The celery worker disconnected with redis pod and messages are in queued status #594
Unanswered
anu251989
asked this question in
Questions & Answers
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
The redis pod restarted after celery worker pod during deployment. the celery worker disconnected with redis and not able to reestablish the connection with redis. This issue facing in Airflow version: 2.2.5 and in airflow1.10.12 the worker pod reestablish the connection.
[2022-05-30 17:53:06,186: ERROR/MainProcess] consumer: Cannot connect to redis://:@airflow-redis-master.-----*.svc.cluster.local:6379/1: Connection refused..
Trying again in 12.00 seconds... (6/100)
[2022-05-30 17:53:18,228: INFO/MainProcess] mingle: searching for neighbors
[2022-05-30 17:53:19,239: INFO/MainProcess] mingle: all alone
[2022-05-30 17:53:24,246: INFO/MainProcess] missed heartbeat from celery@airflow-worker-0
Anyone faced this issue in airflow2.2.5. How to make celery worker to reestablish the connection with redis?
Beta Was this translation helpful? Give feedback.
All reactions