Upgrading Redis on Heroku causing SSL errors in Celery.

huangapple
go评论93阅读模式
英文:

Upgrading Redis on Heroku causing SSL errors in Celery

问题

我最近将我们的Heroku Redis从版本5.0升级到了7.0.11，现在在运行Celery时遇到以下错误：

  1.  Traceback (most recent call last):
  2.    File "/app/.heroku/python/bin/celery", line 8, in <module>
  3.      sys.exit(main())
  4.    File "/app/.heroku/python/lib/python3.8/site-packages/celery/__main__.py", line 15, in main
  5.      sys.exit(_main())
  6.    File "/app/.heroku/python/lib/python3.8/site-packages/celery/bin/celery.py", line 235, in main
  7.      return celery(auto_envvar_prefix="CELERY")
  8.    File "/app/.heroku/python/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
  9.      return self.main(*args, **kwargs)
  10.    File "/app/.heroku/python/lib/python3.8/site-packages/click/core.py", line 1055, in main
  11.      rv = this.invoke(ctx)
  12.    File "/app/.heroku/python/lib/python3.8/site-packages/click/core.py", line 1657, in invoke
  13.      return _process_result(sub_ctx.command.invoke(sub_ctx))
  14.    File "/app/.heroku/python/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
  15.      return ctx.invoke(this.callback, **ctx.params)
  16.    File "/app/.heroku/python/lib/python3.8/site-packages/click/core.py", line 760, in invoke
  17.      return __callback(*args, **kwargs)
  18.    File "/app/.heroku/python/lib/python3.8/site-packages/click/decorators.py", line 26, in new_func
  19.      return f(get_current_context(), *args, **kwargs)
  20.    File "/app/.heroku/python/lib/python3.8/site-packages/celery/bin/base.py", line 134, in caller
  21.      return f(ctx, *args, **kwargs)
  22.    File "/app/.heroku/python/lib/python3.8/site-packages/celery/bin/worker.py", line 348, in worker
  23.      worker = app.Worker(
  24.    File "/app/.heroku/python/lib/python3.8/site-packages/celery/worker/worker.py", line 98, in __init__
  25.      self.setup_instance(**self.prepare_args(**kwargs))
  26.    File "/app/.heroku/python/lib/python3.8/site-packages/celery/worker/worker.py", line 119, in setup_instance
  27.      self._conninfo = self.app.connection_for_read()
  28.    File "/app/.heroku/python/lib/python3.8/site-packages/celery/app/base.py", line 818, in connection_for_read
  29.      return self._connection(url or self.conf.broker_read_url, **kwargs)
  30.    File "/app/.heroku/python/lib/python3.8/site-packages/celery/app/base.py", line 877, in _connection
  31.      return this.amqp.Connection(
  32.    File "/app/.heroku/python/lib/python3.8/site-packages/kombu/connection.py", line 203, in __init__
  33.      url_params = parse_url(hostname)
  34.    File "/app/.heroku/python/lib/python3.8/site-packages/kombu/utils/url.py", line 50, in parse_url
  35.      query['ssl'][key] = query[key]
  36.  TypeError: 'str' object does not support item assignment

celery.py文件：

  1. from celery import Celery
  3. app = Celery('endpoints')
  5. # namespace='CELERY' means all celery-related configuration keys should have a 'CELERY_' prefix.
  6. app.config_from_object('django.conf:settings', namespace='CELERY')
  7. app.conf.redis_backend_use_ssl = {
  8.                  'ssl_cert_reqs': 'CERT_NONE'
  9.             }
  10. app.conf.broker_use_ssl = {
  11.                  'ssl_cert_reqs': 'CERT_NONE'
  12.             }
  14. # Load task modules from all registered Django app configs.
  15. app.autodiscover_tasks()

requirements.txt文件：

  1. dj-database-url==2.0.0
  2. Django==4.2.2
  3. django-environ==0.9.0
  4. django-storages==1.9.1
  5. djangorestframework==3.14.0
  6. django-cors-headers==3.5.0
  7. django-parler==2.3
  8. redis==4.5.5
  9. celery[redis]==5.3.0

在升级之前一切都正常工作，但这个错误导致Celery立即崩溃。

英文:

I've recently upgraded our Heroku Redis from version 5.0 to 7.0.11 and I'm now receiving the following error when running Celery

  1.  Traceback (most recent call last):
  2.    File &quot;/app/.heroku/python/bin/celery&quot;, line 8, in &lt;module&gt;
  3.      sys.exit(main())
  4.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/celery/__main__.py&quot;, line 15, in main
  5.      sys.exit(_main())
  6.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/celery/bin/celery.py&quot;, line 235, in main
  7.      return celery(auto_envvar_prefix=&quot;CELERY&quot;)
  8.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/click/core.py&quot;, line 1130, in __call__
  9.      return self.main(*args, **kwargs)
  10.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/click/core.py&quot;, line 1055, in main
  11.      rv = self.invoke(ctx)
  12.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/click/core.py&quot;, line 1657, in invoke
  13.      return _process_result(sub_ctx.command.invoke(sub_ctx))
  14.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/click/core.py&quot;, line 1404, in invoke
  15.      return ctx.invoke(self.callback, **ctx.params)
  16.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/click/core.py&quot;, line 760, in invoke
  17.      return __callback(*args, **kwargs)
  18.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/click/decorators.py&quot;, line 26, in new_func
  19.      return f(get_current_context(), *args, **kwargs)
  20.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/celery/bin/base.py&quot;, line 134, in caller
  21.      return f(ctx, *args, **kwargs)
  22.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/celery/bin/worker.py&quot;, line 348, in worker
  23.      worker = app.Worker(
  24.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/celery/worker/worker.py&quot;, line 98, in __init__
  25.      self.setup_instance(**self.prepare_args(**kwargs))
  26.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/celery/worker/worker.py&quot;, line 119, in setup_instance
  27.      self._conninfo = self.app.connection_for_read()
  28.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/celery/app/base.py&quot;, line 818, in connection_for_read
  29.      return self._connection(url or self.conf.broker_read_url, **kwargs)
  30.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/celery/app/base.py&quot;, line 877, in _connection
  31.      return self.amqp.Connection(
  32.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/kombu/connection.py&quot;, line 203, in __init__
  33.      url_params = parse_url(hostname)
  34.    File &quot;/app/.heroku/python/lib/python3.8/site-packages/kombu/utils/url.py&quot;, line 50, in parse_url
  35.      query[&#39;ssl&#39;][key] = query[key]
  36.  TypeError: &#39;str&#39; object does not support item assignment

celery.py

  1. from celery import Celery
  3. app = Celery(&#39;endpoints&#39;)
  5. # namespace=&#39;CELERY&#39; means all celery-related configuration keys should have a `CELERY_` prefix.
  6. app.config_from_object(&#39;django.conf:settings&#39;, namespace=&#39;CELERY&#39;)
  7. app.conf.redis_backend_use_ssl = {
  8.                  &#39;ssl_cert_reqs&#39;: &#39;CERT_NONE&#39;
  9.             }
  10. app.conf.broker_use_ssl = {
  11.                  &#39;ssl_cert_reqs&#39;: &#39;CERT_NONE&#39;
  12.             }
  14. # Load task modules from all registered Django app configs.
  15. app.autodiscover_tasks()

requirements.txt

  1. dj-database-url==2.0.0
  2. Django==4.2.2
  3. django-environ==0.9.0
  4. django-storages==1.9.1
  5. djangorestframework==3.14.0
  6. django-cors-headers==3.5.0
  7. django-parler==2.3
  8. redis==4.5.5
  9. celery[redis]==5.3.0

Everything was working flawlessly prior to the upgrade, but this error is causing celery to crash immediately.

答案1

得分: 0

将此问题的解决方法是将 redis 的要求降级至 4.4.4 并从 celery 的要求中移除 [redis] 附加部分。

英文:

The solution to this issue was to downgrade the redis requirement to 4.4.4 and remove the [redis] extra from the celery requirement.

huangapple
  • 本文由 发表于 2023年6月22日 04:32:18
  • 转载请务必保留本文链接：https://go.coder-hub.com/76526930.html
  • celery
  • django
  • django-celery
  • heroku
  • redis
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定