我有一个 Django 应用程序,我在 task.py
下定义了一些 @task
函数,以在给定的定期任务中执行。我 100% 确定该问题不是由 task.py
或任何相关代码引起的,而是由于 settings.py
或我的 celery Worker 中可能存在某些配置。
任务确实以周期性任务执行,但多次执行。
以下是 celery 工作日志:
celery -A cimexmonitor worker --loglevel=info -B -c 4
[2019-09-19 21:22:16,360: INFO/ForkPoolWorker-5] Project Monitor Started : APPProject1
[2019-09-19 21:22:16,361: INFO/ForkPoolWorker-4] Project Monitor Started : APPProject1
[2019-09-19 21:25:22,108: INFO/ForkPoolWorker-4] Project Monitor DONE : APPProject1
[2019-09-19 21:25:45,255: INFO/ForkPoolWorker-5] Project Monitor DONE : APPProject1
[2019-09-20 00:22:16,395: INFO/ForkPoolWorker-4] Project Monitor Started : APPProject2
[2019-09-20 00:22:16,398: INFO/ForkPoolWorker-5] Project Monitor Started : APPProject2
[2019-09-20 01:22:11,554: INFO/ForkPoolWorker-5] Project Monitor DONE : APPProject2
[2019-09-20 01:22:12,047: INFO/ForkPoolWorker-4] Project Monitor DONE : APPProject2
如果您检查上述时间间隔,tasks.py 会执行一个任务,但 2 个 celery 工作人员会执行该任务并以相同的时间间隔执行相同的任务。我不明白为什么 2 个 worker 承担一项任务?
settings.py
..
..
# Internationalization
# https://docs.djangoproject.com/en/2.1/topics/i18n/
LANGUAGE_CODE = 'en-us'
TIME_ZONE = 'Asia/Kolkata'
USE_I18N = True
USE_L10N = True
USE_TZ = True
..
..
..
######## CELERY : CONFIG
CELERY_BROKER_URL = 'redis://localhost:6379'
CELERY_RESULT_BACKEND = 'redis://localhost:6379'
CELERY_ACCEPT_CONTENT = ['application/json']
CELERY_TASK_SERIALIZER = 'json'
CELERY_RESULT_SERIALIZER = 'json'
CELERY_ENABLE_UTC = True
CELERYBEAT_SCHEDULER = 'django_celery_beat.schedulers:DatabaseScheduler'
- celery.py
from __future__ import absolute_import, unicode_literals
from celery import Celery
import os
from django.conf import settings
os.environ.setdefault('DJANGO_SETTINGS_MODULE','cimexmonitor.settings')
## set the default Django settings module for the 'celery' program.
# Using a string here means the worker don't have to serialize
# the configuration object to child processes.
# - namespace='CELERY' means all celery-related configuration keys
# should have a `CELERY_` prefix.
app = Celery('cimexmonitor')
#app.config_from_object('django.conf:settings', namespace='CELERY')
app.config_from_object('django.conf:settings')
# Load task modules from all registered Django app configs.
app.autodiscover_tasks(settings.INSTALLED_APPS)
@app.task(bind=True)
def debug_task(self):
print('Request: {0!r}'.format(self.request))
- 其他信息:
→ celery --version
4.3.0 (rhubarb)
→ redis-server --version
Redis server v=3.0.6 sha=00000000:0 malloc=jemalloc-3.6.0 bits=64 build=7785291a3d2152db
django-admin-interface==0.9.2
django-celery-beat==1.5.0
- 请帮助我调试问题的方法:
谢谢
最佳答案
worker 和beat 服务需要同时运行,以便按照https://github.com/celery/django-celery-beat
定期执行任务
- worker :
$ celery -A [project-name] worker --loglevel=info -B -c 5
- Django 调度程序:
celery -A [project-name] beat -l info --scheduler django_celery_beat.schedulers:DatabaseScheduler
- 我同时运行工作程序和数据库调度程序,根据文档所述,这导致问题同时执行,我真的不确定
celery工作程序
同时开始作为数据库调度程序工作。 - 只需运行
celeryworker
就解决了我的问题。
关于python - Celery 任务在 Django 应用程序中执行多次,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/58029514/