ec2 尝试使用 systemd 启动守护进程时出现 Django celery Worker 错误

标签 django linux celery ubuntu-18.04 django-celery

我正在尝试使用 celery 作为我的 ec2 服务器上的守护进程,并且到目前为止一直在关注 this教程。每次我尝试启动 celery 工作守护进程时,日志都会返回以下错误:

systemd[1]: celery.service: Failed to load environment files: No such file or directory
systemd[1]: celery.service: Failed to run 'start' task: No such file or directory
systemd[1]: celery.service: Failed with result 'resources'.
systemd[1]: Failed to start Celery Service.

当我使用运行工作人员时

celery -A project_name worker --loglevel=INFO

celery 按预期运行,但当我注销服务器时关闭。任何帮助解决这个错误的帮助将不胜感激,因为我是这里的一个完整的初学者。下面提供了所有相关文件:

celery.conf

# celery.conf

CELERYD_NODES="w1"
CELERY_BIN="path/to/project/directory/env/bin/celery"
CELERY_APP="project_name"
CELERYD_MULTI="multi"
CELERYD_PID_FILE="/var/run/celery/%n.pid"
CELERYD_LOG_FILE="/var/log/celery/%n%I.log"
CELERYD_LOG_LEVEL="INFO"

celery.service

[Unit]
Description=Celery Service
After=network.target

[Service]
Type=forking
User=username
Group=groupname
EnvironmentFile=/path/to/environmentfile/celery.conf
WorkingDirectory=path/to/project/directory/env/bin/
ExecStart=/bin/sh -c '${CELERY_BIN} -A ${CELERY_APP} multi start ${CELERYD_NODES} \
  --pidfile=${CELERYD_PID_FILE} \
  --logfile=${CELERYD_LOG_FILE} --loglevel=${CELERYD_LOG_LEVEL} ${CELERYD_OPTS}'
ExecStop=/bin/sh -c '${CELERY_BIN} multi stopwait ${CELERYD_NODES} \
  --pidfile=${CELERYD_PID_FILE}'
ExecReload=/bin/sh -c '${CELERY_BIN} -A ${CELERY_APP} multi restart ${CELERYD_NODES} \
  --pidfile=${CELERYD_PID_FILE} \
  --logfile=${CELERYD_LOG_FILE} --loglevel=${CELERYD_LOG_LEVEL} ${CELERYD_OPTS}'

[Install]
WantedBy=multi-user.target

Django 设置:

INSTALLED_APPS = [
    'django.contrib.admin',
    'django.contrib.auth',
    'django.contrib.contenttypes',
    'django.contrib.sessions',
    'django.contrib.messages',
    'django.contrib.staticfiles',
    'rest_framework',
    'rest_framework.authtoken',
    'profiles_api',
    "push_notifications",

]

REST_FRAMEWORK = {
    'DEFAULT_RENDERER_CLASSES': [
        'rest_framework.renderers.JSONRenderer',
        'rest_framework.renderers.BrowsableAPIRenderer',
    ]
}


MIDDLEWARE = [
    'django.middleware.security.SecurityMiddleware',
    'django.contrib.sessions.middleware.SessionMiddleware',
    'django.middleware.common.CommonMiddleware',
    'django.middleware.csrf.CsrfViewMiddleware',
    'django.contrib.auth.middleware.AuthenticationMiddleware',
    'django.contrib.messages.middleware.MessageMiddleware',
    'django.middleware.clickjacking.XFrameOptionsMiddleware',
]

ROOT_URLCONF = 'profiles_project.urls'

TEMPLATES = [
    {
        'BACKEND': 'django.template.backends.django.DjangoTemplates',
        'DIRS': [],
        'APP_DIRS': True,
        'OPTIONS': {
            'context_processors': [
                'django.template.context_processors.debug',
                'django.template.context_processors.request',
                'django.contrib.auth.context_processors.auth',
                'django.contrib.messages.context_processors.messages',
            ],
        },
    },
]

WSGI_APPLICATION = 'profiles_project.wsgi.application'


# Database
# https://docs.djangoproject.com/en/3.0/ref/settings/#databases

DATABASES = {
    'default': {
        'ENGINE': 'django.db.backends.mysql',
        'NAME': 'name',
        'USER': 'name',
        'PASSWORD': '***',
        'HOST': '', # Or an IP Address that your DB is hosted on
        'PORT': '',
    },
}
#

# Password validation
# https://docs.djangoproject.com/en/3.0/ref/settings/#auth-password-validators

AUTH_PASSWORD_VALIDATORS = [
    {
        'NAME': 'django.contrib.auth.password_validation.UserAttributeSimilarityValidator',
    },
    {
        'NAME': 'django.contrib.auth.password_validation.MinimumLengthValidator',
    },
    {
        'NAME': 'django.contrib.auth.password_validation.CommonPasswordValidator',
    },
    {
        'NAME': 'django.contrib.auth.password_validation.NumericPasswordValidator',
    },
]


# Internationalization
# https://docs.djangoproject.com/en/3.0/topics/i18n/

LANGUAGE_CODE = 'en-us'

TIME_ZONE = 'UTC'

USE_I18N = True

USE_L10N = True

USE_TZ = True


# Static files (CSS, JavaScript, Images)
# https://docs.djangoproject.com/en/3.0/howto/static-files/

STATIC_URL = '/static/'

AUTH_USER_MODEL = 'profiles_api.UserProfile'

STATIC_ROOT = 'static/'

# celery
BROKER_URL = 'redis://localhost:5555'
RESULT_BACKEND = 'redis://localhost:5555'
ACCEPT_CONTENT = ['application/json']
RESULT_SERIALIZER = 'json'
TASK_SERIALIZER = 'json'

最佳答案

我已经通过编辑我的 celery.service 文件来解决这个问题

celery.service

[Unit]
Description=Celery Service
After=network.target

    [Service]
    #Type=forking
    User=username
    Group=groupname
    KillMode=control-group
    RemainAfterExit=yes
    WorkingDirectory=path/to/project/directory
    Restart=yes
    #PassEnvironment=CELERYD_NODES CELERY_BIN CELERY_APP CELERYD_MULTI CELERYD_PID_FILE CELERYD_LOG_FILE CELERYD_LOG_LEVEL
    
    ExecStart=path/to/project/directory/env/bin/celery -A project_name worker --loglevel=INFO
    
    ExecStop=path/to/project/directory/env/bin/celery -A project_name worker --loglevel=INFO
    
    
    
    ExecReload=path/to/project/directory/env/bin/celery -A project_name worker --loglevel=INFO
    
    
    [Install]
    WantedBy=multi-user.target

关于ec2 尝试使用 systemd 启动守护进程时出现 Django celery Worker 错误,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/64300287/

相关文章:

django - 如何在 Django 中执行 SELECT MAX?

python - 外键默认值的 ValueError

python - django Rest框架如何删除多余的查询?

c - 如何添加文件大小

在 Linux 用户模式下退出 init 的正确方法

python - 基于集合作为数据结构而不是列表的分布式任务队列

python - Django 文件 uploader 抛出错误 "cannot pickle ' _io.BufferedRandom' object"同时使用 celery 上传更多感谢 2.5mb 的图像

python - 如何使用 Django REST Framework 构建嵌套路由?

django - 在 Amazon SQS 上关闭 CELERY.BACKEND_CLEANUP

linux - 如何列出 nginx 中的所有虚拟主机