gunicorn - Airflow 网络服务器启动 - Gunicorn 工作人员关闭

标签 gunicorn airflow

我在 docker 上的 centos7 上运行 Airflow 1.8，但我的网络服务器无法访问浏览器。我通过pip2.7安装了airflow。 Flower ui 显示良好，initdb 运行连接到 postgres 和 redis 后端，使用 CeleryExecutor，在 ECS 上运行，我以 root 身份运行。网络服务器正在通过 Airflow 网络服务器部署到默认 8080。

有谁知道下面显示的日志中gunicorn worker 退出的原因/解决方案是什么？具体来说，好像就是这一行

ERROR - [0 / 0] some workers seem to have died and gunicorndid not restart them as expected

整个日志... 

[2018-04-13 20:05:01,161] {db.py:287} INFO - Creating tables
INFO  [alembic.runtime.migration] Context impl PostgresqlImpl.
INFO  [alembic.runtime.migration] Will assume transactional DDL.
Done.
[2018-04-13 20:05:02,358] {__init__.py:57} INFO - Using executor CeleryExecutor
/usr/local/lib/python2.7/site-packages/flask/exthook.py:71: ExtDeprecationWarning: Importing flask.ext.cache is deprecated, use flask_cache instead.
  .format(x=modname), ExtDeprecationWarning
  ____________       _____________
 ____    |__( )_________  __/__  /________      __
____  /| |_  /__  ___/_  /_ __  /_  __ \_ | /| / /
___  ___ |  / _  /   _  __/ _  / / /_/ /_ |/ |/ /
 _/_/  |_/_/  /_/    /_/    /_/  \____/____/|__/

[2018-04-13 20:05:03,363] [1] {models.py:167} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2018-04-13 20:05:04,488] {__init__.py:57} INFO - Using executor CeleryExecutor
[2018-04-13 20:05:04 +0000] [18] [INFO] Starting gunicorn 19.3.0
[2018-04-13 20:05:04 +0000] [18] [INFO] Listening at: http://0.0.0.0:8080 (18)
[2018-04-13 20:05:04 +0000] [18] [INFO] Using worker: sync
[2018-04-13 20:05:04 +0000] [24] [INFO] Booting worker with pid: 24
[2018-04-13 20:05:05 +0000] [25] [INFO] Booting worker with pid: 25
/usr/local/lib/python2.7/site-packages/flask/exthook.py:71: ExtDeprecationWarning: Importing flask.ext.cache is deprecated, use flask_cache instead.
  .format(x=modname), ExtDeprecationWarning
[2018-04-13 20:05:05 +0000] [26] [INFO] Booting worker with pid: 26
[2018-04-13 20:05:05 +0000] [27] [INFO] Booting worker with pid: 27
/usr/local/lib/python2.7/site-packages/flask/exthook.py:71: ExtDeprecationWarning: Importing flask.ext.cache is deprecated, use flask_cache instead.
  .format(x=modname), ExtDeprecationWarning
Running the Gunicorn Server with:
Workers: 4 sync
Host: 0.0.0.0:8080
Timeout: 120
Logfiles: - -
=================================================================            
/usr/local/lib/python2.7/site-packages/flask/exthook.py:71: ExtDeprecationWarning: Importing flask.ext.cache is deprecated, use flask_cache instead.
  .format(x=modname), ExtDeprecationWarning
/usr/local/lib/python2.7/site-packages/flask/exthook.py:71: ExtDeprecationWarning: Importing flask.ext.cache is deprecated, use flask_cache instead.
  .format(x=modname), ExtDeprecationWarning
[2018-04-13 20:05:06,461] [24] {models.py:167} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2018-04-13 20:05:07,873] [1] {cli.py:723} ERROR - [0 / 0] some workers seem to have died and gunicorndid not restart them as expected
[2018-04-13 20:05:08,271] [27] {models.py:167} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2018-04-13 20:05:08,271] [25] {models.py:167} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2018-04-13 20:05:08,271] [26] {models.py:167} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2018-04-13 20:05:09 +0000] [25] [INFO] Parent changed, shutting down: <Worker 25>
[2018-04-13 20:05:09 +0000] [25] [INFO] Worker exiting (pid: 25)
[2018-04-13 20:05:09 +0000] [26] [INFO] Parent changed, shutting down: <Worker 26>
[2018-04-13 20:05:09 +0000] [26] [INFO] Worker exiting (pid: 26)
[2018-04-13 20:05:09 +0000] [27] [INFO] Parent changed, shutting down: <Worker 27>
[2018-04-13 20:05:09 +0000] [27] [INFO] Worker exiting (pid: 27)

我发誓我不久前就开始工作了，不知道发生了什么。这是我安装的 pip 软件包列表

airflow (1.8.0)
alembic (0.8.10)
amqp (2.2.2)
asn1crypto (0.24.0)
awscli (1.15.4)
Babel (2.5.3)
backports-abc (0.5)
billiard (3.5.0.3)
boto3 (1.7.4)
botocore (1.10.4)
celery (4.0.2)
certifi (2018.1.18)
cffi (1.11.5)
chardet (3.0.4)
click (6.7)
colorama (0.3.7)
croniter (0.3.20)
cryptography (2.2.2)
Cython (0.28.2)
dill (0.2.7.1)
docutils (0.14)
enum34 (1.1.6)
Flask (0.11.1)
Flask-Admin (1.4.1)
Flask-Cache (0.13.1)
Flask-Login (0.2.11)
flask-swagger (0.2.13)
Flask-WTF (0.12)
flower (0.9.2)
funcsigs (1.0.0)
future (0.15.2)
futures (3.2.0)
gitdb2 (2.0.3)
GitPython (2.1.9)
gunicorn (19.3.0)
idna (2.6)
ipaddress (1.0.19)
itsdangerous (0.24)
Jinja2 (2.8.1)
jmespath (0.9.3)
kombu (4.1.0)
lockfile (0.12.2)
lxml (3.8.0)
Mako (1.0.7)
Markdown (2.6.11)
MarkupSafe (1.0)
ndg-httpsclient (0.4.4)
numpy (1.14.2)
ordereddict (1.1)
pandas (0.22.0)
pip (9.0.3)
psutil (4.4.2)
psycopg2-binary (2.7.4)
pyasn1 (0.4.2)
pycparser (2.18)
Pygments (2.2.0)
pyOpenSSL (17.5.0)
python-daemon (2.1.2)
python-dateutil (2.7.2)
python-editor (1.0.3)
python-nvd3 (0.14.2)
python-slugify (1.1.4)
pytz (2018.4)
PyYAML (3.12)
redis (2.10.6)
requests (2.18.4)
rsa (3.4.2)
s3transfer (0.1.13)
setproctitle (1.1.10)
setuptools (39.0.1)
singledispatch (3.4.0.3)
six (1.11.0)
smmap2 (2.0.3)
SQLAlchemy (1.2.6)
tabulate (0.7.7)
thrift (0.9.3)
tornado (5.0.2)
Unidecode (1.0.22)
urllib3 (1.22)
vine (1.1.4)
Werkzeug (0.14.1)
wheel (0.31.0)
WTForms (2.1)
zope.deprecation (4.3.0)

更新 我从源代码安装，现在从网络服务器收到此错误

[2018-04-14 00:20:48,594] {{cli.py:718}} ERROR - [0 / 0] some workers seem to have died and gunicorndid not restart them as expected
[2018-04-14 00:20:50,396] {{models.py:197}} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2018-04-14 00:20:50,396] {{models.py:197}} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2018-04-14 00:20:50,396] {{models.py:197}} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2018-04-14 00:24:18,135] {{cli.py:725}} ERROR - No response from gunicorn master within 120 seconds
[2018-04-14 00:24:23,032] {{cli.py:726}} ERROR - Shutting down webserver

我认为这是 https://issues.apache.org/jira/browse/AIRFLOW-1235 的结果当gunicorn worker 死亡时，它会关闭网络服务器。我认为....

更新 好的，这以某种方式自行解决了。不知道怎么做，因为我做了很多事情，但是使用 greenlet、eventlet、gevent 安装 Gunicorn 可能会有所帮助，而且它可能是我的入口点上的一些东西，也许与执行 airflow webserver 时的并发有关。就在airflow initdb之后。留下这个问题，因为我之前也曾在 puckel 安装中遇到过这个问题，并且很想知道这是否是其他人面临的错误以及这个问题是什么。

最佳答案

因此，当您从源代码安装时，您获得了 https://issues.apache.org/jira/browse/AIRFLOW-1235 的修复程序，我认为当工作人员死亡时，它会重新启动主工作人员和工作人员。 我还看到我的工作人员因 MySQL session /连接损坏而死亡。 EG 来自 SQLAlchemy 的异常，要么是事务因并发锁而失败并需要重试，而 Airflow 模型没有任何逻辑，要么是 InvalidRequestError: This session is in 'prepared' state; no further SQL can be emitted within this transaction.但一般不AT启动。

我在启动时遇到两次错误，一次是由于 AWS 中的安全组而无法建立与数据库的连接，一次是我们的 3000 多个 dags 花了很长时间才添加到 DAG Bag，工作人员的超时被触发，他们在设置代码完成之前就关闭了自己。我很想看看这个设置代码是否可以改进或从工作人员中移出。

关于gunicorn - Airflow 网络服务器启动 - Gunicorn 工作人员关闭，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/49824969/

上一篇：windows-7 - "Cannot find a valid peer process to connect to"启动虚拟机时的 VMware Workstation 10.0.1

下一篇：three.js - THREEJS中MeshPhongMaterial和ShaderMaterial有什么区别

相关文章：

python - 我可以添加对媒体 django 媒体文件的权限吗？

logging - 当 Airflow 尝试写入日志时 Errno 13 权限被拒绝

python - 使用自定义文件名进行 Airflow 记录？

amazon-web-services - 502使用Nginx，Gunicorn和Flask的错误网关

nginx 仅将基本 '/' url 传递给gunicorn

nginx - 错误(没有这样的过程)Nginx+Gunicorn+Supervisord

Django Channels Nginx 制作

airflow - Cloud Composer 将文件写入其他存储桶问题

airflow - 从 GitHub 在 debian 8 上安装 Apache Airflow 1.9

python - Airflow 中 DAG 配置文件的建议方式是什么

©2024 IT工具网  联系我们