Airflow 分支错误，类型错误 : 'NoneType' object is not iterable

Question

尝试调用分支操作时出现以下错误

[2020-01-05 19:11:34,888] {skipmixin.py:78} INFO - Following branch None
[2020-01-05 19:11:34,897] {taskinstance.py:1047} ERROR - 'NoneType' object is not iterable
Traceback (most recent call last):
  File "/root/anaconda3/envs/py3/lib/python3.6/site-packages/airflow/models/taskinstance.py", line 922, in _run_raw_task
    result = task_copy.execute(context=context)
  File "/root/anaconda3/envs/py3/lib/python3.6/site-packages/airflow/operators/python_operator.py", line 142, in execute
    self.skip_all_except(context['ti'], branch)
  File "/root/anaconda3/envs/py3/lib/python3.6/site-packages/airflow/models/skipmixin.py", line 92, in skip_all_except
    for b in branch_task_ids:
TypeError: 'NoneType' object is not iterable
[2020-01-05 19:11:34,900] {taskinstance.py:1076} INFO - All retries failed; marking task as FAILED
[2020-01-05 19:11:35,315] {logging_mixin.py:95} INFO - [[34m2020-01-05 19:11:35,312[0m] {[34mlocal_task_job.py:[0m172} [33mWARNING[0m - [33mState of this instance has been externally set to [1mfailed[0m. Taking the poison pill.[0m
[2020-01-05 19:11:35,321] {helpers.py:319} INFO - Sending Signals.SIGTERM to GPID 25398
[2020-01-05 19:11:35,321] {taskinstance.py:897} ERROR - Received SIGTERM. Terminating subprocesses.

它按 CONVERT_PDF_TO_JPG_TASK 的预期工作

Answer 1

发现问题...这是一个愚蠢的错误，PRE_PROCESS_JPG_TASK 被创建为 BranchPythonOperator 而不是常规 PythonOperator，因此它期望分支 id 作为函数的返回。

(旁注:对 Airflow DAG UI 团队的建议:喜欢这个 UI...但是如果不同的运算符(operator)以不同的颜色表示就太好了。谢谢!)