我尝试在 MWAA 中安装 apache-airflow-providers-google,但 Airflow 似乎没有选择该库:
Broken DAG: [/usr/local/airflow/dags/mi-framework/jobs/google_analytics/main.py] Traceback (most recent call last):
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/usr/local/airflow/dags/mi-framework/jobs/google_analytics/main.py", line 8, in <module>
from airflow.providers.google import *
ModuleNotFoundError: No module named 'airflow.providers.google'
我有以下requirements.txt文件:
apache-airflow[postgres]==2.0.2
apache-airflow[mysql]==2.0.2
apache-airflow-providers-google==6.0.0
sqlalchemy==1.3.24
google-api-python-client==2.27.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
sentry-sdk
我做错了什么?
最佳答案
我假设您的 MWAA Airflow 版本是 2.0。*
因此,基于 Airflow 文档中的以下链接:https://airflow.apache.org/docs/apache-airflow-providers-google/stable/index.html您需要将 apache-airflow-providers-google 降级到 3.0.0
关于google-cloud-platform - MWAA 中的 apache-airflow-providers-google,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/69788020/