google-cloud-platform - MWAA 中的 apache-airflow-providers-google

标签 google-cloud-platform airflow mwaa

我尝试在 MWAA 中安装 apache-airflow-providers-google,但 Airflow 似乎没有选择该库:

    Broken DAG: [/usr/local/airflow/dags/mi-framework/jobs/google_analytics/main.py] Traceback (most recent call last):
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/usr/local/airflow/dags/mi-framework/jobs/google_analytics/main.py", line 8, in <module>
    from airflow.providers.google import *
ModuleNotFoundError: No module named 'airflow.providers.google'

我有以下requirements.txt文件:

apache-airflow[postgres]==2.0.2
apache-airflow[mysql]==2.0.2
apache-airflow-providers-google==6.0.0
sqlalchemy==1.3.24
google-api-python-client==2.27.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
sentry-sdk

我做错了什么?

最佳答案

我假设您的 MWAA Airflow 版本是 2.0。*

因此,基于 Airflow 文档中的以下链接:https://airflow.apache.org/docs/apache-airflow-providers-google/stable/index.html您需要将 apache-airflow-providers-google 降级到 3.0.0

Image from airflow documentation

关于google-cloud-platform - MWAA 中的 apache-airflow-providers-google,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/69788020/

相关文章:

python - 如何从 Python 脚本上传字节图像到 Google Cloud Storage

docker - 无法使用云构建上传非图像工件

node.js - knex 是否支持云 Spanner

airflow - 达格似乎失踪了

amazon-web-services - MWAA Airflow 缩放 : what do I do when I have to run frequent & time consuming scripts? (Negsignal.SIGKILL)

google-cloud-platform - GCP 是否提供多区域虚拟机实例?

python - 测试时如何查看 Airflow 运算符(operator)的日志

amazon-ec2 - "Error:/run/airflow doesn' t 存在。将 systemd 用于 Airflow 网络服务器时可以为 't create pidfile."

airflow - MWAA Apache Airflow DAG 导入 EcsOperator 时出错