google-app-engine - Go Bigquery 上的 DEADLINE_EXCEEDED

标签 google-app-engine go google-bigquery

我们的应用程序在访问 Big Query 时有时会看到 DEADLINE_EXCEEDED。

import (
    "cloud.google.com/go/bigquery"
    "golang.org/x/net/context"
    "google.golang.org/api/option"
)

func MyFunc(ctx context.Context) {
            :
    client, err := bigquery.NewClient(ctx, PROJECT_ID, option.WithServiceAccountFile(SERVICE_ACCOUNT_JSON_FILE_PATH))
    query := client.Query("SELECT * FROM ....")
    it, err := query.Read(ctx)
    var list []MyStruct
    for {
        var m MyStruct
        err := it.Next(&m)
        if err == iterator.Done {
            break
        }
        if err != nil {
           <Error Handling>
        }
        list = append(list, m)
    }
            :
}

有时我们会看到这个错误。

Get https://www.googleapis.com/bigquery/v2/projects/myproject/queries/job_zandIeLwH0s8f3FAQ_ORC0zau14?alt=json\u0026startIndex=0\u0026timeoutMs=60000: API error 5 (urlfetch: DEADLINE_EXCEEDED): ('The read operation timed out',)"

看起来超时是 5 秒,但我找不到如何更改超时秒数。

我读了this post ,我修改了我的源代码如下。

ctx_with_deadline, _ := context.WithTimeout(ctx, 1*time.Minute)
httpClient := &http.Client{
    Transport: &oauth2.Transport{
        Base: &urlfetch.Transport{Context: ctx_with_deadline},
    },
}

client, err := bigquery.NewClient(ctx, PROJECT_ID, option.WithServiceAccountFile(SERVICE_ACCOUNT_JSON_FILE_PATH), option.WithHTTPClient(httpClient))

然后我遇到了这个错误。

Post https://www.googleapis.com/bigquery/v2/projects/myproject/jobs?alt=json: oauth2: Transport's Source is nil

如何在 Go Bigquery 中更改超时?

最佳答案

在创建 bigquery 客户端的新实例时也使用 ctx_with_deadline:

client, err := bigquery.NewClient(ctx_with_deadline, PROJECT_ID, option.WithServiceAccountFile(SERVICE_ACCOUNT_JSON_FILE_PATH‌​), option.WithHTTPClient(httpClient))

关于google-app-engine - Go Bigquery 上的 DEADLINE_EXCEEDED,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/43339181/

相关文章:

python - Google应用程序引擎从ndb key 对象获取字符串 key

authentication - OAuth2.0的用例

python-3.x - "pyarrow.lib.ArrowInvalid: Casting from timestamp[ns] to timestamp[ms] would lose data"在没有架构的情况下向 BigQuery 发送数据时

google-app-engine - 主/从数据存储与高复制数据存储

google-app-engine - 运行Dart应用程序的Docker构建找不到pubspec.yaml

postgresql - Postgres 中的 Go 和 IN 子句

python - Golang单元测试python函数

google-bigquery - bigquery MERGE DML 与相关子查询

google-bigquery - BigQuery 高效查询最新表

google-app-engine - 部署 java google app engine 灵活应用程序时出错 - 等待应用程序基础架构变得健康时超时