google-bigquery - 大查询字符串中的新行

标签 google-bigquery

“字符串中的换行符”到底是什么意思?

https://developers.google.com/bigquery/docs/quota-policy#import

如何查看和删除?

Import Jobs: Daily limit: 1,000 import jobs per table per day (including failures), 10,000 import jobs per project per day (including failures)
Maximum size per import job: 1TB uncompressed
Maximum number of files per import job: 500

最佳答案

字符串中的换行符是指 CSV 字段值中嵌入的换行符。这使得并行导入变得困难。

例如:2 行,第一行嵌入换行符:

1,2,"this is my
string",4,5
1,2,"another string",4,5

BigQuery 导入器具有“--noallow_quoted_newlines”选项,表示该文件不包含任何嵌入的换行符。

# --noallow_quoted_newlines:
#   Do not allow quoted newlines in the data.  This allows BigQuery to parallelize the load.

https://developers.google.com/bigquery/articles/ingestioncookbook#atomic

Individual JSON and CSV files without newlines in string fields may be as large as 100GB, and CSV files that contain newlines within strings must be 4GB or less.

https://developers.google.com/bigquery/articles/ingestioncookbook

关于google-bigquery - 大查询字符串中的新行,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/12792045/

相关文章:

google-bigquery - BigQuery Java API 读取记录数组 : "Retrieving field value by name is not supported" exception

sql - 谷歌 BigQuery : UNNEST where each different key becomes a column

google-bigquery - 给定两个时间戳,计算这些日期之间经过的工作小时数

mysql - BigQuery 根据最接近的时间戳和匹配值合并表

google-bigquery - 如何使用 bigquery 流将嵌套数据插入现有记录

sql - 从 BigQuery 获取用户级别的人口统计数据

google-bigquery - 如何使用第一行的列名将 CSV 导入 BigQuery?

java - BigQuery Java 大型查询的读取可靠性

google-bigquery - 是否可以在 BigQuery 中将外部表转换为 native 表?

google-analytics - `fullVisitorId` => clientId,一对多映射?