我有一个文本格式配置单元表,例如:
CREATE EXTERNAL TABLE op_log (
time string, debug string,app_id string,app_version string, ...more fields)
PARTITIONED BY (dt string)
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'
STORED AS TEXTFILE;
现在我用相同的字段创建一个兽人格式表,例如
CREATE TABLE op_log_orc (
time string, debug string,app_id string,app_version string, ...more fields)
PARTITIONED BY (dt string)
STORED AS ORC tblproperties ("orc.compress" = "SNAPPY");
当我从op_log
复制到op_log_orc
时,出现以下错误:
hive> insert into op_log_orc PARTITION(dt='2016-08-09') select * from op_log where dt='2016-08-09';
FAILED: SemanticException [Error 10044]: Line 1:12 Cannot insert into target table because column number/types are different ''2016-08-09'': Table insclause-0 has 62 columns, but query has 63 columns.
hive>
最佳答案
源表中的分区键(dt
)就像常规字段一样返回到结果集中,因此您有多余的列。如果要在分区键中指定其值,请从字段列表中排除dt
字段(而不是*
)。或者,只需将dt
指定为分区的名称,而不提供值。请参见此处示例中的CTAS(将表创建为select ...):https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-CreateTableAsSelect(CTAS)
关于hadoop - 如何在Hive中将TEXT格式的分区表复制到ORC格式的表,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/38841409/