目前正在使用 Hadoop 学习 Apache Pig，并使用 6200 万的庞大数据集。只是尝试执行正常的 COUNT 函数并不断出现错误。我分配了 8G 的 RAM，我可以轻松地使用 HIVE 来完成，但似乎遇到解析问题或堆分配问题，每次都不同。我在虚拟机上使用hadoop。
错误是:
file script.pig, line 3, column 39> Failed to generate logical plan. Nested exception: org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
ERROR org.apache.pig.PigServer - exception during parsing: Error during parsing. Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
ERROR 1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
我的 pig 代码
a = LOAD 'bigData_orc' using org.apache.hive.hcatalog.pig.HCatLoader();
b = group a ALL;
c = foreach b generate group as rap, count(a) as counter;
dump c;`
最佳答案
Could not resolve count
尝试将 COUNT() Pig 函数大写
关于java - Apache Pig 分配和解析计数问题，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/39130220/