我遇到一个奇怪的错误。我正在运行带有where子句的简单select *查询,以下是查询执行状态的摘要
我需要解决第3点。
这是我正在获取的错误跟踪,无法找到此故障的根本原因以及此错误日志试图传达的内容。
at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380)
at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:257)
at org.apache.hive.service.cli.operation.SQLOperation.access$800(SQLOperation.java:91)
at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:348)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1840)
at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:362)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)' SQL<select `ID`, `ISDELETED`, `ACCOUNTID`, `CREATEDBYID`, `CREATEDDATE`, `FIELD`, `OLDVALUE`, `NEWVALUE`, `AUDIT_UPD_TS`, `SRC_OP_TYP`, `GG_INGEST_TS` from `t4i_ent_sfdc_b2b_psa`.`sf_accounthistory` x WHERE SRC_OP_TYP='NA'>```
最佳答案
我能够解决这个问题。问题是我没有通过指定用户就通过JDBC将应用程序连接到Hive。对于需要简单数据流的查询,它是成功的,但是在触发Map-Reduce作业写入HDFS的查询中,写入操作失败,并显示错误
Failed to execute tez graph.
org.apache.hadoop.security.AccessControlException: Permission denied: user=anonymous, access=WRITE, inode="/user":hdfs:hadoop:drwxr-xr-x
为了解决这个问题,我添加了user = hadoop;在JDBC URL中,查询现在可以正常运行。
关于hadoop - 从Beeline连接时,Hive查询在Tez上失败,但在Map-Reduce上成功,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/58761935/