java - Hadoop map reduce hipi.mapreduce.BinaryOutputFormat 未找到

标签 java opencv hadoop mapreduce hipi

尝试对 HIB 中的图像运行 Facecount 作业时,出现此异常。我在类路径中包含了 hipi-2.1.0.jar。

Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)
at org.apache.hadoop.util.Shell.run(Shell.java:487)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)

在 hadoop 作业日志中打印了以下堆栈跟踪。

org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.hipi.mapreduce.BinaryOutputFormat not found
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:519)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:499)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.callWithJobClassLoader(MRAppMaster.java:1598)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.createOutputCommitter(MRAppMaster.java:499)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:285)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$5.run(MRAppMaster.java:1556)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1553)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1486)
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.hipi.mapreduce.BinaryOutputFormat not found
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2195)
    at org.apache.hadoop.mapreduce.task.JobContextImpl.getOutputFormatClass(JobContextImpl.java:222)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:515)
    ... 11 more
Caused by: java.lang.ClassNotFoundException: Class org.hipi.mapreduce.BinaryOutputFormat not found
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2101)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2193)
    ... 13 more

如何解决这个问题?

最佳答案

看起来 hadoop 没有带您的类路径目录,您是否尝试将 hipi-2.1.0.jar 放入 hadoop-mapreduce/lib/文件夹中?

如果您使用的是 cloudera,这是您必须放置库的位置,它应该在所有节点上。

/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/

关于java - Hadoop map reduce hipi.mapreduce.BinaryOutputFormat 未找到,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/36760193/

相关文章:

python - 在 Python+OpenCV 中,如何测试 cv.CaptureFromFile 返回值是否失败?

c++ - 如何找到改变偏航时风力涡轮机叶片形成的角度?

java - 无法在映射器、MapReduce 中访问 hashmap

java mysql 更新

java - 更改属性 View 中属性的顺序

Java FlowLayout 确实把我的图片画得很小

hadoop - 在 Hbase 表之上创建 Hive 表时出错

java - 转换到泛型导致 Java 中的 ArrayStoreException

opencv - HoughlinesP 参数 "threshold"和 "minLineLength"

java - hadoop map reduce 程序未运行不受支持的 major.minor 版本