hadoop - Oozie 服务未启动

标签 hadoop hadoop-streaming oozie

我有一个运行 Map-Reduce V1 的 CDH4 集群。当我尝试从 tarball 安装 oozie CDh4 并按照给出的说明进行配置时 https://ccp.cloudera.com/display/CDH4DOC/Oozie+Installation#OozieInstallation-Configuringthehadoopversion

在启动服务时,我在日志中收到以下错误

INFO: Starting Servlet Engine: Apache Tomcat/6.0.32
    11 Oct, 2012 11:51:57 PM org.apache.catalina.startup.HostConfig deployDescriptor
    INFO: Deploying configuration descriptor oozie.xml

    ERROR: Oozie could not be started

    REASON: java.lang.NoClassDefFoundError: org/apache/hadoop/util/ReflectionUtils

    Stacktrace:
    -----------------------------------------------------------------
    java.lang.NoClassDefFoundError: org/apache/hadoop/util/ReflectionUtils
        at org.apache.oozie.service.Services.setServiceInternal(Services.java:349)
        at org.apache.oozie.service.Services.<init>(Services.java:107)
        at org.apache.oozie.servlet.ServicesLoader.contextInitialized(ServicesLoader.java:38)
        at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4205)
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:4704)
        at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)
        at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
        at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:601)
        at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:675)
        at org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:601)
        at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:502)
        at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1315)
        at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)
        at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
        at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1061)
        at org.apache.catalina.core.StandardHost.start(StandardHost.java:840)
        at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053)
        at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463)
        at org.apache.catalina.core.StandardService.start(StandardService.java:525)
        at org.apache.catalina.core.StandardServer.start(StandardServer.java:754)
        at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
        at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
    Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.ReflectionUtils

最佳答案

我在 CDH4 文档中没有看到这个,但是在 CDH3u3 下你必须将 hadoop-core 库复制到 <oozie-home>/lib 中.该 jar 包含堆栈跟踪中缺少的类。

编辑:

对于我的生活,我也无法在 cdh3u3 的任何地方的文档中找到它。所以,我复制了它和我需要的其他 jar,但我不记得我是在哪里读到的。

关于hadoop - Oozie 服务未启动,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/12840167/

相关文章:

hadoop - 访问正在写入的文件

java - Hadoop - 文本到浮点转换的问题

hadoop - 按值顺序排序Hadoop

python - Hadoop Streaming with TextInputFormat 和 Python - 跟踪行号

hadoop - Oozie 仅在指定时间范围内运行作业

hadoop - reducer 会耗尽Java堆空间

hadoop - 如何将自定义 hadoop native 编解码器编译为 libhadoop.so?

perl - 使用Hadoop的有效方法来消隐在列中出现少于X次的值

exception - 如何在 Oozie 中获取有关已终止作业的更具体的错误信息

hadoop - Oozie shell 操作可以在 HDFS 上创建输出文件吗?