apache - 使用Hadoop 2.4.1时Oozie 4.0.1构建错误

标签 apache maven hadoop oozie hcatalog

我正在尝试使用命令使用centOS 6.5在Hadoop 2.4.1上构建Oozie 4.0.1

bin/mkdistro.sh -P hadoop-2 -DskipTests 

此时构建失败
[INFO] Apache Oozie Main .................................. SUCCESS [  0.688 s]
[INFO] Apache Oozie Client ................................ SUCCESS [ 24.719 s]
[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.1 .............. SUCCESS [  0.431 s]
[INFO] Apache Oozie Hadoop Distcp 1.1.1.oozie-4.0.1 ....... SUCCESS [  0.035 s]
[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.1 Test ......... SUCCESS [  0.065 s]
[INFO] Apache Oozie Hadoop 2.3.0.oozie-4.0.1 .............. SUCCESS [  1.626 s]
[INFO] Apache Oozie Hadoop 2.3.0.oozie-4.0.1 Test ......... SUCCESS [  0.098 s]
[INFO] Apache Oozie Hadoop Distcp 2.3.0.oozie-4.0.1 ....... SUCCESS [  0.038 s]
[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.1 ............. SUCCESS [  1.176 s]
[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.1 Test ........ SUCCESS [  0.087 s]
[INFO] Apache Oozie Hadoop Distcp 0.23.5.oozie-4.0.1 ...... SUCCESS [  0.028 s]
[INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [  1.493 s]
[INFO] Apache Oozie Hbase 0.94.2.oozie-4.0.1 .............. SUCCESS [  0.148 s]
[INFO] Apache Oozie Hbase Libs ............................ SUCCESS [  0.319 s]
[INFO] Apache Oozie HCatalog 0.5.0.oozie-4.0.1 ............ FAILURE [  0.127 s]
[INFO] Apache Oozie HCatalog Libs ......................... SKIPPED
[INFO] Apache Oozie Share Lib Oozie ....................... SKIPPED
[INFO] Apache Oozie Share Lib HCatalog .................... SKIPPED
[INFO] Apache Oozie Core .................................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
[INFO] Apache Oozie Share Lib Distcp ...................... SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 31.826 s
[INFO] Finished at: 2015-01-02T21:17:00+05:30
[INFO] Final Memory: 40M/358M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project oozie-hcatalog: Could not resolve dependencies for project org.apache.oozie:oozie-hcatalog:jar:0.5.0.oozie-4.0.1: Failed to collect dependencies at org.apache.hcatalog:hcatalog-server-extensions:jar:0.5.0-incubating -> org.apache.hcatalog:hcatalog-core:jar:0.5.0-incubating -> org.apache.hive:hive-metastore:jar:0.10.0 -> org.datanucleus:datanucleus-enhancer:jar:2.0.3 -> asm:asm:jar:[3.0, 4.0): No versions available for asm:asm:jar:[3.0, 4.0) within specified range -> [Help 1]

我尝试过的存储库链接如下:
<url>https://repository.cloudera.com/cloudera/ext-release-local/</url>      
<url>http://121.241.113.72:8080/archiva/repository/internal/</url>
<url>http://maven.icm.edu.pl/artifactory/repo</url> 
<url>https://github.com/CeON/oozie-maven-plugin</url>
<url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
<url>http://repository.jboss.org/nexus/content/groups/public-jboss/</url>
<url>http://repo1.maven.org/maven2/</url>

但是所有这些都导致相同的错误,并且发行版创建过程仅在该特定点失败。
对于hadoop 2.4.1,我还更改了必需的POM条目。
cd hadooplibs
File hadoop-2/pom.xml : change hadoop-client & hadoop-auth dependency version to 2.4.1
File hadoop-distcp-2/pom.xml: change hadoop-distcp version to 2.4.1
File hadoop-test-2/pom.xml: change hadoop-minicluster version to 2.4.1

在Oozie POM主文件中

        <profile>
            <id>hadoop-2</id>
            <activation>
                <activeByDefault>false</activeByDefault>
            </activation>
            <properties>
               <hadoop.version>2.4.1</hadoop.version>
               <hadoop.auth.version>2.4.1</hadoop.auth.version>
               <pig.classifier>h2</pig.classifier>
               <sqoop.classifier>hadoop200</sqoop.classifier>
            </properties>
        </profile>


请告诉我使用Hadoop 2.4.1安装此Oozie 4.0.1的方法任何帮助将不胜感激。

最佳答案

请点击以下链接构建oozie 4.1.0。

http://gauravkohli.com/2014/08/26/apache-oozie-installation-on-hadoop-2-4-1/

其工作正常。正在使用hadoop 2.6.0的构建

关于apache - 使用Hadoop 2.4.1时Oozie 4.0.1构建错误,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/27740762/

相关文章:

python - 使用 mod_rewrite 隐藏在 Web 浏览器上访问的 Python 脚本的 .py 扩展名

java - Selenium 中的线程 "main"java.lang.NullPointerException 中出现异常

使用 HDFS 在 RAM 中缓存

Apache Jackrabbit 在 WebDAV 匿名访问中抛出 403

apache - apache2 如何拒绝与非托管域的连接

apache - 如何在 Apache Tomcat 7 中重定向 URL?

maven - 指定的 XML 文件没有任何关联的样式表

maven - 如何在 mvn assembly :single? 期间关联 Ant 任务

hadoop - 安装cloudera manager后无法执行任何hadoop命令

hadoop - 错误 hive.HiveConfig : Could not load org. apache.hadoop.hive.conf.HiveConf。确保 HIVE_CONF _DIR 设置正确