java - Eclipse 环境中的 Hadoop

标签 java linux eclipse ssh hadoop

运行 http://developer.yahoo.com/hadoop/tutorial/module3.html#running 提供的字数统计示例 我在 yahoo 提供的虚拟机上运行 hadoop，并通过 ssh 客户端连接到虚拟机。

我收到这些错误:

12/07/13 00:10:03 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
12/07/13 00:10:03 INFO mapred.FileInputFormat: Total input paths to process : 2
12/07/13 00:10:03 INFO mapred.FileInputFormat: Total input paths to process : 2
12/07/13 00:10:04 INFO mapred.JobClient: Running job: job_201207121015_0021
12/07/13 00:10:05 INFO mapred.JobClient:  map 0% reduce 0%
12/07/13 00:10:10 INFO mapred.JobClient: Task Id : attempt_201207121015_0021_m_000000_0, Status : FAILED
java.lang.UnsupportedClassVersionError: WordCountReducer : Unsupported major.minor version 51.0
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(Unknown Source)
    at java.security.SecureClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.access$000(Unknown Source)
    at java.net.URLClassLoader$1.run(Unknown Source)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClassInternal(Unknown Source)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Unknown Source)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:628)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:646)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:672)
    at org.apache.hadoop.mapred.JobConf.getCombinerClass(JobConf.java:780)
    at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:403)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:193)
    at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2209)

12/07/13 00:10:10 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:10 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:10 INFO mapred.JobClient: Task Id : attempt_201207121015_0021_m_000001_0, Status : FAILED
java.lang.UnsupportedClassVersionError: WordCountReducer : Unsupported major.minor version 51.0
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(Unknown Source)
    at java.security.SecureClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.access$000(Unknown Source)
    at java.net.URLClassLoader$1.run(Unknown Source)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClassInternal(Unknown Source)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Unknown Source)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:628)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:646)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:672)
    at org.apache.hadoop.mapred.JobConf.getCombinerClass(JobConf.java:780)
    at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:403)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:193)
    at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2209)

12/07/13 00:10:10 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:10 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:14 INFO mapred.JobClient: Task Id : attempt_201207121015_0021_m_000000_1, Status : FAILED
java.lang.UnsupportedClassVersionError: WordCountReducer : Unsupported major.minor version 51.0
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(Unknown Source)
    at java.security.SecureClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.access$000(Unknown Source)
    at java.net.URLClassLoader$1.run(Unknown Source)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClassInternal(Unknown Source)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Unknown Source)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:628)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:646)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:672)
    at org.apache.hadoop.mapred.JobConf.getCombinerClass(JobConf.java:780)
    at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:403)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:193)
    at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2209)

12/07/13 00:10:14 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:14 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:15 INFO mapred.JobClient: Task Id : attempt_201207121015_0021_m_000001_1, Status : FAILED
java.lang.UnsupportedClassVersionError: WordCountReducer : Unsupported major.minor version 51.0
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(Unknown Source)
    at java.security.SecureClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.access$000(Unknown Source)
    at java.net.URLClassLoader$1.run(Unknown Source)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClassInternal(Unknown Source)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Unknown Source)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:628)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:646)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:672)
    at org.apache.hadoop.mapred.JobConf.getCombinerClass(JobConf.java:780)
    at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:403)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:193)
    at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2209)

12/07/13 00:10:15 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:15 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:19 INFO mapred.JobClient: Task Id : attempt_201207121015_0021_m_000000_2, Status : FAILED
java.lang.UnsupportedClassVersionError: WordCountReducer : Unsupported major.minor version 51.0
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(Unknown Source)
    at java.security.SecureClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.access$000(Unknown Source)
    at java.net.URLClassLoader$1.run(Unknown Source)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClassInternal(Unknown Source)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Unknown Source)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:628)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:646)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:672)
    at org.apache.hadoop.mapred.JobConf.getCombinerClass(JobConf.java:780)
    at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:403)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:193)
    at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2209)

12/07/13 00:10:19 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:19 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:19 INFO mapred.JobClient: Task Id : attempt_201207121015_0021_m_000001_2, Status : FAILED
java.lang.UnsupportedClassVersionError: WordCountReducer : Unsupported major.minor version 51.0
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(Unknown Source)
    at java.security.SecureClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.defineClass(Unknown Source)
    at java.net.URLClassLoader.access$000(Unknown Source)
    at java.net.URLClassLoader$1.run(Unknown Source)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClassInternal(Unknown Source)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Unknown Source)
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:628)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:646)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:672)
    at org.apache.hadoop.mapred.JobConf.getCombinerClass(JobConf.java:780)
    at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:403)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:193)
    at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2209)

12/07/13 00:10:19 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
12/07/13 00:10:19 WARN mapred.JobClient: Error reading task outputhadoop-desk.localdomain
java.io.IOException: Job failed!
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1113)
    at WordCount.main(WordCount.java:33)

最佳答案

您正在使用 Java7 编译代码，而 Hadoop 在 Java6 上运行。您可以让 Hadoop 在 Java7 上运行或为 Java6 编译您的代码。

关于java - Eclipse 环境中的 Hadoop，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/11467813/

上一篇：c++ - 在 Linux 上使用 Qt 实现 C++ HTTPS SOAP 客户端

下一篇：linux - linux shell中如何判断当前伪终端的主动监听？

相关文章：

java - 在 software ag webmethods 中使用第三方库会导致 InitationTargetException

java - 如何在 Struts 2 JSP 结果中链接到外部网站上的图像/css 文件？

php - 如何在 Debian VPS 上将 PHPmyadmin 更新到 4.0.4.1

c - USB 上的 Linux 串行设备服务器？

linux - crontab 星期几语法

java - 一个java程序中有2个方法

java - 如何解决运行jar文件时出现 "Could not find or load main class"问题

java - 为什么从浏览器下载的文件已损坏？

java - Spring Boot 自定义约束验证组件

java - 无法从 eclipse neon 推送到 bitbucket

©2024 IT工具网  联系我们