java - 使用 hadoop-mapreduce-examples-2.7.7.jar 时出错

标签 java hadoop hdfs

我有hadoop

hadoop@nodo1:/opt/hadoop$ hadoop version Hadoop 2.7.7 Subversion Unknown -r c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac Compiled by stevel on 2018-07-18T22:47Z Compiled with protoc 2.5.0 From source with checksum 792e15d20b12c74bd6f19a1fb886490 This command was run using /opt/hadoop/share/hadoop/common/hadoop-common-2.7.7.jar

正如在类(class)中学到的,我使用

/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar wordcount 

但是当我运行它时,会显示下一个错误:

hadoop@nodo1:/opt/hadoop$ hadoop jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar wordcount /libros /output3

org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://nodo1:9000/output3 already exists at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:146) at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:266) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:139) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308) at org.apache.hadoop.examples.WordCount.main(WordCount.java:87) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71) at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:226) at org.apache.hadoop.util.RunJar.main(RunJar.java:141)

在路上我有一本书

hadoop@nodo1:/opt/hadoop$ hdfs dfs -ls /libros/ Found 1 items -rw-r--r-- 1 hadoop supergroup 2198927 2018-11-02 10:22 /libros/quijote.txt

TNK 来自你的帮助

最佳答案

先做

hdfs dfs -ls /output3

如果有文件的话,

或者删除,输出目录hdfs://nodo1:9000/output3 或者,

使用不同的文件名

# Change output3 to output4
hadoop jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar wordcount /libros /output4 

关于java - 使用 hadoop-mapreduce-examples-2.7.7.jar 时出错,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/53123677/

相关文章:

java - 如何找到正则表达式模式而不将其包含在结果中?

apache-spark - 扩展 DefaultCodec 以支持 Hadoop 文件的 Zip 压缩

hadoop - 如何在映射器中为每个输入记录输出单独的文件?

hadoop - 不寻常的 Hadoop 错误 - 任务自行终止

hadoop - 在 hadoop-gremlin 中使用 OneTimeBulkLoader 的 janusgraph 引发 "Graph does not support adding vertices"

hadoop - 如何设置用户特定的HDFS垃圾回收间隔?

hadoop - 从一个集群到另一个集群的 HDFS 数据传输不适用于 distcp

java - 如何将 .p12 或 pem 证书导入 java keystore ?

Java 8 : performance of Streams vs Collections

java - 获取数据库表的触发器名称