windows - 映射减少错误 : Failed to setup local dir

Question

我在 Windows 8 上安装的 hadoop 上运行 mapreduce wordcount 示例。我收到如下错误。这听起来像是一个安全许可问题。但我不太确定。 我在 yarn-site.xml 文件中添加了一个属性

<property>
        <name>yarn.nodemanager.local-dirs</name>
        <value>c:\hadoop\tmp-nm</value>
</property>

任何想法都会很有帮助!

15/07/15 11:01:54 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
15/07/15 11:01:55 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
15/07/15 11:01:56 INFO input.FileInputFormat: Total input paths to process : 2
15/07/15 11:01:56 INFO mapreduce.JobSubmitter: number of splits:2
15/07/15 11:01:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1436976054610_0001
15/07/15 11:01:57 INFO impl.YarnClientImpl: Submitted application application_1436976054610_0001
15/07/15 11:01:58 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1436976054610_0001/
15/07/15 11:01:58 INFO mapreduce.Job: Running job: job_1436976054610_0001
15/07/15 11:02:03 INFO mapreduce.Job: Job job_1436976054610_0001 running in uber mode : false
15/07/15 11:02:03 INFO mapreduce.Job:  map 0% reduce 0%
15/07/15 11:02:03 INFO mapreduce.Job: Job job_1436976054610_0001 failed with state FAILED due to: Application application_1436976054610_0001 failed 2
times due to AM Container for appattempt_1436976054610_0001_000002 exited with  exitCode: -1000
For more detailed output, check application tracking page:http://localhost:8088/cluster/app/application_1436976054610_0001Then, click on links to logs of each attempt.
Diagnostics: Failed to setup local dir c:/hadoop/tmp-nm, which was marked as good.
Failing this attempt. Failing the application.
15/07/15 11:02:03 INFO mapreduce.Job: Counters: 0

Answer 1

我刚刚遇到了同样的问题。这是一个权限问题，您基本上需要将所有权更改为 c:/hadoop/tmp-nm 文件夹中所有文件夹的用户帐户。尝试仅更改 tmp-nm 的所有权是行不通的，因为您必须手动更改 tmp-nm 内所有子文件夹的所有权。