我通过aws上的自定义jar步骤来运行一系列Mapper和Reducer任务。我只想通过一个reducer运行最后一个reducer任务。我怎样才能做到这一点?
最佳答案
也许:
SET mapreduce.job.reduces=XX
来自:How do you force the number of reducers in a map reduce job to be higher? - Hortonworks
也许:
SET mapred.reduce.tasks=XX
来自:hadoop - How does Hive choose the number of reducers for a job? - Stack Overflow
关于java - 如何在EMR上设置 reducer 数量,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/54897613/