hadoop - CDH5 上的启动/停止 hadoop hdfs/mapred 脚本在哪里

标签 hadoop cloudera-manager cloudera-cdh

CDH4 的文档引用了 /etc/init.d/hadoop-* 脚本,但这些在 CDH5 中不再存在。

我已经仔细阅读了文档,但未能成功找到/理解什么是 CDH5 等价物。我能找到的最接近的是 SCM 经理:

http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM5/latest/Cloudera-Manager-Administration-Guide/cm5ag_agents.html

将不胜感激新流程 (/es) 的指针和解释。

最佳答案

我在 Cloudera 用户的邮件列表上收到了来自 Harsh 的回复:

它们仍在同一位置,但只有在您安装 遵循非 CM 指南。 CM 依赖于它自己的脚本。

我正在跟进 Harsh 以确定如何改进当前安装以包含这些脚本。

更新关于邮件列表的进一步讨论:

来自 Jarek:

Don't be deceived by the fact that we are not using "master" branches - you have to check out release specific branches. For example slightly more then one moth old 5.0.1 sources are available in branch:

https://github.com/cloudera/hadoop-common/tree/cdh5-2.3.0_5.0.1

根据 Jark 的指针,下面的方法成功了:

git clone -b  cdh5-2.3.0_5.0.1 https://github.com/cloudera/hadoop-common.git

让我们来看看结果:

hadoop-common $git status

On branch cdh5-2.3.0_5.0.1
Your branch is up-to-date with 'origin/cdh5-2.3.0_5.0.1'.

看起来我正在寻找的脚本就在那里:

07:41:00/hadoop-common $find . -name st\*.sh

./hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
./hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
./hadoop-mapreduce1-project/bin/start-mapred.sh
./hadoop-mapreduce1-project/bin/stop-mapred.sh
./hadoop-mapreduce1-project/src/contrib/thriftfs/scripts/start_thrift_server.sh
./hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh
./hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh

这就是我要找的。

关于hadoop - CDH5 上的启动/停止 hadoop hdfs/mapred 脚本在哪里,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/24113166/

相关文章:

apache-spark - java.lang.AbstractMethodError,org.apache.spark.internal.Logging$class.initializeLogIfNecessary

hadoop - 如何解决 YARN 日志中的 Log aggregation has not completed or is not enabled 错误

cloudera - cloudera中包裹的缺点

hadoop - Cloudera安装问题(scm_prepare_node.sh:权限被拒绝)

hadoop - Cloudera Manager 中的 dfs_hosts_allow

hadoop - 如何防止 CDH 中的 Hue 在重启时清除作业历史记录?

apache-spark - 排除CDH对spark-core的依赖

hadoop - 您如何设置具有不同批处理持续时间的多个 Spark Streaming 作业?

hadoop - 实际执行Map和Reduce操作的方式

hadoop - 如何避免为 Hive 查询生成空的 .deflate 文件?