hadoop - HDFS NFS启动错误: “ERROR portmap.Portmap: Failed to start the server… ChannelException: Failed to bind”

Question

尝试在docs之后使用/启动HDFS NFS，但在尝试设置启动hadoop portmap服务的NFS服务时遇到错误:

[root@HW02 hdfs]# service rpcbind stop
Redirecting to /bin/systemctl stop rpcbind.service
Warning: Stopping rpcbind.service, but it can still be activated by:
  rpcbind.socket
[root@HW02 hdfs]#
[root@HW02 hdfs]#
[root@HW02 hdfs]# hadoop portmap

WARNING: Use of this script to execute portmap is deprecated.

WARNING: Attempting to execute replacement "hdfs portmap" instead.

19/07/23 10:17:14 INFO portmap.Portmap: STARTUP_MSG:

/************************************************************

STARTUP_MSG: Starting Portmap

STARTUP_MSG: host = HW02.co.local/172.18.4.47

STARTUP_MSG: args = []

STARTUP_MSG: version = 3.1.1.3.1.0.0-78

STARTUP_MSG: classpath = /usr/hdp/3.1.0.0-78/hadoop/conf:/usr/hdp/3.1.0.0-78/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.1.0.0-78/hadoop/lib/ranger-hdfs-plugin-shim-1.2.0.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.1.0.0-78/hadoop/lib/ranger-plugin-classloader-1.2.0.3.1.0.0-78.jar:

...<many other jars>...

STARTUP_MSG: build = git@github.com:hortonworks/hadoop.git -r e4f82af51faec922b4804d0232a637422ec29e64; compiled by 'jenkins' on 2018-12-06T12:26Z

STARTUP_MSG: java = 1.8.0_112

************************************************************/

19/07/23 10:17:14 INFO portmap.Portmap: registered UNIX signal handlers for [TERM, HUP, INT]

19/07/23 10:17:14 ERROR portmap.Portmap: Failed to start the server. Cause:

org.jboss.netty.channel.ChannelException: Failed to bind to: 0.0.0.0/0.0.0.0:111

at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)

at org.apache.hadoop.portmap.Portmap.start(Portmap.java:122)

at org.apache.hadoop.portmap.Portmap.main(Portmap.java:65)

Caused by: java.net.BindException: Address already in use

at sun.nio.ch.Net.bind0(Native Method)

at sun.nio.ch.Net.bind(Net.java:433)

at sun.nio.ch.Net.bind(Net.java:425)

at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)

at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)

at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)

at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391)

at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315)

at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)

at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)

at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

19/07/23 10:17:14 INFO portmap.Portmap: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down Portmap at HW02.co.local/172.18.4.47

************************************************************/

不确定如何解释此处看到的任何错误，有关此问题的任何调试建议或解决方案？

Answer 1

在调试另一个NFS网关问题时找到答案，请参阅https://stackoverflow.com/a/57228283/8236733

TLDR :nfs网关服务已经在运行(默认情况下，显然是默认情况)，我认为阻止hadoop nfs3服务(jsvc.exec)的服务已经(正在假设)该服务的一部分已在运行。如果您已经通过ambari管理群集，则为HDP3.1设置用于HDFS的NFS网关的文档不一定是最佳方法。