hadoop - 使用importtsv将数据加载到HBASE中会导致错误

标签 hadoop hbase apache-zookeeper

我正在尝试使用importtsv工具将数据从CSV文件加载到HBASE中。我已经建立了3台机器的集群。
这是我的hbase-site.xml文件

<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://ec2-54-190-103-64.us-west-2.compute.amazonaws.com:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
 <property>
   <name>hbase.zookeeper.quorum</name>
   <value>ec2-54-203-95-235.us-west-2.compute.amazonaws.com</value>
  </property>
 <property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>

  <property>
      <name>hbase.zookeeper.property.clientPort</name>
      <value>2222</value>
   </property>
   <property>
   <name>hbase.zookeeper.property.dataDir</name>
   <value>/home/ubuntu/zookeeper</value>
   <description>Property from ZooKeeper's config zoo.cfg.
   The directory where the snapshot is stored.
    </description>
 </property>
 </configuration>

当我启动并运行jps时。在主节点下,我看到HMaster,在数据节点下,我看到Hquorumpeer和Hregionserver
当我尝试加载数据时出现以下错误
INFO zookeeper.ClientCnxn: Opening socket connection to server       localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
 14/08/11 07:41:28 WARN zookeeper.ClientCnxn: Session 0x0 for server null,    unexpected     error, closing socket connection and attempting reconnect
  java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at   org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   14/08/11 07:41:28 WARN zookeeper.RecoverableZooKeeper: Possibly transient   ZooKeeper    exception: org.apache.zookeeper.KeeperException$ConnectionLossException:    KeeperErrorCode = ConnectionLoss for /hbase
 14/08/11 07:41:28 INFO util.RetryCounter: Sleeping 8000ms before retry #3...
  14/08/11 07:41:29 INFO zookeeper.ClientCnxn: Opening socket connection to server   localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)

不知道Zookeeper有什么问题。提前致谢

最佳答案

您需要在hbase-site.xml文件中添加以下属性(主服务器和从服务器)

<property>
 <name>hbase.zookeeper.property.maxClientCnxns</name>
 <value>1000</value>
</property>

关于hadoop - 使用importtsv将数据加载到HBASE中会导致错误,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/25238160/

相关文章:

mysql - 从 Hadoop Reducer 向 MySQL 写入数据

apache-kafka - Kafka消费者在Mesos上运行时出现 "Failed to add leader for partitions"错误

java - Zookeeper集群如何实现2pc?

java - Kafka Java 消费者仅适用于本地主机,无法用于远程服务器

java - Hadoop名称节点格式化窗口-java.lang.UnsupportedOperationException

hadoop - 当(减少的数量)一项作业超过群集的容量时,预期会导致什么性能损失?

hadoop - 如何获取HDFS中特定时间之后创建的目录列表?

HBase RowMutations 替换一行的所有列

hadoop - 在HBase中进行扫描和过滤

hadoop - 极大 MAX_FILESIZE 的缺点