hbase集群部分節點HRegionServer啟動后自動關閉的問題

參考鏈接

http://f.dataguru.cn/thread-209058-1-1.html

我有４ＨRegionServer節點，1個master,其中３個是unbuntu 系統，２個節點是centos 6.5，

啟動過程都很正常，但是一會后slave3 的HRegionServer會自動關閉.

查看tail -n100 hbase-hadoop-regionserver-Slave3.log日志如下:

015-07-04 16:18:52,761 WARN  [regionserver/Slave3/192.168.2.38:16020] zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper, quorum=Master:2181,Slave1:2181,Slave2:2181,Slave3:2181,Slavrg.apache.zookeeper.KeeperException$OperationTimeoutException: KeeperErrorCode = OperationTimeout
2015-07-04 16:18:52,761 ERROR [regionserver/Slave3/192.168.2.38:16020] zookeeper.RecoverableZooKeeper: ZooKeeper delete failed after 4 attempts
2015-07-04 16:18:52,762 WARN  [regionserver/Slave3/192.168.2.38:16020] regionserver.HRegionServer: Failed deleting my ephemeral node
org.apache.zookeeper.KeeperException$OperationTimeoutException: KeeperErrorCode = OperationTimeout
        at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.checkZk(RecoverableZooKeeper.java:145)
        at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.delete(RecoverableZooKeeper.java:179)
        at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1347)
        at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1336)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.deleteMyEphemeralNode(HRegionServer.java:1391)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1074)
        at java.lang.Thread.run(Thread.java:745)
2015-07-04 16:18:52,767 INFO  [regionserver/Slave3/192.168.2.38:16020] regionserver.HRegionServer: stopping server Slave3,16020,1435997816385; zookeeper connection close

 

 

通過調整系統時間解決問題了.參考內容復制如下:

2、問題原因是時間不致造成的，解決方法如下：
1）在hbase-site.xml文件中 修改增加 ，將時間改大點
<property>
<name>hbase.master.maxclockskew</name>
<value>150000</value>
</property>
2）修改系統時間，將時間改為一致（建議采用本方法）：
修改日期
date -s 11/23/2013
修改時間
date -s 15:14:00
檢查硬件（CMOS）時間
clock -r
將系統時間寫入CMOS
clock -w

3、修改完成后單獨啟動HRegionServer節點即可：
啟動集群中所有的regionserver
./hbase-daemons.sh start regionserver
啟動某個regionserver
./hbase-daemon.sh start regionserver

其實最好關閉hbase和hadoop之后重啟,才能瀏覽器http://192.168.2.35:16010/查看到結果.