錯誤1:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired
2019-03-18 10:21:01,623 [pool-5-thread-1-EventThread] WARN org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation - This client just lost it's session with ZooKeeper, closing it. It will be recreated next time someone needs it org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:677) at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:609) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:40) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498) 2019-03-18 10:21:18,758 [pool-5-thread-1-EventThread] INFO org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x1697f22c8e70014 2019-03-18 10:21:18,816 [pool-5-thread-1-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down 分析:往hbase插入大量數據的時候,client連接超時。 可能原因: (1)、hbase內存堆大小設置太小,修改hbase-env.sh文件,把堆大小設置大一些。eg:export HBASE_HEAPSIZE=30720 (2)、hadoop內存堆設置太小,修改hadoop-env.sh,把堆大小設置大一些。eg:export HBASE_HEAPSIZE=8192。默認是1000m (3)、zk最大連接數過小 默認值是300,在查詢量與記錄數量特大的集群中,可能會造成相互間通信連接過多從而拒絕連接服務。 <property> <name>hbase.zookeeper.property.maxClientCnxns</name> <value>15000</value> </property>
錯誤2:Reported time is too far out of sync with master
INFO [regionserver60020] regionserver.HRegionServer: STOPPED: Unhandled: org.apache.hadoop.hbase.ClockOutOfSyncException: Server slave2,60020,1405560498057 has been rejected; Reported time is too far out of sync with master. Time difference of 28804194ms > max allowed of 30000ms 分析:根據錯誤日志,可得到slave2和maste機器時間差太多,查看各個系統的時間,果真如此,同步即可。另外一種方法就是配置hbase的配置文件: 解決: <property> <name>hbase.master.maxclockskew</name> <value>200000</value> <description>Time difference of regionserver from master</description> </property> 盡量同步時間