Storm集群參數調整

Supervisor 參數調整

• 修改${STORM_HOME}conf/storm.yaml文件內容

supervisor變更參數

• slots 配置：
  • 若storm host僅僅執行supervisor(不包含nimbus)時，slots數目 = (Memory GB - 1 )
  • 若同時包含了storm nimbus、ui、supervisor時，slots = (Memory GB - 1 )

supervisor.slots.ports

• worker.childopts 配置：

worker.childopts: "-Xmx1g -Xms1g -server -XX:+UseCompressedOops -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC"

supervisor重啟腳本

spid=`jps | grep supervisor | awk '{print $1}'`

if [ "x${spid}" != "x" ]
then
	kill ${spid}
	storm supervisor
fi

nimbus與ui 參數調整

• worker.childopts影響storm ui頁面展示信息，因此也調整和supervisor一致

worker.childopts: "-Xmx1g -Xms1g -server -XX:+UseCompressedOops -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC"

nimbus重啟

npid=`jps | grep nimbus | awk '{print $1}'`

if [ "x${npid}" != "x" ]
then
	kill ${npid}
	storm nimbus
fi

ui重啟

nimbus重啟

upid=`jps | grep core | awk '{print $1}'`

if [ "x${upid}" != "x" ]
then
	kill ${upid}
	storm nimbus
fi