Cloudera hadoop配置文件地址和修改配置屬性方法

問題導讀
1.cloudera 的配置文件路徑默認在什么位置？
2.如何通過cloudera manager web UI修改配置文件？

配置文件地址：
Hadoop: /etc/hadoop/conf
hbase: /etc/hadoop/conf
hive: /etc/hive/conf

使用cloudera manager web UI 修改hadoop .xml文件屬性方法：

For Cloudera the best way to push this configuration to the nodes is to use the Cloudera manager GUI.

 

 From the Cloudera web page, click on the HDFS service under Status to open the HDFS service.

 

 

 

Click Configuration, and choose View and Edit

 

 

On the left panel expand Service-Wide and click advance

 

 

 

Click on Cluster-wide Configuration Safety Valve for core-site.xml

Enter the setting from Table above

 

 

 Settings entered into core-site safety valve

 

 

At the top right of the page, Click Save Changes

 

 

Go back to the Cloudera Manager Home screen. Using the drop down stop the HDFS service.

 

 

 

Using the drop down, restart the Mapreduce service.

 

 

 

Check that the nodes have received the correct configuration. From the CLI on a node do a grep on the core-site.xml and search for HSK

cat /etc/hadoop/conf.cloudera.hdfs1/core-site.xml |grep HSK

 

Next Upload the Java ViPR client JAR file to a client using WinSCP and copy it to the Hadoop Classpath on all Hadoop nodes.

 

On the first node where you have uploaded the ViPr client copy it to the Cloudera Classpath

cp hadoop-2.0.x-alpha-viprfs-1.0.1.jar /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/hadoop/lib

 

 

 

Copy it to all the other nodes in your cluster using the scp command. Do this for all hosts.

scp hadoop-2.0.x-alpha-viprfs-1.0.1.jar [e-mail] :/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/hadoop/lib

 

 

 Validate that the connection is working with a hadoop list command. First using the ViPR URL then just a normal Hadoop list:

 

修改Hive配置文件路徑的方法： hive1->configuration->view and edit->default->HiveServer2->Advanced

如果想對hive-site.xml的修改存儲在Cloudera Manager，則可通過上面的方法選擇Hive Service Configuration Safety Valve for hive-site.xml來添加屬性。
如果想要將所添加的屬性，出現在服務器的/etc/hive/conf/hive-site.xml文件中，則可以hive1->configuration->view and edit->default->Gateway->Advanced->Hive Client Configuration Safety Valve for hive-site.xml
.
Be sure to restart Hive, restart any dependent services (Hue and Impala), and deploy client configs after making a configuration change.