hadoop(五)scp命令copy文件和配置(完全分布式准備二)|7


機器的克隆參考centos7克隆ip|機器名|映射關系|別名配置(hadoop完全分布式准備一)

那么問題來了,如果我們有30台機器,之間可以互相訪問,那我們如何快速安裝配置環境如jdk hadoop等?
可通過scp命令將配置、下載好的工具等直接copy到我們新的機器上就可以了。

scp(secure copy)安全copy

Scp定義:
Scp可以實現服務器與服務器之間的數據copy。(from server1 to server2)
基本語法

Scp     -r         $pair/$fname                 $user@hadoop&host:$pdir/$fname 命令 遞歸 要copy的文件路徑/名稱 目標用戶@主機:目標路徑名稱 

操作實例
在hadoop101上,將hadoop101中/opt/module目錄下的軟件copy到hadoop102上。

scp/opt/module shaozhiqi@hadoop102:/opt 

實際操作時發現報錯了:

[shaozhiqi@hadoop101 ~]$ scp -r /opt/module shaozhiqi@hadoop102: /opt ^Z [1]+ Stopped scp -r /opt/module shaozhiqi@hadoop102: /opt/ [shaozhiqi@hadoop101 ~]$ scp -r /opt/module shaozhiqi@hadoop102:/opt/ ssh: Could not resolve hostname hadoop102: Name or service not kno lost connection 

那就去修改hadoop101的/etc/hosts
添加上與102/103/104等機器的映射配置,否則在執行命令時只能使用ip

[shaozhiqi@hadoop101 ~]$ vi /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 192.168.1.101 hadoop101 192.168.1.102 hadoop102 192.168.1.103 hadoop103 192.168.1.104 hadoop104 192.168.1.105 hadoop105 192.168.1.106 hadoop106 192.168.1.107 hadoop107 192.168.1.108 hadoop108 

Reboot后
再次執行scp

[shaozhiqi@hadoop101 ~]$ scp -r /opt/module shaozhiqi@hadoop102: /opt/module [shaozhiqi@hadoop102 module]$ ll total 8 drwxr-xr-x. 15 shaozhiqi shaozhiqi 4096 Jun 22 22:04 hadoop-3.1.2 drwxr-xr-x. 7 shaozhiqi shaozhiqi 4096 Jun 22 21:59 jdk1.8.0_211 [shaozhiqi@hadoop102 module]$ 

在103上將101的數據copy過來 ./表示當前目錄

[shaozhiqi@hadoop103 module]$ scp –r shaozhiqi@hadoop101:/opt/module ./ [shaozhiqi@hadoop103 module]$ ll total 8 drwxr-xr-x. 15 shaozhiqi shaozhiqi 4096 Jun 22 22:41 hadoop-3.1.2 drwxr-xr-x. 7 shaozhiqi shaozhiqi 4096 Jun 22 22:26 jdk1.8.0_211 [shaozhiqi@hadoop103 module]$ 

在103copy 102module到104,執行命令輸入102和104的密碼

[shaozhiqi@hadoop103 module]$ scp -r shaozhiqi@hadoop102:/opt/module shaozhiqi@hadoop104:/opt/ 

如果之前沒有module,需要用root用戶執行scp
那么執行結束后就需要執行chown進行授權

[shaozhiqi@hadoop103 opt]$ cd module/ [shaozhiqi@hadoop103 module]$ ll total 8 drwxr-xr-x. 15 root root 4096 Jun 23 00:21 hadoop-3.1.2 drwxr-xr-x. 7 root root 4096 Jun 23 00:19 jdk1.8.0_211 [shaozhiqi@hadoop103 opt]$ sudo chown shaozhiqi:shaozhiqi module/ -R [shaozhiqi@hadoop103 opt]$ ll total 0 drwxr-xr-x. 4 shaozhiqi shaozhiqi 44 Jun 23 00:19 module drwxr-xr-x. 2 shaozhiqi shaozhiqi 6 Jun 18 05:58 software 

將101上配置的環境變量copy過來
cat /etc/profile

[shaozhiqi@hadoop101 ~]$ scp /etc/profile root@hadoop102:/etc/profile root@hadoop102's password: profile 100% 1985 1.9KB/s 00:00 [shaozhiqi@hadoop101 ~]$ scp /etc/profile root@hadoop103:/etc/profile root@hadoop103's password: profile 100% 1985 1.9KB/s 00:00 [shaozhiqi@hadoop101 ~]$ scp /etc/profile root@hadoop104:/etc/profile root@hadoop104's password: profile 100% 1985 1.9KB/s 00:00 [shaozhiqi@hadoop101 ~]$ 

重新加載環境配置
source /etc/profile
java –version
如果是openJKD則可刪除
刪除方式參考[Hadoop學習(一) centos7 jdk安裝,hadoop安裝
刪除后再次
source /etc/profile
驗證

[shaozhiqi@hadoop103 ~]$ java -version
java version "1.8.0_211" Java(TM) SE Runtime Environment (build 1.8.0_211-b12) Java HotSpot(TM) 64-Bit Server VM (build 25.211-b12, mixed mode) [shaozhiqi@hadoop103 ~]$


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM