ubuntu下用vagrant搭建集群環境


1、安裝virtualbox

終端輸入:sudo apt-get install virtualbox(事實從來都不是一番風順的.......)

正在讀取軟件包列表... 完成
正在分析軟件包的依賴關系樹
正在讀取狀態信息... 完成
virtualbox-5.0:i386 已經是最新的版本了。
您可能需要運行“apt-get -f install”來糾正下列錯誤:
下列軟件包有未滿足的依賴關系:
virtualbox-5.0:i386 : 依賴: libcurl3:i386 (>= 7.16.2) 但是它將不會被安裝
依賴: libdevmapper1.02.1:i386 (>= 2:1.02.20) 但是它將不會被安裝
依賴: libpython2.7:i386 (>= 2.7) 但是它將不會被安裝
依賴: libsdl1.2debian:i386 (>= 1.2.11) 但是它將不會被安裝
依賴: libxmu6:i386 但是它將不會被安裝
依賴: psmisc:i386 但是它將不會被安裝
推薦: libsdl-ttf2.0-0:i386 但是它將不會被安裝
推薦: dkms:i386 但無法安裝它
推薦: linux-headers:i386
推薦: gcc:i386 但是它將不會被安裝
推薦: binutils:i386 但是它將不會被安裝
推薦: pdf-viewer:i386
E: 有未能滿足的依賴關系。請嘗試不指明軟件包的名字來運行“apt-get -f install”(也可以指定一個解決辦法)。

為解決這個問題,按照提示做,終端輸入:sudo apt-get -f install(事實通常是一波三折的........)

W: 無法下載 bzip2:/var/lib/apt/lists/partial/mirrors.ustc.edu.cn_ubuntu_dists_quantal-updates_main_binary-i386_Packages Hash 校驗和不符
W: 無法下載 bzip2:/var/lib/apt/lists/partial/mirrors.ustc.edu.cn_ubuntu_dists_quantal-updates_universe_binary-i386_Packages Hash 校驗和不符
W: 無法下載 bzip2:/var/lib/apt/lists/partial/mirrors.ustc.edu.cn_ubuntu_dists_quantal-security_main_binary-i386_Packages Hash 校驗和不符
W: 無法下載 bzip2:/var/lib/apt/lists/partial/mirrors.ustc.edu.cn_ubuntu_dists_quantal-security_universe_binary-i386_Packages Hash 校驗和不符
E: Some index files failed to download. They have been ignored, or old ones used instead.

什么鬼......,百度了一下,終於找到了解決辦法,終端輸入:

sudo mv /var/lib/apt/lists /var/lib/apt/lists.bak

sudo mkdir /var/lib/apt/lists
然后繼續:sudo apt-get -f install(成功)
終於修復了依賴關系
再試一遍:sudo apt-get install virtualbox(成功)
將會同時安裝下列軟件:
  dkms libgsoap8 libqt5x11extras5 libsdl1.2debian libvncserver1
  virtualbox-dkms virtualbox-qt
建議安裝:
  vde2 virtualbox-guest-additions-iso
下列軟件包將被【卸載】:
  virtualbox-5.2:i386
下列【新】軟件包將被安裝:
  dkms libgsoap8 libqt5x11extras5 libsdl1.2debian libvncserver1 virtualbox
  virtualbox-dkms virtualbox-qt
升級了 0 個軟件包,新安裝了 8 個軟件包,要卸載 1 個軟件包,有 236 個軟件包未被升級。
需要下載 24.3 MB/24.7 MB 的歸檔。
解壓縮后將會空出 77.8 MB 的空間。
您希望繼續執行嗎? [Y/n] y
獲取:1 http://cn.archive.ubuntu.com/ubuntu xenial/main amd64 libsdl1.2debian amd64 1.2.15+dfsg1-3 [168 kB]
獲取:2 http://cn.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 virtualbox-dkms all 5.1.38-dfsg-0ubuntu1.16.04.1 [650 kB]
獲取:3 http://cn.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 virtualbox amd64 5.1.38-dfsg-0ubuntu1.16.04.1 [15.9 MB]
獲取:4 http://cn.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 virtualbox-qt amd64 5.1.38-dfsg-0ubuntu1.16.04.1 [7,503 kB]
已下載 24.3 MB,耗時 2分 46秒 (146 kB/s)                                                                                                                                                                   
(正在讀取數據庫 ... 系統當前共安裝有 405828 個文件和目錄。)
正在卸載 virtualbox-5.2:i386 (5.2.16-123759~Ubuntu~xenial) ...
正在處理用於 libc-bin (2.23-0ubuntu10) 的觸發器 ...
正在處理用於 gnome-menus (3.13.3-6ubuntu3.1) 的觸發器 ...
正在處理用於 desktop-file-utils (0.22-1ubuntu5.1) 的觸發器 ...
正在處理用於 bamfdaemon (0.5.3~bzr0+16.04.20160824-0ubuntu1) 的觸發器 ...
Rebuilding /usr/share/applications/bamf-2.index...
正在處理用於 mime-support (3.59ubuntu1) 的觸發器 ...
正在處理用於 shared-mime-info (1.5-2ubuntu0.1) 的觸發器 ...
正在處理用於 hicolor-icon-theme (0.15-0ubuntu1) 的觸發器 ...
正在選中未選擇的軟件包 dkms。
(正在讀取數據庫 ... 系統當前共安裝有 404991 個文件和目錄。)
正准備解包 .../dkms_2.2.0.3-2ubuntu11.5_all.deb  ...
正在解包 dkms (2.2.0.3-2ubuntu11.5) ...
正在選中未選擇的軟件包 libgsoap8:amd64。
正准備解包 .../libgsoap8_2.8.28-1_amd64.deb  ...
正在解包 libgsoap8:amd64 (2.8.28-1) ...
正在選中未選擇的軟件包 libqt5x11extras5:amd64。
正准備解包 .../libqt5x11extras5_5.5.1-3build1_amd64.deb  ...
正在解包 libqt5x11extras5:amd64 (5.5.1-3build1) ...
正在選中未選擇的軟件包 libsdl1.2debian:amd64。
正准備解包 .../libsdl1.2debian_1.2.15+dfsg1-3_amd64.deb  ...
正在解包 libsdl1.2debian:amd64 (1.2.15+dfsg1-3) ...
正在選中未選擇的軟件包 libvncserver1:amd64。
正准備解包 .../libvncserver1_0.9.10+dfsg-3ubuntu0.16.04.2_amd64.deb  ...
正在解包 libvncserver1:amd64 (0.9.10+dfsg-3ubuntu0.16.04.2) ...
正在選中未選擇的軟件包 virtualbox-dkms。
正准備解包 .../virtualbox-dkms_5.1.38-dfsg-0ubuntu1.16.04.1_all.deb  ...
正在解包 virtualbox-dkms (5.1.38-dfsg-0ubuntu1.16.04.1) ...
正在選中未選擇的軟件包 virtualbox。
正准備解包 .../virtualbox_5.1.38-dfsg-0ubuntu1.16.04.1_amd64.deb  ...
正在解包 virtualbox (5.1.38-dfsg-0ubuntu1.16.04.1) ...
正在選中未選擇的軟件包 virtualbox-qt。
正准備解包 .../virtualbox-qt_5.1.38-dfsg-0ubuntu1.16.04.1_amd64.deb  ...
正在解包 virtualbox-qt (5.1.38-dfsg-0ubuntu1.16.04.1) ...
正在處理用於 man-db (2.7.5-1) 的觸發器 ...
正在處理用於 libc-bin (2.23-0ubuntu10) 的觸發器 ...
正在處理用於 systemd (229-4ubuntu21.2) 的觸發器 ...
正在處理用於 ureadahead (0.100.0-19) 的觸發器 ...
正在處理用於 hicolor-icon-theme (0.15-0ubuntu1) 的觸發器 ...
正在處理用於 gnome-menus (3.13.3-6ubuntu3.1) 的觸發器 ...
正在處理用於 desktop-file-utils (0.22-1ubuntu5.1) 的觸發器 ...
正在處理用於 bamfdaemon (0.5.3~bzr0+16.04.20160824-0ubuntu1) 的觸發器 ...
Rebuilding /usr/share/applications/bamf-2.index...
正在處理用於 mime-support (3.59ubuntu1) 的觸發器 ...
正在處理用於 shared-mime-info (1.5-2ubuntu0.1) 的觸發器 ...
正在設置 dkms (2.2.0.3-2ubuntu11.5) ...
正在設置 libgsoap8:amd64 (2.8.28-1) ...
正在設置 libqt5x11extras5:amd64 (5.5.1-3build1) ...
正在設置 libsdl1.2debian:amd64 (1.2.15+dfsg1-3) ...
正在設置 libvncserver1:amd64 (0.9.10+dfsg-3ubuntu0.16.04.2) ...
正在設置 virtualbox-dkms (5.1.38-dfsg-0ubuntu1.16.04.1) ...
Loading new virtualbox-5.1.38 DKMS files...
First Installation: checking all kernels...
Building only for 4.15.0-24-generic
Building initial module for 4.15.0-24-generic
Done.

vboxdrv:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/4.15.0-24-generic/updates/dkms/

vboxnetadp.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/4.15.0-24-generic/updates/dkms/

vboxnetflt.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/4.15.0-24-generic/updates/dkms/

vboxpci.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/4.15.0-24-generic/updates/dkms/

depmod....

DKMS: install completed.
正在設置 virtualbox (5.1.38-dfsg-0ubuntu1.16.04.1) ...
vboxweb.service is a disabled or a static unit, not starting it.
正在設置 virtualbox-qt (5.1.38-dfsg-0ubuntu1.16.04.1) ...
正在處理用於 libc-bin (2.23-0ubuntu10) 的觸發器 ...
正在處理用於 systemd (229-4ubuntu21.2) 的觸發器 ...
正在處理用於 ureadahead (0.100.0-19) 的觸發器 ...

驗證一下virtualbox是否安裝成功:virtualbox –help(會談出虛擬窗口)

2  vagrant是ruby開發的,所有安裝ruby相關的東西
  sudo apt-get -y install ruby rubygems

3.安裝vagrant

sudo apt-get install vagrant

正在讀取軟件包列表... 完成
正在分析軟件包的依賴關系樹       
正在讀取狀態信息... 完成       
下列軟件包是自動安裝的並且現在不需要了:
  gcc-5-base:i386 libasn1-8-heimdal:i386 libasyncns0:i386 libbsd0:i386
  libcaca0:i386 libcurl3:i386 libdrm-amdgpu1:i386 libdrm-intel1:i386
  libdrm-nouveau2:i386 libdrm-radeon1:i386 libdrm2:i386 libedit2:i386
  libelf1:i386 libffi6:i386 libflac8:i386 libgl1-mesa-dri:i386
  libgl1-mesa-glx:i386 libglapi-mesa:i386 libglib2.0-0:i386 libgmp10:i386
  libgnutls30:i386 libgssapi-krb5-2:i386 libgssapi3-heimdal:i386
  libhcrypto4-heimdal:i386 libheimbase1-heimdal:i386 libheimntlm0-heimdal:i386
  libhogweed4:i386 libhx509-5-heimdal:i386 libicu55:i386 libidn11:i386
  libjson-c2:i386 libk5crypto3:i386 libkeyutils1:i386 libkrb5-26-heimdal:i386
  libkrb5-3:i386 libkrb5support0:i386 libldap-2.4-2:i386 libllvm6.0:i386
  libnettle6:i386 libogg0:i386 libopus0:i386 libp11-kit0:i386
  .............................................
............................................
使用'sudo apt autoremove'來卸載它(它們)。 將會同時安裝下列軟件: bsdtar bundler curl libgmp-dev libgmpxx4ldbl ruby-bundler ruby-childprocess ruby-dev ruby-domain-name ruby-erubis ruby-ffi ruby-http-cookie ruby-i18n ruby-listen ruby-log4r ruby-mime-types ruby-molinillo ruby-net-http-persistent ruby-net-scp ruby-net-sftp ruby-net-ssh ruby-netrc ruby-nokogiri ruby-rb-inotify ruby-rest-client ruby-sqlite3 ruby-thor ruby-unf ruby-unf-ext ruby2.3-dev sqlite3 建議安裝: bsdcpio gmp-doc libgmp10-doc libmpfr-dev publicsuffix sqlite3-doc 下列【新】軟件包將被安裝: bsdtar bundler curl libgmp-dev libgmpxx4ldbl ruby-bundler ruby-childprocess ruby-dev ruby-domain-name ruby-erubis ruby-ffi ruby-http-cookie ruby-i18n ruby-listen ruby-log4r ruby-mime-types ruby-molinillo ruby-net-http-persistent ruby-net-scp ruby-net-sftp ruby-net-ssh ruby-netrc ruby-nokogiri ruby-rb-inotify ruby-rest-client ruby-sqlite3 ruby-thor ruby-unf ruby-unf-ext ruby2.3-dev sqlite3 vagrant 升級了 0 個軟件包,新安裝了 32 個軟件包,要卸載 0 個軟件包,有 236 個軟件包未被升級。 需要下載 3,509 kB 的歸檔。 解壓縮后會消耗 18.4 MB 的額外空間。 您希望繼續執行嗎? [Y/n] y 獲取:1 http://cn.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 bsdtar amd64 3.1.2-11ubuntu0.16.04.3 [47.9 kB] 獲取:2 http://cn.archive.ubuntu.com/ubuntu xenial/universe amd64 ruby-molinillo all 0.4.3-1 [12.1 kB] 獲取:3 http://cn.archive.ubuntu.com/ubuntu xenial/universe amd64 ruby-net-http-persistent all 2.9.4-1 [15.9 kB] 獲取:4 http://cn.archive.ubuntu.com/ubuntu xenial/universe amd64 ruby-thor all 0.19.1-2 [43.7 kB] 獲取:5 http://cn.archive.ubuntu.com/ubuntu xenial/universe amd64 ruby-bundler all 1.11.2-1 [122 kB] 獲取:6 http://cn.archive.ubuntu.com/ubuntu xenial/universe amd64 bundler all 1.11.2-1 [4,796 B] 獲取:7 http://cn.archive.ubuntu.com/ubuntu xenial-updates/main amd64 curl amd64 7.47.0-1ubuntu2.8 [139 kB] 獲取:8 http://cn.archive.ubuntu.com/ubuntu xenial/main amd64 libgmpxx4ldbl amd64 2:6.1.0+dfsg-2 [8,948 B] 獲取:9 http://cn.archive.ubuntu.com/ubuntu xenial/main amd64 libgmp-dev amd64 2:6.1.0+dfsg-2 [314 kB] .............................................
..............................................
正在選中未選擇的軟件包 curl。 正准備解包 .../curl_7.47.0-1ubuntu2.8_amd64.deb ... 正在解包 curl (7.47.0-1ubuntu2.8) ... 正在選中未選擇的軟件包 libgmpxx4ldbl:amd64。 正准備解包 .../libgmpxx4ldbl_2%3a6.1.0+dfsg-2_amd64.deb ... 正在解包 libgmpxx4ldbl:amd64 (2:6.1.0+dfsg-2) ... 正在選中未選擇的軟件包 libgmp-dev:amd64。 正准備解包 .../libgmp-dev_2%3a6.1.0+dfsg-2_amd64.deb ... 正在解包 libgmp-dev:amd64 (2:6.1.0+dfsg-2) ... 正在選中未選擇的軟件包 ruby-ffi。 正准備解包 .../ruby-ffi_1.9.10debian-1build2_amd64.deb ... 正在解包 ruby-ffi (1.9.10debian-1build2) ... 正在選中未選擇的軟件包 ruby-childprocess。 正准備解包 .../ruby-childprocess_0.5.9-1ubuntu1_all.deb ... 正在解包 ruby-childprocess (0.5.9-1ubuntu1) ... 正在選中未選擇的軟件包 ruby2.3-dev:amd64。 正准備解包 .../ruby2.3-dev_2.3.1-2~16.04.10_amd64.deb ... 正在解包 ruby2.3-dev:amd64 (2.3.1-2~16.04.10) ... 正在選中未選擇的軟件包 ruby-dev:amd64。 正准備解包 .../ruby-dev_1%3a2.3.0+1_amd64.deb ... 正在解包 ruby-dev:amd64 (1:2.3.0+1) ... 正在選中未選擇的軟件包 ruby-unf-ext。 正准備解包 .../ruby-unf-ext_0.0.7.2-1build2_amd64.deb ... 正在解包 ruby-unf-ext (0.0.7.2-1build2) ... 正在選中未選擇的軟件包 ruby-unf。 正准備解包 .../ruby-unf_0.1.4-1_all.deb ... 正在解包 ruby-unf (0.1.4-1) ... 正在選中未選擇的軟件包 ruby-domain-name。 正准備解包 .../ruby-domain-name_0.5.20160216-2_all.deb ... 正在解包 ruby-domain-name (0.5.20160216-2) ... 正在選中未選擇的軟件包 ruby-erubis。 正准備解包 .../ruby-erubis_2.7.0-3_all.deb ... 正在解包 ruby-erubis (2.7.0-3) ... 正在選中 正在設置 ruby-erubis (2.7.0-3) ... 正在設置 ruby-http-cookie (1.0.2-1) ... 正在設置 ruby-i18n (0.7.0-2) ... 正在設置 ruby-rb-inotify (0.9.7-1) ... 正在設置 ruby-listen (3.0.3-3) ... 正在設置 ruby-log4r (1.1.10-4) ... 正在設置 ruby-mime-types (2.6.1-1) ... 正在設置 ruby-net-ssh (1:3.0.1-3) ... 正在設置 ruby-net-scp (1.2.1-3) ... 正在設置 ruby-net-sftp (1:2.1.2-3) ... 正在設置 ruby-netrc (0.10.3-1) ... 正在設置 ruby-nokogiri (1.6.7.2-3build1) ... 正在設置 ruby-rest-client (1.8.0-2ubuntu1) ... 正在設置 ruby-sqlite3 (1.3.11-2build1) ... 正在設置 sqlite3 (3.11.0-1ubuntu1) ... 正在設置 vagrant (1.8.1+dfsg-1ubuntu0.2) ... 正在處理用於 libc-bin (2.23-0ubuntu10) 的觸發器 ...

 vagrant安裝成功

下面來配置虛擬環境

創建一個開發目錄:並且初始化

tan@tan-Precision-Tower-3620:~$ mkdir env
tan@tan-Precision-Tower-3620:~$ cd env
tan@tan-Precision-Tower-3620:~/env$ vagrant centos/7
Usage: vagrant [options] <command> [<args>]

    -v, --version                    Print the version and exit.
    -h, --help                       Print this help.

Common commands:
     box             manages boxes: installation, removal, etc.
     destroy         stops and deletes all traces of the vagrant machine
     global-status   outputs status Vagrant environments for this user
     halt            stops the vagrant machine
     help            shows the help for a subcommand
     init            initializes a new Vagrant environment by creating a Vagrantfile
     login           log in to HashiCorp's Vagrant Cloud
     package         packages a running vagrant environment into a box
     plugin          manages plugins: install, uninstall, update, etc.
     port            displays information about guest port mappings
     powershell      connects to machine via powershell remoting
     provision       provisions the vagrant machine
     push            deploys code in this environment to a configured destination
     rdp             connects to machine via RDP
     reload          restarts vagrant machine, loads new Vagrantfile configuration
     resume          resume a suspended vagrant machine
     snapshot        manages snapshots: saving, restoring, etc.
     ssh             connects to machine via SSH
     ssh-config      outputs OpenSSH valid configuration to connect to the machine
     status          outputs status of the vagrant machine
     suspend         suspends the machine
     up              starts and provisions the vagrant environment
     version         prints current and latest Vagrant version

For help on any individual command run `vagrant COMMAND -h`

Additional subcommands are available, but are either more advanced
or not commonly used. To see all subcommands, run the command
`vagrant list-commands`.

tan@tan-Precision-Tower-3620:~/env$ vagrant init centos/7
A `Vagrantfile` has been placed in this directory. You are now
ready to `vagrant up` your first virtual environment! Please read
the comments in the Vagrantfile as well as documentation on
`vagrantup.com` for more information on using Vagrant.
tan@tan-Precision-Tower-3620:~/env$ ls
Vagrantfile

env中的vagrantfile就是虛擬環境的配置文件

這里配置的系統是centos/7

開啟虛擬機:

由於僅僅配置了系統是centos/7,並未實際安裝, 第一次開啟時,找不到centos/7


tan@tan-Precision-Tower-3620:~/env$ vagrant up
Bringing machine 'default' up with 'virtualbox' provider...
==> default: Box 'centos/7' could not be found. Attempting to find and install...
    default: Box Provider: virtualbox
    default: Box Version: >= 0
==> default: Loading metadata for box 'centos/7'
    default: URL: https://vagrantcloud.com/centos/7
==> default: Adding box 'centos/7' (v1804.02) for provider: virtualbox
    default: Downloading: https://vagrantcloud.com/centos/boxes/7/versions/1804.02/providers/virtualbox.box
default: Progress: 16%

所以現場下載安裝.......

Bringing machine 'default' up with 'virtualbox' provider...
==> default: Box 'centos/7' could not be found. Attempting to find and install...
    default: Box Provider: virtualbox
    default: Box Version: >= 0
==> default: Loading metadata for box 'centos/7'
    default: URL: https://vagrantcloud.com/centos/7
==> default: Adding box 'centos/7' (v1804.02) for provider: virtualbox
    default: Downloading: https://vagrantcloud.com/centos/boxes/7/versions/1804.02/providers/virtualbox.box
==> default: Successfully added box 'centos/7' (v1804.02) for 'virtualbox'!
==> default: Importing base box 'centos/7'...
==> default: Matching MAC address for NAT networking...
==> default: Checking if box 'centos/7' is up to date...
==> default: Setting the name of the VM: env_default_1532934316119_87902
==> default: Clearing any previously set network interfaces...
==> default: Preparing network interfaces based on configuration...
    default: Adapter 1: nat
==> default: Forwarding ports...
    default: 22 (guest) => 2222 (host) (adapter 1)
==> default: Booting VM...
==> default: Waiting for machine to boot. This may take a few minutes...
    default: SSH address: 127.0.0.1:2222
    default: SSH username: vagrant
    default: SSH auth method: private key
    default: 
    default: Vagrant insecure key detected. Vagrant will automatically replace
    default: this with a newly generated keypair for better security.
    default: 
    default: Inserting generated public key within guest...
    default: Removing insecure key from the guest if it's present...
    default: Key inserted! Disconnecting and reconnecting using new SSH key...
==> default: Machine booted and ready!
==> default: Checking for guest additions in VM...
    default: No guest additions were detected on the base box for this VM! Guest
    default: additions are required for forwarded ports, shared folders, host only
    default: networking, and more. If SSH fails on this machine, please install
    default: the guest additions and repackage the box to continue.
    default: 
    default: This is not an error message; everything may continue to work properly,
    default: in which case you may ignore this message.
==> default: Rsyncing folder: /home/tan/env/ => /vagrant

安裝完成

登錄虛擬機......並更新.....

tan@tan-Precision-Tower-3620:~/env$ vagrant ssh
[vagrant@bogon ~]$ ls
[vagrant@bogon ~]$ sudo yum update
Failed to set locale, defaulting to C
Loaded plugins: fastestmirror
Determining fastest mirrors
 * base: mirrors.163.com
 * extras: mirrors.huaweicloud.com
 * updates: mirrors.huaweicloud.com
base                                                                                                                                                                                 | 3.6 kB  00:00:00     
extras                                                                                                                                                                               | 3.4 kB  00:00:00     
updates                                                                                                                                                                              | 3.4 kB  00:00:00     
(1/4): extras/7/x86_64/primary_db                                                                                                                                                    | 172 kB  00:00:00     
(2/4): base/7/x86_64/group_gz                                                                                                                                                        | 166 kB  00:00:00     
(3/4): updates/7/x86_64/primary_db                                                                                                                                                   | 4.3 MB  00:00:00     
(4/4): base/7/x86_64/primary_db                                                                                                                                                      | 5.9 MB  00:00:06     
Resolving Dependencies
--> Running transaction check
---> Package NetworkManager.x86_64 1:1.10.2-13.el7 will be updated
---> Package NetworkManager.x86_64 1:1.10.2-16.el7_5 will be an update
.....................................................................
....................................................

接下來安裝jdk1.8

[vagrant@bogon ~]$ sudo yum install java-1.8.0-openjdk
Failed to set locale, defaulting to C
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirrors.163.com
 * extras: mirrors.huaweicloud.com
 * updates: mirrors.huaweicloud.com
Resolving Dependencies
--> Running transaction check
---> Package java-1.8.0-openjdk.x86_64 1:1.8.0.181-3.b13.el7_5 will be installed
--> Processing Dependency: java-1.8.0-openjdk-headless(x86-64) = 1:1.8.0.181-3.b13.el7_5 for package: 1:java-1.8.0-openjdk-1.8.0.181-3.b13.el7_5.x86_64
............................................................................................................................................
........................................

安裝spark(opt是新建的文件夾,存放下載的東西)

https://archive.apache.org/dist/spark/spark-2.1.1/spark-2.1.1-bin-hadoop2.7.tgz 是官網上spark壓縮包的鏈接地址
[vagrant@bogon ~]$ cd opt
[vagrant@bogon opt]$ curl -O https://archive.apache.org/dist/spark/spark-2.1.1/spark-2.1.1-bin-hadoop2.7.tgz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  191M  100  191M    0     0   129k      0  0:25:13  0:25:13 --:--:--  963k
 
         

下載完成后解壓

[vagrant@bogon opt]$ tar zxvf spark-2.1.1-bin-hadoop2.7.tgz
spark-2.1.1-bin-hadoop2.7/
spark-2.1.1-bin-hadoop2.7/NOTICE
spark-2.1.1-bin-hadoop2.7/jars/
spark-2.1.1-bin-hadoop2.7/jars/bonecp-0.8.0.RELEASE.jar
spark-2.1.1-bin-hadoop2.7/jars/commons-net-2.2.jar
spark-2.1.1-bin-hadoop2.7/jars/javax.servlet-api-3.1.0.jar
spark-2.1.1-bin-hadoop2.7/jars/hadoop-annotations-2.7.3.jar
spark-2.1.1-bin-hadoop2.7/jars/hadoop-hdfs-2.7.3.jar
spark-2.1.1-bin-hadoop2.7/jars/oro-2.0.8.jar
...........................................
.........................................

 進入解壓的后的文件夾,安裝spark
[vagrant@bogon opt]$ cd spark-2.1.1-bin-hadoop2.7/         
[vagrant@bogon spark-2.1.1-bin-hadoop2.7]$ ls
LICENSE  NOTICE  R  README.md  RELEASE  bin  conf  data  examples  jars  licenses  python  sbin  yarn
[vagrant@bogon spark-2.1.1-bin-hadoop2.7]$ bin/pyspark
Python 2.7.5 (default, Jul 13 2018, 13:06:57) 
[GCC 4.8.5 20150623 (Red Hat 4.8.5-28)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
18/07/30 08:24:39 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
18/07/30 08:24:47 WARN ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 1.2.0
18/07/30 08:24:47 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException
18/07/30 08:24:47 WARN ObjectStore: Failed to get database global_temp, returning NoSuchObjectException
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /__ / .__/\_,_/_/ /_/\_\   version 2.1.1
      /_/

Using Python version 2.7.5 (default, Jul 13 2018 13:06:57)
SparkSession available as 'spark'.
>>> 

pyspark安裝成功

待續........

 

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM