環境:ubuntu 16.04 , python3.5.1+
安裝順序如下:
sudo apt-get install build-essential sudo apt-get install python3-dev sudo apt-get install libxml2-de; sudo apt-get install libxslt1-dev
sudo apt-get install libssl-dev
apt-get install -y libffi-dev
pip3 install Twisted
pip3 install w3lib
pip3 install lxm
然后安裝Scrapy:
scrapy運行必備組件需要(OpenSSL,lxml(lxml一般默認有安裝,可以import xml驗證是否有安裝,因為我這里已經默認安裝了xml,所以就不附上xml安裝命令了))
sudo python3 -m pip install Scrapy
安裝OpenSSL:
sudo python3 -m pip install pyopenssl
之前安裝了python-dev和python-setuptools也要重新安裝python3版本的這兩個軟件,即運行:
sudo apt-get install python3-dev sudo apt-get install python3-setuptools