基於ubuntu14.04 干凈的系統一步步遇到的坑記錄下來;
懷着平靜學習的心情,問題總的能解決的!
1. 首先看了下當前python版本
python --version Python 2.7.6
2. 安裝pip
先更新源
sudo apt-get update sudo apt-get upgrade
安裝pip
sudo apt-get install python-pip
查看pip 版本
pip -V pip 1.5.4 from /usr/lib/python2.7/dist-packages (python 2.7)
3. 嘗試安裝tensorflow,本以為安裝就這么簡單完成了:
tyler@pc:/opt/work/lazyzoon$ pip install tensorflow Downloading/unpacking tensorflow Could not find any downloads that satisfy the requirement tensorflow Cleaning up... No distributions at all found for tensorflow Storing debug log for failure in /home/tyler/.pip/pip.log
現在開始報錯了
(1). 首先懷疑的是pip版本太低,想先升級pip版本
tyler@pc:/opt/work/lazyzoon$ pip install pip -U Downloading/unpacking pip from https://files.pythonhosted.org/packages/d8/f3/413bab4ff08e1fc4828dfc59996d721917df8e8583ea85385d51125dceff/pip-19.0.3-py2.py3-none-any.whl#sha256=bd812612bbd8ba84159d9ddc0266b7fbce712fc9bc98c82dee5750546ec8ec64 Downloading pip-19.0.3-py2.py3-none-any.whl (1.4MB): 1.4MB downloaded Installing collected packages: pip Found existing installation: pip 1.5.4 Not uninstalling pip at /usr/lib/python2.7/dist-packages, owned by OS Can't roll back pip; was not uninstalled Cleaning up... Exception: Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 122, in main status = self.run(options, args) File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 283, in run requirement_set.install(install_options, global_options, root=options.root_path) File "/usr/lib/python2.7/dist-packages/pip/req.py", line 1436, in install requirement.install(install_options, global_options, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/pip/req.py", line 672, in install self.move_wheel_files(self.source_dir, root=root) File "/usr/lib/python2.7/dist-packages/pip/req.py", line 902, in move_wheel_files pycompile=self.pycompile, File "/usr/lib/python2.7/dist-packages/pip/wheel.py", line 206, in move_wheel_files clobber(source, lib_dir, True) File "/usr/lib/python2.7/dist-packages/pip/wheel.py", line 193, in clobber os.makedirs(destsubdir) File "/usr/lib/python2.7/os.py", line 157, in makedirs mkdir(name, mode) OSError: [Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/pip' Storing debug log for failure in /home/tyler/.pip/pip.log
沒辦法,只能換種方法升級pip,各種google,百度,找到下面這種方法升級成功
下載這個py腳本
wget https://bootstrap.pypa.io/get-pip.py --no-check-certificate
然后執行
sudo python get-pip.py tyler@pc:/opt/work/lazyzoon$ sudo python get-pip.py DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. The directory '/home/tyler/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. The directory '/home/tyler/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Collecting pip /tmp/tmp5OMysZ/pip.zip/pip/_vendor/urllib3/util/ssl_.py:354: SNIMissingWarning: An HTTPS request has been made, but the SNI (Server Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings /tmp/tmp5OMysZ/pip.zip/pip/_vendor/urllib3/util/ssl_.py:150: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings /tmp/tmp5OMysZ/pip.zip/pip/_vendor/urllib3/util/ssl_.py:150: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings Downloading https://files.pythonhosted.org/packages/d8/f3/413bab4ff08e1fc4828dfc59996d721917df8e8583ea85385d51125dceff/pip-19.0.3-py2.py3-none-any.whl (1.4MB) 100% |████████████████████████████████| 1.4MB 3.0MB/s Installing collected packages: pip Found existing installation: pip 1.5.4 Uninstalling pip-1.5.4: Successfully uninstalled pip-1.5.4 Successfully installed pip-19.0.3
這樣就安裝成功了pip新版本
tyler@pc:/opt/work/lazyzoon$ pip -V pip 19.0.3 from /usr/local/lib/python2.7/dist-packages/pip (python 2.7)
(2). 繼續嘗試安裝tensorfolw,還是報錯
sudo pip install tensorflow markdown 3.1 has requirement setuptools>=36, but you'll have setuptools 3.3 which is incompatible. Installing collected packages: numpy, six, enum34, futures, grpcio, h5py, keras-applications, markdown, werkzeug, protobuf, absl-py, tensorboard, termcolor, gast, funcsigs, pbr, mock, tensorflow-estimator, backports.weakref, astor, keras-preprocessing, tensorflow Found existing installation: six 1.5.2 Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
然后發現我們本地還有python3 版本
tyler@pc:/opt/work/lazyzoon$ python3 -V Python 3.4.3
想着把python也用新版本
為了保險起見,我把之前用python2.7安裝的pip卸載了
sudo apt-get remove python-pip Reading package lists... Done Building dependency tree Reading state information... Done The following packages were automatically installed and are no longer required: libdbusmenu-gtk4 libqpdf13 python-chardet-whl python-colorama python-colorama-whl python-distlib python-distlib-whl python-html5lib python-html5lib-whl python-pip-whl python-requests-whl python-setuptools-whl python-six-whl python-urllib3-whl python-wheel Use 'apt-get autoremove' to remove them. The following packages will be REMOVED: python-pip 0 upgraded, 0 newly installed, 1 to remove and 3 not upgraded. After this operation, 477 kB disk space will be freed. Do you want to continue? [Y/n] Y (Reading database ... 220957 files and directories currently installed.) Removing python-pip (1.5.4-1ubuntu4) ...
但是我發現我卸載的好像是1.5.4版本,可能這個嘗試是多余。。
不管三七二十一了,用python3繼續安裝
tyler@pc:/opt/work/lazyzoon$ sudo python3 get-pip.py DEPRECATION: Python 3.4 support has been deprecated. pip 19.1 will be the last one supporting it. Please upgrade your Python as Python 3.4 won't be maintained after March 2019 (cf PEP 429). The directory '/home/tyler/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. The directory '/home/tyler/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Collecting pip Downloading https://files.pythonhosted.org/packages/d8/f3/413bab4ff08e1fc4828dfc59996d721917df8e8583ea85385d51125dceff/pip-19.0.3-py2.py3-none-any.whl (1.4MB) 100% |████████████████████████████████| 1.4MB 10.6MB/s Collecting setuptools Downloading https://files.pythonhosted.org/packages/d1/6a/4b2fcefd2ea0868810e92d519dacac1ddc64a2e53ba9e3422c3b62b378a6/setuptools-40.8.0-py2.py3-none-any.whl (575kB) 100% |████████████████████████████████| 583kB 12.5MB/s Collecting wheel Downloading https://files.pythonhosted.org/packages/96/ba/a4702cbb6a3a485239fbe9525443446203f00771af9ac000fa3ef2788201/wheel-0.33.1-py2.py3-none-any.whl Installing collected packages: pip, setuptools, wheel Successfully installed pip-19.0.3 setuptools-40.8.0 wheel-0.33.1
也提示安裝成功了
現在多了一個pip3,用pip3安裝試試
sudo pip3 install tensorflow DEPRECATION: Python 3.4 support has been deprecated. pip 19.1 will be the last one supporting it. Please upgrade your Python as Python 3.4 won't be maintained after March 2019 (cf PEP 429). The directory '/home/tyler/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. The directory '/home/tyler/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Collecting tensorflow Downloading https://files.pythonhosted.org/packages/37/f0/7b2fd5c7cddb3f7f11e7859850f543e19009761cdb965ed8bd98f66d60fd/tensorflow-1.13.1-cp34-cp34m-manylinux1_x86_64.whl (93.2MB) 25% |████████▎ | 24.1MB 91kB/s eta 0:12:37Exception: Traceback (most recent call last): File "/usr/local/lib/python3.4/dist-packages/pip/_vendor/urllib3/response.py", line 360, in _error_catcher yield File "/usr/local/lib/python3.4/dist-packages/pip/_vendor/urllib3/response.py", line 442, in read data = self._fp.read(amt) File "/usr/local/lib/python3.4/dist-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read data = self.__fp.read(amt) File "/usr/lib/python3.4/http/client.py", line 529, in read return super(HTTPResponse, self).read(amt) File "/usr/lib/python3.4/http/client.py", line 568, in readinto n = self.fp.readinto(b) File "/usr/lib/python3.4/socket.py", line 374, in readinto return self._sock.recv_into(b) File "/usr/lib/python3.4/ssl.py", line 769, in recv_into return self.read(nbytes, buffer) File "/usr/lib/python3.4/ssl.py", line 641, in read v = self._sslobj.read(len, buffer) socket.timeout: The read operation timed out During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.4/dist-packages/pip/_internal/cli/base_command.py", line 179, in main status = self.run(options, args) File "/usr/local/lib/python3.4/dist-packages/pip/_internal/commands/install.py", line 315, in run resolver.resolve(requirement_set) File "/usr/local/lib/python3.4/dist-packages/pip/_internal/resolve.py", line 131, in resolve self._resolve_one(requirement_set, req) File "/usr/local/lib/python3.4/dist-packages/pip/_internal/resolve.py", line 294, in _resolve_one abstract_dist = self._get_abstract_dist_for(req_to_install) File "/usr/local/lib/python3.4/dist-packages/pip/_internal/resolve.py", line 242, in _get_abstract_dist_for self.require_hashes File "/usr/local/lib/python3.4/dist-packages/pip/_internal/operations/prepare.py", line 334, in prepare_linked_requirement progress_bar=self.progress_bar File "/usr/local/lib/python3.4/dist-packages/pip/_internal/download.py", line 878, in unpack_url progress_bar=progress_bar File "/usr/local/lib/python3.4/dist-packages/pip/_internal/download.py", line 702, in unpack_http_url progress_bar) File "/usr/local/lib/python3.4/dist-packages/pip/_internal/download.py", line 946, in _download_http_url _download_url(resp, link, content_file, hashes, progress_bar) File "/usr/local/lib/python3.4/dist-packages/pip/_internal/download.py", line 639, in _download_url hashes.check_against_chunks(downloaded_chunks) File "/usr/local/lib/python3.4/dist-packages/pip/_internal/utils/hashes.py", line 62, in check_against_chunks for chunk in chunks: File "/usr/local/lib/python3.4/dist-packages/pip/_internal/download.py", line 607, in written_chunks for chunk in chunks: File "/usr/local/lib/python3.4/dist-packages/pip/_internal/utils/ui.py", line 159, in iter for x in it: File "/usr/local/lib/python3.4/dist-packages/pip/_internal/download.py", line 596, in resp_read decode_content=False): File "/usr/local/lib/python3.4/dist-packages/pip/_vendor/urllib3/response.py", line 494, in stream data = self.read(amt=amt, decode_content=decode_content) File "/usr/local/lib/python3.4/dist-packages/pip/_vendor/urllib3/response.py", line 459, in read raise IncompleteRead(self._fp_bytes_read, self.length_remaining) File "/usr/lib/python3.4/contextlib.py", line 77, in __exit__ self.gen.throw(type, value, traceback) File "/usr/local/lib/python3.4/dist-packages/pip/_vendor/urllib3/response.py", line 365, in _error_catcher raise ReadTimeoutError(self._pool, None, 'Read timed out.') pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out.
這個錯誤是網絡不穩定導致的,再次執行結果還是報錯:
tyler@pc:/opt/work/lazyzoon$ sudo pip3 install tensorflow Installing collected packages: six, protobuf, astor, numpy, keras-preprocessing, termcolor, markdown, grpcio, absl-py, werkzeug, tensorboard, pbr, mock, tensorflow-estimator, h5py, keras-applications, gast, tensorflow Found existing installation: six 1.5.2 Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
好像是six模塊的問題,需要更新安裝
然后執行:
sudo pip install six --upgrade --target="/usr/local/lib/python3.4/dist-packages/" DEPRECATION: Python 3.4 support has been deprecated. pip 19.1 will be the last one supporting it. Please upgrade your Python as Python 3.4 won't be maintained after March 2019 (cf PEP 429). The directory '/home/tyler/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. The directory '/home/tyler/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Collecting six Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl Installing collected packages: six Successfully installed six-1.12.0
成功更新了six
繼續嘗試安裝tensorflow,果然沒讓我失望,還是報錯
sudo pip3 install tensorflow File "/tmp/pip-install-s_yz77x6/numpy/numpy/distutils/command/build_src.py", line 165, in build_sources self.build_extension_sources(ext) File "/tmp/pip-install-s_yz77x6/numpy/numpy/distutils/command/build_src.py", line 322, in build_extension_sources sources = self.generate_sources(sources, ext) File "/tmp/pip-install-s_yz77x6/numpy/numpy/distutils/command/build_src.py", line 375, in generate_sources source = func(extension, build_dir) File "numpy/core/setup.py", line 423, in generate_config_h moredefs, ignored = cocache.check_types(config_cmd, ext, build_dir) File "numpy/core/setup.py", line 47, in check_types out = check_types(*a, **kw) File "numpy/core/setup.py", line 281, in check_types "install {0}-dev|{0}-devel.".format(python)) SystemError: Cannot compile 'Python.h'. Perhaps you need to install python-dev|python-devel. ---------------------------------------- Command "/usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-s_yz77x6/numpy/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-record-bie5c7mf/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-install-s_yz77x6/numpy/
看着像是numpy模塊問題,嘗試更新numpy模塊,然后又來一堆錯誤
tyler@pc:/opt/work/lazyzoon$ pip install numpy File "/tmp/pip-install-5x9wvjol/numpy/numpy/distutils/command/build_src.py", line 322, in build_extension_sources sources = self.generate_sources(sources, ext) File "/tmp/pip-install-5x9wvjol/numpy/numpy/distutils/command/build_src.py", line 375, in generate_sources source = func(extension, build_dir) File "numpy/core/setup.py", line 423, in generate_config_h moredefs, ignored = cocache.check_types(config_cmd, ext, build_dir) File "numpy/core/setup.py", line 47, in check_types out = check_types(*a, **kw) File "numpy/core/setup.py", line 281, in check_types "install {0}-dev|{0}-devel.".format(python)) SystemError: Cannot compile 'Python.h'. Perhaps you need to install python-dev|python-devel. ---------------------------------------- Command "/usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-5x9wvjol/numpy/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-record-571bsgcn/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-install-5x9wvjol/numpy/
看提示可能是需要安裝 python-dev
那就安裝唄,sudo apt-get install python-dev
安裝成功了python-dev
回來繼續安裝numpy
結果,還是和上次一樣的報錯
思考了下,我現在用的pip3,對應的python也是python3了,應該要安裝 sudo apt-get install python3-dev 才對,
安裝 python3-dev,
sudo apt-get install python3-dev
安裝成功后,繼續執行
tyler@pc:/opt/work/lazyzoon$ sudo pip3 install numpy DEPRECATION: Python 3.4 support has been deprecated. pip 19.1 will be the last one supporting it. Please upgrade your Python as Python 3.4 won't be maintained after March 2019 (cf PEP 429). The directory '/home/tyler/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. The directory '/home/tyler/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Collecting numpy Installing collected packages: numpy Successfully installed numpy-1.16.2
果然成功了
最后執行:
sudo pip3 install tensorflow Collecting mock>=2.0.0 (from tensorflow-estimator<1.14.0rc0,>=1.13.0->tensorflow) Downloading https://files.pythonhosted.org/packages/e6/35/f187bdf23be87092bd0f1200d43d23076cee4d0dec109f195173fd3ebc79/mock-2.0.0-py2.py3-none-any.whl (56kB) 100% |████████████████████████████████| 61kB 3.2MB/s Collecting pbr>=0.11 (from mock>=2.0.0->tensorflow-estimator<1.14.0rc0,>=1.13.0->tensorflow) Downloading https://files.pythonhosted.org/packages/14/09/12fe9a14237a6b7e0ba3a8d6fcf254bf4b10ec56a0185f73d651145e9222/pbr-5.1.3-py2.py3-none-any.whl (107kB) 100% |████████████████████████████████| 112kB 2.6MB/s Installing collected packages: keras-preprocessing, werkzeug, absl-py, protobuf, grpcio, markdown, tensorboard, termcolor, gast, h5py, keras-applications, pbr, mock, tensorflow-estimator, tensorflow Running setup.py install for absl-py ... done Running setup.py install for termcolor ... done Running setup.py install for gast ... done Successfully installed absl-py-0.7.1 gast-0.2.2 grpcio-1.19.0 h5py-2.9.0 keras-applications-1.0.7 keras-preprocessing-1.0.9 markdown-3.0.1 mock-2.0.0 pbr-5.1.3 protobuf-3.7.0 tensorboard-1.13.1 tensorflow-1.13.1 tensorflow-estimator-1.13.0 termcolor-1.1.0 werkzeug-0.15.1
到此安裝tensorflow成功。