RHEL7下安裝使用TensorFlow和kcws


0.安裝依賴包

#用pip安裝python科學計算庫numpy,sklearn,scipy
su
- wget http://dl.fedoraproject.org/pub/epel/7/x86_64/e/epel-release-7-8.noarch.rpm yum install epel-release-7-8.noarch.rpm yum install python2-pip.noarch
yum install gcc-c++.x86_64 pip
install --upgrade pip pip install numpy pip install sklearn pip install scipy

 

1.安裝bazel 

Bazel是一個類似於Make的工具,是Google為其內部軟件開發的特點量身定制的工具,2015年開源。

cd ~
wget https://github.com/bazelbuild/bazel/archive/0.4.0.tar.gz
tar xzvf 0.4.0.tar.gz
cd bazel-0.4.0/
./compile.sh
sudo cp output/bazel /usr/bin/
which bazel
#配置bash_completion
bazel build //scripts:bazel-complete.bash
sudo cp bazel-bin/scripts/bazel-complete.bash /etc/bash_completion.d/

 

2.安裝TensorFlow

#下載TensorFlow源代碼
git clone https://github.com/tensorflow/tensorflow
cd tensorflow/
./configure
#Create the pip package and install bazel build -c opt //tensorflow/tools/pip_package:build_pip_package bazel-bin/tensorflow/tools/pip_package/build_pip_package /tmp/tensorflow_pkg sudo pip install /tmp/tensorflow_pkg/tensorflow-*-cp27-none-linux_x86_64.whl

 

3.安裝kcws - 97.5%准確率的深度學習中文分詞(字嵌入+Bi-LSTM+CRF)https://github.com/koth/kcws

git clone https://github.com/koth/kcws.git
cd kcws/
#下載語料庫people2014.tar.gz
tar xzvf people2014.tar.gz # 解壓到~/kcws/2014
./configure 
#編譯后台服務
bazel build //kcws/cc:seg_backend_api
python kcws/train/process_anno_file.py ./2014 chars_for_w2v.txt
bazel build third_party/word2vec:word2vec
#使用word2vec 訓練 chars_for_w2v (注意-binary 0),得到字嵌入結果vec.txt
./bazel-bin/third_party/word2vec/word2vec -train chars_for_vec.txt -output kcws/models/vec.txt -size 50 -sample 1e-4 -negative 5 -hs 1 -binary 0 -iter 5
bazel build kcws/train:generate_training
./bazel-bin/kcws/train/generate_training kcws/models/vec.txt ./ all.txt
python kcws/train/filter_sentence.py all.txt
python kcws/train/train_cws_lstm.py --word2vec_path ./kcws/models/vec.txt --train_data_path ./train.txt --test_data_path test.txt --max_sentence_len 80 --learning_rate 0.001

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM