1,模型訓練:pytorch/paddle/tensorflow+pandas+numpy+scipy+os,有時候也會用sklearn
-
pytorch
https://pytorch.org/tutorials/recipes/recipes/Captum_Recipe.html
https://pytorch.org/docs/stable/generated/torch.unsqueeze.html#torch.unsqueeze
分布式訓練: https://mp.weixin.qq.com/s/5yTalo0KICnZ2otfs6KJSw
https://www.zhihu.com/question/436008648 -
tensorflow
顯存釋放:https://blog.csdn.net/qq_41653523/article/details/110353184 -
pandas
- https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.query.html
- 數據類型轉換
data['列索引'].astype(type) data['索引'].apply(自定義函數) ``
-
sklearn
計算AUC(Area Under Curve):from sklearn.metrics import roc_auc_score
2,繪圖:matplotlib,visio,sklearn(可繪制混淆矩陣)
- matplotlib
https://matplotlib.org/api/_as_gen/matplotlib.pyplot.subplot2grid.html#matplotlib.pyplot.subplot2grid
https://www.cnblogs.com/tensorzhang/p/14576189.html (常規用法總結)
3,模型結構展示:tensorwatch+jupyter lab,torch.utils.tensorboard, tensorboardX(但是tensorwatch畫出來的圖都是零碎的,也不知道問題在哪。tensorboard則是直接不顯示graph-路徑不要有中文)
-
jupyter lab
https://www.cnblogs.com/feffery/
https://jupyter.org/documentation -
tensorwatch
https://github.com/microsoft/tensorwatch
https://cloud.tencent.com/developer/article/1449697 -
tensoboard
https://www.tensorflow.org/tensorboard/get_started -
tensorboardX
https://github.com/lanpa/tensorboardX
4,特征追蹤:
-
pytorch+captum
https://captum.ai/
https://captum.ai/tutorials/
https://gilberttanner.com/blog/interpreting-pytorch-models-with-captum
https://www.kaggle.com/zhangkaiyu/notebookd049a46a87/edit -
scikit-learn+ELI5
https://eli5.readthedocs.io/en/latest/
5,圖像數據處理:
- 數據增強:imgaug
https://imgaug.readthedocs.io/en/latest/source/examples_basics.html - opencv
http://labs.eecs.tottori-u.ac.jp/sd/Member/oyamada/OpenCV/html/py_tutorials/py_gui/py_image_display/py_image_display.html - PyDicom
一個用於處理DICOM格式文件的Python包,可以處理包括如醫學圖像(CT等)、報告等。
https://zhuanlan.zhihu.com/p/59413289