datax:
Data是阿里巴巴公司開發的,為解決異構數據源同步問題
它的設計理念:
安裝:
datax下載地址:https://github.com/alibaba/DataX
由於datax需要python2.x版本,而本機裝的是python3.x 所以要安裝python2 並且兩個版本互不影響
裝兩個python方法:https://blog.csdn.net/qq_27089287/article/details/79114441
使用方法:
1.查詢使用模板
2.使用(以csv到mysql為例)
源碼如下:

{ "job": { "setting": { "speed": { "channel": 1 } }, "content": [ { "reader": { "name": "txtfilereader", "parameter": { "path": ["E:/xinfang_data.csv"], "encoding": "gbk", "column": [ { "index": 0, "type": "string" }, { "index": 1, "type": "string" }, { "index": 2, "type": "string" }, { "index": 3, "type": "string" } ], "fieldDelimiter": ",", "skipHeader": "true" } }, "writer": { "name": "mysqlwriter", "parameter": { "writeMode": "insert", "username": "root", "password": "123456", "column": [ "kind", "time", "processingDepartment", "content" ], "session": [], "connection": [ { "jdbcUrl": "jdbc:mysql://127.0.0.1:3306/datax?useUnicode=true&characterEncoding=utf8&useSSL=false&serverTimezone=GMT%2B8", "table": ["csv1"] } ] } } } ] } }
執行方法
至此,數據就已經從csv文件導入mysql數據庫。