阿里dataX配置使用

dataX是阿里研發的主要做離線數據同步工具，支持多種數據庫源同步。

文檔：https://github.com/alibaba/DataX

 

下載：wget http://datax-opensource.oss-cn-hangzhou.aliyuncs.com/datax.tar.gz

解壓：tar -zxvf datax.tar.gz -C /usr/local/

自檢：cd /usr/local/datax/bin/

　　　python2.6 datax.py /usr/local/datax/job/job.json

 

授權：在源庫和目標庫的my.cnf中的[mysqld]中加入skip-grant-tables，否則終端顯示沒有權限執行失敗

　　　

 

配置：vim /usr/local/datax/job/my_test.json，把下面那段復制進去

{
        "job": {
                "setting": {
                        "speed": {
                                "channel":1
                        }
                },
                "content": [
                {
                        "reader": {
                                "name": "mysqlreader",
                                "parameter": {
                                        "username": "root",
                                        "password": "123456",
                                        "column": [
                                                "id",
                                                "name"
                                        ],
                                        "connection": [
                                        {
                                                "table": [
                                                        "test"
                                                ],
                                                "jdbcUrl": [
                                                        "jdbc:mysql://192.168.112.129:3306/test"
                                                ]
                                        }
                                        ]
                                }
                        },
                        "writer": {
                                "name": "mysqlwriter",
                                "parameter": {
                                        "writeMode": "insert",
                                        "username": "root",
                                        "password": "123456",
                                        "column": [
                                                "id",
                                                "name"
                                        ],
                                        "connection": [
                                        {
                                                "jdbcUrl": "jdbc:mysql://192.168.112.130:3306/test",
                                                "table": [
                                                        "test"
                                                ]
                                        }
                                        ]
                                }
                        }
                }
                ]
        }
}

 

 執行：python2.6 /usr/local/datax/bin/datax.py /usr/local/datax/job/my_test.json

 

查看目標庫192.168.112.130的test庫test表是否和129的數據對應，一致說明執行成功。