使用Kettle工具進行增量數據同步

增量同步的方式有很多種，我使用的是: 快照表 + 觸發器
需求：

當主庫庫表發生增刪改時，從庫庫表與主庫庫表數據保持一致。

環境：
1、Mysql
2、kettle 7.1

思路：

1、在主庫中，將需要同步的庫表新建快照表，表結構一致。

#創建同步臨時表(insert)
DROP TABLE IF EXISTS brch_temp_insert;
CREATE TABLE brch_temp_insert like brch;

#創建同步臨時表(delete)
DROP TABLE IF EXISTS brch_temp_delete;
CREATE TABLE brch_temp_delete like brch;

#創建同步臨時表(update)
DROP TABLE IF EXISTS brch_temp_update;
CREATE TABLE brch_temp_update like brch;

2、在主庫中，分別新增庫表的增、刪、改的觸發器。

#創建同步表觸發器(insert) DROP TRIGGER IF EXISTS tri_insert_brch; CREATE TRIGGER tri_insert_brch AFTER INSERT ON brch FOR EACH ROW BEGIN insert into brch_temp_insert ( ROW_ID, BRCH_ID, BRCH_NAME ) values( new.ROW_ID, new.BRCH_ID, new.BRCH_NAME ); END; #創建同步表觸發器(delete) DROP TRIGGER IF EXISTS tri_delete_brch; CREATE TRIGGER tri_delete_brch AFTER delete ON brch FOR EACH ROW BEGIN insert into brch_temp_delete( ROW_ID ) values( old.ROW_ID ); END; #創建同步表觸發器(update) DROP TRIGGER IF EXISTS tri_update_brch; CREATE TRIGGER tri_update_brch AFTER update ON brch FOR EACH ROW BEGIN insert into brch_temp_update( ROW_ID, BRCH_ID, BRCH_NAME ) values( new.ROW_ID, new.BRCH_ID, new.BRCH_NAME ); END;