canal快速啟動

QuickStart

  https://github.com/alibaba/canal/wiki/QuickStart   

 

 

准備

• 對於自建 MySQL , 需要先開啟 Binlog 寫入功能，配置 binlog-format 為 ROW 模式，my.cnf 中配置如下

  [mysqld]
  log-bin=mysql-bin # 開啟 binlog
  binlog-format=ROW # 選擇 ROW 模式
  server_id=1 # 配置 MySQL replaction 需要定義，不要和 canal 的 slaveId 重復
  

  • 注意：針對阿里雲 RDS for MySQL , 默認打開了 binlog , 並且賬號默認具有 binlog dump 權限 , 不需要任何權限或者 binlog 設置,可以直接跳過這一步

• 授權 canal 鏈接 MySQL 賬號具有作為 MySQL slave 的權限, 如果已有賬戶可直接 grant

  CREATE USER canal IDENTIFIED BY 'canal'; GRANT SELECT, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'canal'@'%'; -- GRANT ALL PRIVILEGES ON *.* TO 'canal'@'%' ; FLUSH PRIVILEGES;

啟動

• 下載 canal, 訪問 release 頁面 , 選擇需要的包下載, 如以 1.0.17 版本為例

  wget https://github.com/alibaba/canal/releases/download/canal-1.0.17/canal.deployer-1.0.17.tar.gz

• 解壓縮

  mkdir /tmp/canal
  tar zxvf canal.deployer-$version.tar.gz  -C /tmp/canal
  

  • 解壓完成后，進入 /tmp/canal 目錄，可以看到如下結構

    drwxr-xr-x 2 jianghang jianghang  136 2013-02-05 21:51 bin
    drwxr-xr-x 4 jianghang jianghang  160 2013-02-05 21:51 conf
    drwxr-xr-x 2 jianghang jianghang 1.3K 2013-02-05 21:51 lib
    drwxr-xr-x 2 jianghang jianghang   48 2013-02-05 21:29 logs
    

• 配置修改

  vi conf/example/instance.properties
  

  ## mysql serverId
  canal.instance.mysql.slaveId = 1234
  #position info，需要改成自己的數據庫信息
  canal.instance.master.address = 127.0.0.1:3306 
  canal.instance.master.journal.name = 
  canal.instance.master.position = 
  canal.instance.master.timestamp = 
  #canal.instance.standby.address = 
  #canal.instance.standby.journal.name =
  #canal.instance.standby.position = 
  #canal.instance.standby.timestamp = 
  #username/password，需要改成自己的數據庫信息
  canal.instance.dbUsername = canal  
  canal.instance.dbPassword = canal
  canal.instance.defaultDatabaseName =
  canal.instance.connectionCharset = UTF-8
  #table regex
  canal.instance.filter.regex = .\*\\\\..\*

  • canal.instance.connectionCharset 代表數據庫的編碼方式對應到 java 中的編碼類型，比如 UTF-8，GBK , ISO-8859-1
  • 如果系統是1個 cpu，需要將 canal.instance.parser.parallel 設置為 false

• 啟動

  sh bin/startup.sh
  

• 查看 server 日志

  vi logs/canal/canal.log</pre>
  

  2013-02-05 22:45:27.967 [main] INFO  com.alibaba.otter.canal.deployer.CanalLauncher - ## start the canal server.
  2013-02-05 22:45:28.113 [main] INFO  com.alibaba.otter.canal.deployer.CanalController - ## start the canal server[10.1.29.120:11111]
  2013-02-05 22:45:28.210 [main] INFO  com.alibaba.otter.canal.deployer.CanalLauncher - ## the canal server is running now ......
  

• 查看 instance 的日志

  vi logs/example/example.log
  

  2013-02-05 22:50:45.636 [main] INFO  c.a.o.c.i.spring.support.PropertyPlaceholderConfigurer - Loading properties file from class path resource [canal.properties]
  2013-02-05 22:50:45.641 [main] INFO  c.a.o.c.i.spring.support.PropertyPlaceholderConfigurer - Loading properties file from class path resource [example/instance.properties]
  2013-02-05 22:50:45.803 [main] INFO  c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start CannalInstance for 1-example 
  2013-02-05 22:50:45.810 [main] INFO  c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start successful....
  

• 關閉

  sh bin/stop.sh

php操作 

composer require xingwenge/canal_php

https://github.com/xingwenge/canal-php

<?php

use xingwenge\canal_php\CanalClient;
use xingwenge\canal_php\CanalConnectorFactory;
use xingwenge\canal_php\Fmt;

require "./vendor/autoload.php";
try {
    //$client = CanalConnectorFactory::createClient(CanalClient::TYPE_SOCKET_CLUE);
    $client = CanalConnectorFactory::createClient(CanalClient::TYPE_SWOOLE);

    $client->connect("192.168.33.10", 11111);
    $client->checkValid();
    $client->subscribe("1001", "example", ".*\\..*");
    //$client->subscribe("1001", "example", "test.*"); # 設置過濾

    while (true) {
        $message = $client->get(100);
        if ($entries = $message->getEntries()) {
            foreach ($entries as $key=>$entry) {
                Fmt::println($entry);
            }
        }
    }

    $client->disConnect();
} catch (\Exception $e) {
    echo $e->getMessage(), PHP_EOL;
}

　　

[root@localhost wang]# php index.php 


================> binlog[mysql-bin.000015 : 242],name[test,user], eventType: 1

id : 56  update= true
name : d  update= true
================> binlog[mysql-bin.000015 : 438],name[test,user], eventType: 1

id : 57  update= true
name : d  update= true
================> binlog[mysql-bin.000015 : 634],name[test,user], eventType: 1

id : 58  update= true
name : d  update= true
================> binlog[mysql-bin.000015 : 830],name[test,user], eventType: 1

id : 59  update= true
name : d  update= true