mycat結合雙主復制實現讀寫分離模式

本文轉載自查看原文 2017-06-21 14:55 5814 雙主復制/ mycat/ mysql

簡介：應用程序僅需要連接mycat，后端服務器的讀寫分離由mycat進行控制，后端服務器數據的同步由MySQL主從同步進行控制。

本次實驗環境架構圖

服務器主機規划

主機名	IP	功能	備注
linux-node1	192.168.56.11	mycat	需要安裝MySQL不用啟動
linux-node2	192.168.56.12	mysql-master1,mysql-slave1	slave1端口：3307
linux-node3	192.168.56.13	mysql-master2,mysql-slave2	slave2端口：3307

實戰演示

安裝MySQL數據庫

創建mysql用戶

 groupadd mysql
 useradd -r -g mysql -s /bin/false mysql

安裝MySQL

yum install -y libaio
cd /usr/local/src/
wget http://mirrors.sohu.com/mysql/MySQL-5.7/mysql-5.7.17-linux-glibc2.5-x86_64.tar.gz
tar -zxf mysql-5.7.17-linux-glibc2.5-x86_64.tar.gz 
cp -rf mysql-5.7.17-linux-glibc2.5-x86_64 /data/app/mysql-3306
cp -rf mysql-5.7.17-linux-glibc2.5-x86_64 /data/app/mysql-3307
chown -R mysql:mysql /data/app/mysql-3306
chown -R mysql:mysql /data/app/mysql-3307
/data/app/mysql-3306/bin/mysqld --initialize-insecure --user=mysql --basedir=/data/app/mysql-3306 --datadir=/data/app/mysql-3306/data
/data/app/mysql-3307/bin/mysqld --initialize-insecure --user=mysql --basedir=/data/app/mysql-3307 --datadir=/data/app/mysql-3307/data

生成my.cnf 配置文件

需要修改的參數：

server-id：保證每個配置文件唯一。
兩台master的自增長ID必須不同。

linux-node2

master端

cat > /data/app/mysql-3306/my.cnf<<EOF
[client]
port = 3306
socket = /data/app/mysql-3306/mysql.sock
[mysqld]

port = 3306
user = mysql
server-id = 1
bind-address = 0.0.0.0
basedir = /data/app/mysql-3306
datadir = /data/app/mysql-3306/data
socket = /data/app/mysql-3306/mysql.sock
pid-file = /data/app/mysql-3306/mysql.pid
log-error = /data/app/mysql-3306/mysqld.log

skip-name-resolve
log_bin = mysql-bin
log-slave-updates
auto-increment-increment = 2 
auto-increment-offset = 1

sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES 
EOF
chown mysql.mysql /data/app/mysql-3306/my.cnf

slave端

cat > /data/app/mysql-3307/my.cnf<<EOF
[client]
port = 3307
socket = /data/app/mysql-3307/mysql.sock
[mysqld]

port = 3307
user = mysql
server-id = 11
bind-address = 0.0.0.0
basedir = /data/app/mysql-3307
datadir = /data/app/mysql-3307/data
socket = /data/app/mysql-3307/mysql.sock
pid-file = /data/app/mysql-3307/mysql.pid
log-error = /data/app/mysql-3307/mysqld.log

skip-name-resolve
log_bin = mysql-bin


sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES 
EOF
chown mysql.mysql /data/app/mysql-3307/my.cnf

linux-node3

master端

cat > /data/app/mysql-3306/my.cnf<<EOF
[client]
port = 3306
socket = /data/app/mysql-3306/mysql.sock
[mysqld]

port = 3306
user = mysql
server-id = 2
bind-address = 0.0.0.0
basedir = /data/app/mysql-3306
datadir = /data/app/mysql-3306/data
socket = /data/app/mysql-3306/mysql.sock
pid-file = /data/app/mysql-3306/mysql.pid
log-error = /data/app/mysql-3306/mysqld.log

skip-name-resolve
log_bin = mysql-bin
log-slave-updates
auto-increment-increment = 2 
auto-increment-offset = 2

sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES 
EOF
chown mysql.mysql /data/app/mysql-3306/my.cnf

slave 端

cat > /data/app/mysql-3307/my.cnf<<EOF
[client]
port = 3307
socket = /data/app/mysql-3307/mysql.sock
[mysqld]

port = 3307
user = mysql
server-id = 22
bind-address = 0.0.0.0
basedir = /data/app/mysql-3307
datadir = /data/app/mysql-3307/data
socket = /data/app/mysql-3307/mysql.sock
pid-file = /data/app/mysql-3307/mysql.pid
log-error = /data/app/mysql-3307/mysqld.log

skip-name-resolve
log_bin = mysql-bin


sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES 
EOF
chown mysql.mysql /data/app/mysql-3307/my.cnf

啟動MySQL進程

linux-node2和linux-node3都執行如下命令

touch /data/app/mysql-3306/mysqld.log && chown mysql.mysql /data/app/mysql-3306/mysqld.log
sed -i 's#/usr/local/mysql#/data/app/mysql-3306#g' /data/app/mysql-3306/bin/mysqld_safe 
/data/app/mysql-3306/bin/mysqld_safe --defaults-file=/data/app/mysql-3306/my.cnf --basedir=/data/app/mysql-3306 --datadir=/data/app/mysql-3306/data --user=mysql &


touch /data/app/mysql-3307/mysqld.log && chown mysql.mysql /data/app/mysql-3307/mysqld.log
sed -i 's#/usr/local/mysql#/data/app/mysql-3307#g' /data/app/mysql-3307/bin/mysqld_safe 
/data/app/mysql-3307/bin/mysqld_safe --defaults-file=/data/app/mysql-3307/my.cnf --basedir=/data/app/mysql-3307 --datadir=/data/app/mysql-3307/data --user=mysql &

檢查端口是否正常

ss -lntup |egrep '3306|3307'
tcp    LISTEN     0      80                     *:3306                  *:*      users:(("mysqld",19973,22))
tcp    LISTEN     0      80                     *:3307                  *:*      users:(("mysqld",20537,22))

MySQL雙主配置

第一步先配置主從模式

linux-node2

master端

cd /data/app/mysql-3306/
./bin/mysql -uroot -p -S mysql.sock -P 3306
mysql> CREATE USER 'repl'@'192.%' IDENTIFIED BY 'mysql';
Query OK, 0 rows affected (0.05 sec)

mysql> GRANT REPLICATION SLAVE ON *.* TO 'repl'@'192.%';
Query OK, 0 rows affected (0.00 sec)

mysql> show master status;
+------------------+----------+--------------+------------------+-------------------+
| File             | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |
+------------------+----------+--------------+------------------+-------------------+
| mysql-bin.000001 |      613 |              |                  |                   |
+------------------+----------+--------------+------------------+-------------------+
1 row in set (0.00 sec)

slave端

cd /data/app/mysql-3307/
./bin/mysql -uroot -p -S mysql.sock -P 3307
mysql> CHANGE MASTER TO MASTER_HOST='192.168.56.12', 
    ->                  MASTER_PORT=3306, 
    ->                  MASTER_USER='repl', 
    ->                  MASTER_PASSWORD='mysql', 
    ->                  MASTER_LOG_FILE='mysql-bin.000001', 
    ->                  MASTER_LOG_POS=613;
Query OK, 0 rows affected, 2 warnings (0.04 sec)

mysql> start slave;
Query OK, 0 rows affected (0.02 sec)
mysql> show slave status\G
*************************** 1. row ***************************
               Slave_IO_State: Waiting for master to send event
                  Master_Host: 192.168.56.12
                  Master_User: repl
                  Master_Port: 3306
                Connect_Retry: 60
              Master_Log_File: mysql-bin.000001
          Read_Master_Log_Pos: 613
               Relay_Log_File: linux-node2-relay-bin.000002
                Relay_Log_Pos: 320
        Relay_Master_Log_File: mysql-bin.000001
             Slave_IO_Running: Yes
            Slave_SQL_Running: Yes

linux-node3

master端

cd /data/app/mysql-3306/
./bin/mysql -uroot -p -S mysql.sock -P 3306
mysql> CREATE USER 'repl'@'192.%' IDENTIFIED BY 'mysql';
Query OK, 0 rows affected (0.05 sec)

mysql> GRANT REPLICATION SLAVE ON *.* TO 'repl'@'192.%';
Query OK, 0 rows affected (0.00 sec)

mysql> show master status;
+------------------+----------+--------------+------------------+-------------------+
| File             | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |
+------------------+----------+--------------+------------------+-------------------+
| mysql-bin.000001 |      613 |              |                  |                   |
+------------------+----------+--------------+------------------+-------------------+
1 row in set (0.00 sec)

slave端

cd /data/app/mysql-3307/
./bin/mysql -uroot -p -S mysql.sock -P 3307
mysql> 
CHANGE MASTER TO MASTER_HOST='192.168.56.13', 
                 MASTER_PORT=3306, 
                 MASTER_USER='repl', 
                 MASTER_PASSWORD='mysql', 
                 MASTER_LOG_FILE='mysql-bin.000001', 
                 MASTER_LOG_POS=613;
Query OK, 0 rows affected, 2 warnings (0.04 sec)

mysql> start slave;
Query OK, 0 rows affected (0.02 sec)
mysql> show slave status\G
*************************** 1. row ***************************
               Slave_IO_State: Waiting for master to send event
                  Master_Host: 192.168.56.13
                  Master_User: repl
                  Master_Port: 3306
                Connect_Retry: 60
              Master_Log_File: mysql-bin.000001
          Read_Master_Log_Pos: 613
               Relay_Log_File: linux-node2-relay-bin.000002
                Relay_Log_Pos: 320
        Relay_Master_Log_File: mysql-bin.000001
             Slave_IO_Running: Yes
            Slave_SQL_Running: Yes

第二步配置雙主模式
檢查兩個master端的binlog位置

linux-node2 master端

cd /data/app/mysql-3306/
./bin/mysql -uroot -p -S mysql.sock -P 3306
mysql> show master status;
+------------------+----------+--------------+------------------+-------------------+
| File             | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |
+------------------+----------+--------------+------------------+-------------------+
| mysql-bin.000001 |      613 |              |                  |                   |
+------------------+----------+--------------+------------------+-------------------+
1 row in set (0.00 sec)

linux-node3 master端

cd /data/app/mysql-3306/
./bin/mysql -uroot -p -S mysql.sock -P 3306
mysql> show master status;
+------------------+----------+--------------+------------------+-------------------+
| File             | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |
+------------------+----------+--------------+------------------+-------------------+
| mysql-bin.000001 |      613 |              |                  |                   |
+------------------+----------+--------------+------------------+-------------------+
1 row in set (0.00 sec)

node2-master 上配置跟node3同步

CHANGE MASTER TO MASTER_HOST='192.168.56.13', 
                 MASTER_PORT=3306, 
                 MASTER_USER='repl', 
                 MASTER_PASSWORD='mysql', 
                 MASTER_LOG_FILE='mysql-bin.000001', 
                 MASTER_LOG_POS=613;
mysql> start slave;
Query OK, 0 rows affected (0.03 sec)

mysql> show slave status\G
*************************** 1. row ***************************
               Slave_IO_State: Waiting for master to send event
                  Master_Host: 192.168.56.13
                  Master_User: repl
                  Master_Port: 3306
                Connect_Retry: 60
              Master_Log_File: mysql-bin.000001
          Read_Master_Log_Pos: 613
               Relay_Log_File: linux-node2-relay-bin.000002
                Relay_Log_Pos: 320
        Relay_Master_Log_File: mysql-bin.000001
             Slave_IO_Running: Yes
            Slave_SQL_Running: Yes

node3-master 上配置跟node2同步

CHANGE MASTER TO MASTER_HOST='192.168.56.12', 
                 MASTER_PORT=3306, 
                 MASTER_USER='repl', 
                 MASTER_PASSWORD='mysql', 
                 MASTER_LOG_FILE='mysql-bin.000001', 
                 MASTER_LOG_POS=613;
mysql> start slave;
Query OK, 0 rows affected (0.00 sec)

mysql> 
mysql> show slave status\G
*************************** 1. row ***************************
               Slave_IO_State: Waiting for master to send event
                  Master_Host: 192.168.56.12
                  Master_User: repl
                  Master_Port: 3306
                Connect_Retry: 60
              Master_Log_File: mysql-bin.000001
          Read_Master_Log_Pos: 613
               Relay_Log_File: linux-node3-relay-bin.000002
                Relay_Log_Pos: 320
        Relay_Master_Log_File: mysql-bin.000001
             Slave_IO_Running: Yes
            Slave_SQL_Running: Yes

開始驗證結果

在node2-master主機上創建數據

mysql> create database test;
Query OK, 1 row affected (0.01 sec)

mysql> use test;
Database changed

mysql> create table temp(id int,name varchar(64));
Query OK, 0 rows affected (0.11 sec)

mysql> insert into temp values(1,'aaa');
Query OK, 1 row affected (0.28 sec)

mysql> CREATE TABLE temp2(id INT PRIMARY KEY  NOT NULL AUTO_INCREMENT ,nname VARCHAR(64));
Query OK, 0 rows affected (0.01 sec)

mysql> insert into temp2(nname) values('bbb');
Query OK, 1 row affected (0.01 sec)

mysql> select * from test.temp;
+------+------+
| id   | name |
+------+------+
|    1 | aaa  |
+------+------+
1 row in set (0.01 sec)

mysql>

在node2-slave端查看數據是否存在

mysql> select * from test.temp;
+------+------+
| id   | name |
+------+------+
|    1 | aaa  |
+------+------+
1 row in set (0.00 sec)

mysql>

在node3-master端查看數據是否存在

mysql> select * from test.temp;
+------+------+
| id   | name |
+------+------+
|    1 | aaa  |
+------+------+
1 row in set (0.00 sec)

mysql>

在node3-slave端查看數據是否存在

mysql> select * from test.temp;
+------+------+
| id   | name |
+------+------+
|    1 | aaa  |
+------+------+
1 row in set (0.00 sec)

mysql>

在node3-master主機上創建數據

mysql> use test;

mysql> insert into temp2(nname) values('ddd');
Query OK, 1 row affected (0.02 sec)
mysql>  insert into temp2(nname) values('fff');
Query OK, 1 row affected (0.00 sec)

mysql> select * from test.temp2;
+----+-------+
| id | nname |
+----+-------+
|  1 | bbb   |
|  2 | ddd   |
|  4 | fff   |
+----+-------+
3 rows in set (0.00 sec)

在node3-slave端查看數據是否存在

mysql> select * from test.temp2;
+----+-------+
| id | nname |
+----+-------+
|  1 | bbb   |
|  2 | ddd   |
|  4 | fff   |
+----+-------+
3 rows in set (0.00 sec)

mysql>

在node2-master端查看數據是否存在

mysql> select * from test.temp2;
+----+-------+
| id | nname |
+----+-------+
|  1 | bbb   |
|  2 | ddd   |
|  4 | fff   |
+----+-------+
3 rows in set (0.00 sec)

mysql>

在node2-slave端查看數據是否存在

mysql> select * from test.temp2;
+----+-------+
| id | nname |
+----+-------+
|  1 | bbb   |
|  2 | ddd   |
|  4 | fff   |
+----+-------+
3 rows in set (0.00 sec)

mysql>

結論

在任意一個master端更新數據，其他任意端都可以更新數據。
兩台服務器配置了間隔自增長，數據不同沖突。

mycat安裝

cd /usr/local/src
wget http://dl.mycat.io/1.6-RELEASE/Mycat-server-1.6-RELEASE-20161028204710-linux.tar.gz
tar -zxf Mycat-server-1.6-RELEASE-20161028204710-linux.tar.gz 
mv mycat /data/app/mycat-1.6
ln -s /data/app/mycat-1.6 /data/app/mycat

修改schema.xml 的配置文件

balance="1" : 全部的readHost與stand by writeHost參與select語句的負載均衡。
writeType="0" : 所有寫操作發送到配置的第一個writeHost，第一個掛了切到還生存的第二個 writeHost，重新啟動后以切換后的為准，切換記錄在配置文件中:dnindex.properties 。
switchType="1" : 1 默認值，自動切換。

cd /data/app/mycat
cp conf/schema.xml conf/schema.xml.bak
cat > conf/schema.xml <<EOF
<?xml version="1.0"?>
<!DOCTYPE mycat:schema SYSTEM "schema.dtd">
<mycat:schema xmlns:mycat="http://io.mycat/">
<schema name="TESTDB" checkSQLschema="true" sqlMaxLimit="100" dataNode="dn1"></schema>
	<dataNode name="dn1" dataHost="node1" database="test" />
	<dataHost name="node1" maxCon="10" minCon="5" balance="1" writeType="0" dbType="mysql" dbDriver="native" switchType="1">
		<heartbeat>select user()</heartbeat>
		<writeHost host="master1" url="192.168.56.12:3306" user="root" password="mysql">
			<readHost host="slave2" url="192.168.56.13:3307" user="root" password="mysql" />
		</writeHost>
		<writeHost host="master2" url="192.168.56.13:3306" user="root" password="mysql">
			<readHost host="slave2" url="192.168.56.13:3307" user="root" password="mysql" />
		</writeHost>
	</dataHost>
</mycat:schema>
EOF

啟動mycat服務

./bin/mycat start 
ss -lntup |egrep  '(8066|9066)'  
tcp    LISTEN     0      100                   :::8066                 :::*      users:(("java",16546,79))
tcp    LISTEN     0      100                   :::9066                 :::*      users:(("java",16546,75))

驗證mycat服務是否正常

第一步：在linux-node2-master端配置mycat連接賬號

mysql> GRANT ALL PRIVILEGES ON *.* TO root@'192.%' IDENTIFIED BY 'mysql'; 
Query OK, 0 rows affected, 1 warning (0.07 sec)

第二步：在mycat服務器上安裝mysql服務，但是不啟動。

具體步驟省略，詳細內容可以參考上面的MySQL安裝。

第三步：使用mysql的客戶端連接mycat

cd /data/app/mysql/
./bin/mysql -uroot -p -P 8066 -h 192.168.56.11 ##連接mycat，初始密碼123456
mysql> show databases;
+----------+
| DATABASE |
+----------+
| TESTDB   |
+----------+
1 row in set (0.00 sec)

mysql> use TESTDB;

mysql> insert into temp2(nname) values('eee');
Query OK, 1 row affected (0.09 sec)
mysql> insert into temp2(nname) values('ggg');
Query OK, 1 row affected (0.01 sec)

linux-node3-slave 端查看數據是否同步

mysql> select * from test.temp2;
+----+-------+
| id | nname |
+----+-------+
|  1 | bbb   |
|  2 | ddd   |
|  4 | fff   |
|  5 | eee   |
|  7 | ggg   |
+----+-------+
5 rows in set (0.00 sec)

根據查詢結果發現數據寫入到了linux-node3-slave端。

測試一台master端掛了服務自動遷移

關閉linux-node2-master的服務

mysql> shutdown;
Query OK, 0 rows affected (0.01 sec)

shell > ss -lntup |grep 3306 ## 確認端口已經關閉。

mycat端插入新的數據查看數據是否同步

mysql> insert into temp2(nname) values('mmmm');
Query OK, 1 row affected (0.07 sec)

mysql> insert into temp2(nname) values('nnnn');
Query OK, 1 row affected (0.01 sec)

linux-node3-slave端查看數據是否同步

mysql> select * from test.temp2;
+----+-------+
| id | nname |
+----+-------+
|  1 | bbb   |
|  2 | ddd   |
|  4 | fff   |
|  5 | eee   |
|  7 | ggg   |
|  8 | mmmm  |
| 10 | nnnn  |
+----+-------+
7 rows in set (0.00 sec)

mysql>

linux-node2-slave端查看數據是否同步

mysql> select * from test.temp2;
+----+-------+
| id | nname |
+----+-------+
|  1 | bbb   |
|  2 | ddd   |
|  4 | fff   |
|  5 | eee   |
|  7 | ggg   |
+----+-------+
5 rows in set (0.00 sec)

mysql>

因為linux-node2的master端已經掛了，故數據不能同步。

測試一台master端掛掉，數據訪問是否正常

登錄到mycat服務器上執行如下命令：

mysql> select * from temp2;
+----+-------+
| id | nname |
+----+-------+
|  1 | bbb   |
|  2 | ddd   |
|  4 | fff   |
|  5 | eee   |
|  7 | ggg   |
|  8 | mmmm  |
| 10 | nnnn  |
+----+-------+
7 rows in set (0.00 sec)

mysql> select * from temp2;
+----+-------+
| id | nname |
+----+-------+
|  1 | bbb   |
|  2 | ddd   |
|  4 | fff   |
|  5 | eee   |
|  7 | ggg   |
|  8 | mmmm  |
| 10 | nnnn  |
+----+-------+
7 rows in set (0.00 sec)

執行多次發現結果一樣，說明在一台master端掛掉的情況下，其連接的slave端也被剔除，因此數據完整性可以保證。

參考

mycat權威指南

故障匯總

第一次配置的時候maser端沒有配置log-slave-updates導致，node3-slave上沒有node2-master端的數據。
解釋：
從庫開啟log-bin參數，如果直接往從庫寫數據，是可以記錄log-bin日志的，但是從庫通過I0線程讀取主庫二進制日志文件，然后通過SQL線程寫入的數據，是不會記錄binlog日志的。也就是說從庫從主庫上復制的數據，是不寫入從庫的binlog日志的。所以從庫做為其他從庫的主庫時需要在配置文件中添加log-slave-updates參數。

解決辦法：

[mysqld]
log-slave-updates

免責聲明！

本站轉載的文章為個人學習借鑒使用，本站對版權不負任何法律責任。如果侵犯了您的隱私權益，請聯系本站郵箱yoyou2525@163.com刪除。

猜您在找 MyCat實現MySQL雙主雙從的讀寫分離 4、讀寫分離---雙主雙從（mycat） mycat 1.6.6.1安裝以及配置docker 安裝mysql 5.7.24 雙主多從讀寫分離主主切換基於Mycat實現讀寫分離 Mycat實現讀寫分離 mycat實現讀寫分離（一） mycat實現讀寫分離 MySQL主從復制 + Mycat實現讀寫分離 Mycat實現mysql主從復制(讀寫分離) mysql+mycat搭建穩定高可用集群，負載均衡，主備復制，讀寫分離