haproxy mycat mysql 讀寫分離MHA高可用

本文轉載自查看原文 2018-03-28 14:52 1995 MySQL性能優化

主機IP信息

hostname	IP
172.16.3.140	haproxy01
172.16.3.141	haproxy02
172.16.3.142	mycat01
172.16.3.143	mycat02
172.16.3.152	mha
172.16.3.153	master
172.16.3.154	slave01
172.16.3.155	slave02

mysql 安裝：http://www.cnblogs.com/jenvid/p/8516781.html

mycat安裝

mycat部署到節點

172.16.3.142 mycat01
172.16.3.143 mycat02

1.部署mycat

https://segmentfault.com/a/1190000009520414
https://www.cnblogs.com/raphael5200/p/5884931.html
https://www.cnblogs.com/hk315523748/p/6094656.html
http://www.roncoo.com/course/view/f614343765bc4aac8597c6d8b38f06fd
https://www.cnblogs.com/conanwang/p/5961019.html

1.1解壓復制到`/usr/local/mycat`

http://dl.mycat.io/

1.2安裝jdk

https://blog.csdn.net/linlinv3/article/details/45060705

1)下載jdkwget http://dl.mycat.io/jdk-8u20-linux-x64.tar.gz
2)解壓tar -zxvf jdk-8u20-linux-x64.tar.gz -C /usr/lib
3)解壓后拷貝到lib目錄cp -rp jdk1.8.0_20 /usr/lib
4)配置環境變量

vi /etc/profile
export JAVA_HOME=/usr/lib/jdk1.8.0_20
export JRE_HOME=$JAVA_HOME/jre
export CLASSPATH=.:$JAVA_HOME/lib:$JER_HOME/lib:$CLASSPATH
export PATH=$JAVA_HOME/bin:$JER_HOME/bin:$PATH:/usr/local/mycat/bin
export MYCAT_HOME=/usr/local/mycat

source /etc/profile
java -version
[root@mycat01 jdk1.8.0_20]# java -version
java version "1.8.0_20"
Java(TM) SE Runtime Environment (build 1.8.0_20-b26)
Java HotSpot(TM) 64-Bit Server VM (build 25.20-b23, mixed mode)

2.配置mycat server.xml

grant select on *.* to 'readonly'@'172.16.3.%' identified by 'readonly';

server.xml

user定義的是mycat服務端口8066和管理端口9066的登錄信息，和后端mysql授權沒關系
schemas定義的是mycat的邏輯DB名稱，必須和schema.xml的schema name=必須一致

        <property name="txlsolation">2</property>
        </system>
        <user name="mycatdb">
                <property name="password">1234567</property>
                <property name="schemas">test</property>
        </user>

        <user name="readonly">
                <property name="password">readonly1</property>
                <property name="schemas">test</property>
                <property name="readOnly">true</property>
        </user>
</mycat:server>

3.配置mycat schema

schema.xml

schema name=必須和server.xml的schema一致
dataNode="dn_tpcc100"指定需要使用的數據節點
dataHost指定數據節點

<?xml version="1.0"?>
<!DOCTYPE mycat:schema SYSTEM "schema.dtd">
<mycat:schema xmlns:mycat="http://org.opencloudb/" >
        <schema name="test" checkSQLschema="false" sqlMaxLimit="100" dataNode="dn_test"> </schema>

        <dataNode name="dn_test" dataHost="dh_3.151" database="test" />

        <dataHost name="dh_3.151" maxCon="1000" minCon="10" balance="1"
                          writeType="0" dbType="mysql" dbDriver="native" switchType="1"  slaveThreshold="100">
                <heartbeat>show slave status</heartbeat>
                <!-- can have multi write hosts -->
                <writeHost host="Master_vip" url="172.16.3.151:3306" user="root" password="123456">
                        <!-- can have multi read hosts -->
                        <readHost host="S1_3.154" url="172.16.3.154:3306" user="root" password="123456" />
                        <readHost host="S2_3.155" url="172.16.3.155:3306" user="root" password="123456" />
                </writeHost>
                <!-- <writeHost host="hostM2" url="localhost:3316" user="root" password="123456"/> -->
        </dataHost>
</mycat:schema>

writeHost和readhost如果填寫的用戶名不一樣，所有的讀寫將發送到writehost，balance不起作用

4.啟動mycat`./mycat start`

#因為磁盤滿了，主庫創建用戶語句還沒在從庫生效
               Master_SSL_Key: 
        Seconds_Behind_Master: 170301
Master_SSL_Verify_Server_Cert: No
                Last_IO_Errno: 0

5.檢查端口

[root@mycat01 bin]# netstat -lnpt
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      880/sshd            
tcp        0      0 127.0.0.1:32000         0.0.0.0:*               LISTEN      1418/java           
tcp6       0      0 :::8066                 :::*                    LISTEN      1418/java           
tcp6       0      0 :::9066                 :::*                    LISTEN      1418/java           
tcp6       0      0 :::55407                :::*                    LISTEN      1418/java           
tcp6       0      0 :::35574                :::*                    LISTEN      1418/java           
tcp6       0      0 :::22                   :::*                    LISTEN      880/sshd            
tcp6       0      0 :::1984                 :::*                    LISTEN      1418/java

https://blog.csdn.net/kefengwang/article/details/54233390

6.登錄讀寫分離服務8066

這里以server.xml的定義的用戶登錄
顯示的是mycat的邏輯庫

[root@mycat01 ~]# mysql -uroot -p1234567 -h127.0.0.1 -P 8066
Warning: Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 3
Server version: 5.5.8-mycat-1.5.1-RELEASE-20160525110043 MyCat Server (OpenCloundDB)

Copyright (c) 2000, 2018, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

root@127.0.0.1 12:04:  [(none)]> show databases;
+----------+
| DATABASE |
+----------+
| db1      |
| test     |
| tpcc100  |
+----------+
3 rows in set (0.00 sec)

root@127.0.0.1 12:04:  [(none)]>

7.登錄mycat管理端9066

show @@heartbeat;里面顯示的name是在schema.xml里面定義
- RS_CODE=1表示心跳正常

[root@mycat01 bin]# mysql -uroot -p1234567 -h127.0.0.1 -P 9066
Warning: Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 1
Server version: 5.5.8-mycat-1.5.1-RELEASE-20160525110043 MyCat Server (monitor)

Copyright (c) 2000, 2018, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

root@127.0.0.1 12:06:  [(none)]> show @@heartbeat;
+------------+-------+--------------+------+---------+-------+--------+---------+--------------+---------------------+-------+
| NAME       | TYPE  | HOST         | PORT | RS_CODE | RETRY | STATUS | TIMEOUT | EXECUTE_TIME | LAST_ACTIVE_TIME    | STOP  |
+------------+-------+--------------+------+---------+-------+--------+---------+--------------+---------------------+-------+
| Master_vip | mysql | 172.16.3.151 | 3306 |       1 |     0 | idle   |       0 | 0,0,0        | 2018-03-26 12:06:53 | false |
| S1_3.154   | mysql | 172.16.3.154 | 3306 |       1 |     0 | idle   |       0 | 0,0,0        | 2018-03-26 12:06:53 | false |
| S2_3.155   | mysql | 172.16.3.155 | 3306 |       1 |     0 | idle   |       0 | 0,0,0        | 2018-03-26 12:06:53 | false |
+------------+-------+--------------+------+---------+-------+--------+---------+--------------+---------------------+-------+
3 rows in set (0.01 sec)

root@127.0.0.1 12:07:  [(none)]> show @@datasource;
+------------+------------+-------+--------------+------+------+--------+------+------+---------+
| DATANODE   | NAME       | TYPE  | HOST         | PORT | W/R  | ACTIVE | IDLE | SIZE | EXECUTE |
+------------+------------+-------+--------------+------+------+--------+------+------+---------+
| dn_db1     | Master_vip | mysql | 172.16.3.151 | 3306 | W    |      0 |   15 | 1000 |     244 |
| dn_db1     | S1_3.154   | mysql | 172.16.3.154 | 3306 | R    |      0 |   11 | 1000 |     234 |
| dn_db1     | S2_3.155   | mysql | 172.16.3.155 | 3306 | R    |      0 |   11 | 1000 |     235 |
| dn_test    | Master_vip | mysql | 172.16.3.151 | 3306 | W    |      0 |   15 | 1000 |     244 |
| dn_test    | S1_3.154   | mysql | 172.16.3.154 | 3306 | R    |      0 |   11 | 1000 |     234 |
| dn_test    | S2_3.155   | mysql | 172.16.3.155 | 3306 | R    |      0 |   11 | 1000 |     235 |
| dn_tpcc100 | Master_vip | mysql | 172.16.3.151 | 3306 | W    |      0 |   15 | 1000 |     244 |
| dn_tpcc100 | S1_3.154   | mysql | 172.16.3.154 | 3306 | R    |      0 |   11 | 1000 |     234 |
| dn_tpcc100 | S2_3.155   | mysql | 172.16.3.155 | 3306 | R    |      0 |   11 | 1000 |     235 |
+------------+------------+-------+--------------+------+------+--------+------+------+---------+
9 rows in set (0.00 sec)

8.mycat讀寫分離驗證

1)修改mycat日志等級為debug，重啟mycat生效

vi /usr/local/mycat/conf/log4j.xml
<level value="debug" />

2)以mycat的root用戶創建表插入數據

[root@mycat01 ~]# mysql -uroot -p1234567 -h127.0.0.1 -P 8066
Warning: Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 5
Server version: 5.5.8-mycat-1.5.1-RELEASE-20160525110043 MyCat Server (OpenCloundDB)

Copyright (c) 2000, 2018, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

root@127.0.0.1 12:12:  [(none)]> select user();
+----------------+
| USER()         |
+----------------+
| root@127.0.0.1 |
+----------------+
1 row in set (0.00 sec)

root@127.0.0.1 12:12:  [(none)]> show databases;
+----------+
| DATABASE |
+----------+
| db1      |
| test     |
| tpcc100  |
+----------+
3 rows in set (0.01 sec)

root@127.0.0.1 12:12:  [(none)]> use db1;
Database changed
root@127.0.0.1 12:12:  [db1]> show tables;
+---------------+
| Tables_in_db1 |
+---------------+
| t1            |
| t2            |
| t3            |
+---------------+
3 rows in set (0.01 sec)

create table t4 (id int not null primary key,user_id varchar(20),user_name varchar(20),date DATE);
insert into t4 values(1,'001','yzw1',20180326);
insert into t4 values(2,'002','yzw2',20180326);   
insert into t4 values(3,'003','yzw3',20180326);

在mycat.log中可以看到路由信息

03/26 12:17:23.925  DEBUG [$_NIOREACTOR-1-RW] (NonBlockingSession.java:229) -release connection MySQLConnection [id=7, lastTime=1522037843904, user=root, schema=db1
, old shema=db1, borrowed=true, fromSlaveDB=false, threadId=183, charset=utf8, txIsolation=3, autocommit=true, attachment=dn_db1{insert into t4 values(3,'003','yzw3
',20180326)}, respHandler=SingleNodeHandler [node=dn_db1{insert into t4 values(3,'003','yzw3',20180326)}, packetId=1], host=172.16.3.151, port=3306, statusSync=null
, writeQueue=0, modifiedSQLExecuted=true]

讀的時候則選擇從庫路由

03/26 13:27:24.531  DEBUG [$_NIOREACTOR-0-RW] (NonBlockingSession.java:229) -release connection MySQLConnection [id=35, lastTime=1522042044524, user=readonly, schema=db1, old shema=db1, borrowed=true, fromSlaveDB=true, threadId=83, charset=utf8, txIsolation=3, autocommit=true, attachment=dn_db1{select * from db1}, respHandler=SingleNodeHandler [node=dn_db1{select * from db1}, packetId=1], host=172.16.3.155, port=3306, statusSync=org.opencloudb.mysql.nio.MySQLConnection$StatusSync@c7c82a3, writeQueue=0, modifiedSQLExecuted=false]
03/26 13:27:24.531  DEBUG [$_NIOREACTOR-0-RW] (PhysicalDatasource.java:403) -release channel MySQLConnection [id=35, lastTime=1522042044524, user=readonly, schema=db1, old shema=db1, borrowed=true, fromSlaveDB=true, threadId=83, charset=utf8, txIsolation=3, autocommit=true, attachment=null, respHandler=null, host=172.16.3.155, port=3306, statusSync=null, writeQueue=0, modifiedSQLExecuted=false]

只讀賬號進行寫數據則報錯

readonly@127.0.0.1 13:28:  [db1]> create table t5 (id int);
ERROR 1495 (HY000): User readonly
readonly@127.0.0.1 13:28:  [db1]>

keepalived安裝

keepalvied部署到節點

172.16.3.140 haproxy01
172.16.3.141 haproxy02

1.下載解壓編譯安裝

http://www.keepalived.org/download.html

wget http://www.keepalived.org/software/keepalived-1.4.2.tar.gz
yum install curl gcc openssl-devel libnl3-devel net-snmp-devel libnfnetlink-devel
tar -zxvf keepalived-1.4.2.tar.gz 
cd keepalived-1.4.2
./configure --prefix=/usr/local/keepalived-1.4.2
make && make install

http://www.keepalived.org/doc/installing_keepalived.html

2.拷貝文件

cp -rp /root/keepalived-1.4.2/keepalived/etc/init.d/keepalived /etc/init.d
cp -rp /root/keepalived-1.4.2/keepalived/etc/sysconfig/keepalived /etc/sysconfig/ 
ln -s /usr/local/keepalived-1.4.2/sbin/keepalived  /usr/sbin
cp -rp /usr/local/keepalived-1.4.2/etc/keepalived/keepalived.conf /etc/keepalived
systemctl enable keepalived
ln -s /usr/local/keepalived-1.4.2 /usr/local/keepalived/
mkdir /usr/local/keepalived/log/

3.增加配置`/etc/keepalived/keepalived.conf`

master

! Configuration File for keepalived  
global_defs {  
## keepalived 自帶的郵件提醒需要開啟 sendmail 服務。建議用獨立的監控或第三方 SMTP  
    router_id haproxy02 ## 標識本節點的字條串，通常為 hostname  
}  
## keepalived 會定時執行腳本並對腳本執行的結果進行分析，動態調整 vrrp_instance 的優先級。  
## 如果腳本執行結果為 0，並且 weight 配置的值大於 0，則優先級相應的增加。  
## 如果腳本執行結果非 0，並且 weight 配置的值小於 0，則優先級相應的減少。  
## 其他情況，維持原本配置的優先級，即配置文件中 priority 對應的值。  
vrrp_script chk_haproxy {  
    script "/etc/keepalived/haproxy_check.sh" ## 檢測 haproxy 狀態的腳本路徑  
    interval 2 ## 檢測時間間隔  
    weight 2 ## 如果條件成立，權重+2  
}  
## 定義虛擬路由， VI_1 為虛擬路由的標示符，自己定義名稱  
vrrp_instance VI_1 {  
    state BACKUP ## 默認主設備（priority 值大的）和備用設備（priority 值小的）都設置為 BACKUP，  
    ## 由 priority 來控制同時啟動情況下的默認主備，否則先啟動的為主設備  
    interface eth0 ## 綁定虛擬 IP 的網絡接口，與本機 IP 地址所在的網絡接口相同，我的是 eth0 
    virtual_router_id 35 ## 虛擬路由的 ID 號，兩個節點設置必須一樣，可選 IP 最后一段使用,  
    ## 相同的 VRID 為一個組，他將決定多播的 MAC 地址  
    priority 180 ## 節點優先級，值范圍 0-254， MASTER 要比 BACKUP 高  
    nopreempt ## 主設備（priority 值大的）配置一定要加上 nopreempt，否則非搶占也不起作用  
    advert_int 1 ## 組播信息發送間隔，兩個節點設置必須一樣，默認 1s  
    ## 設置驗證信息，兩個節點必須一致  
    authentication {  
        auth_type PASS  
        auth_pass 180326 ## 真實生產，按需求對應該過來  
    }  
    ## 將 track_script 塊加入 instance 配置塊  
    track_script {  
        chk_haproxy ## 檢查 HAProxy 服務是否存活  
    }  
    ## 虛擬 IP 池, 兩個節點設置必須一樣  
    virtual_ipaddress {  
        172.16.3.144 ## 虛擬 ip，可以定義多個，每行一個  
    }  
}

backup

! Configuration File for keepalived  
global_defs {  
## keepalived 自帶的郵件提醒需要開啟 sendmail 服務。建議用獨立的監控或第三方 SMTP  
    router_id haproxy01 ## 標識本節點的字條串，通常為 hostname  
}  
## keepalived 會定時執行腳本並對腳本執行的結果進行分析，動態調整 vrrp_instance 的優先級。  
## 如果腳本執行結果為 0，並且 weight 配置的值大於 0，則優先級相應的增加。  
## 如果腳本執行結果非 0，並且 weight 配置的值小於 0，則優先級相應的減少。  
## 其他情況，維持原本配置的優先級，即配置文件中 priority 對應的值。  
vrrp_script chk_haproxy {  
    script "/etc/keepalived/haproxy_check.sh" ## 檢測 haproxy 狀態的腳本路徑  
    interval 2 ## 檢測時間間隔  
    weight 2 ## 如果條件成立，權重+2  
}  
## 定義虛擬路由， VI_1 為虛擬路由的標示符，自己定義名稱  
vrrp_instance VI_1 {  
    state BACKUP ## 默認主設備（priority 值大的）和備用設備（priority 值小的）都設置為 BACKUP，  
    ## 由 priority 來控制同時啟動情況下的默認主備，否則先啟動的為主設備  
    interface eth0 ## 綁定虛擬 IP 的網絡接口，與本機 IP 地址所在的網絡接口相同，我的是 eth0  
    virtual_router_id 35 ## 虛擬路由的 ID 號，兩個節點設置必須一樣，可選 IP 最后一段使用,  
    ## 相同的 VRID 為一個組，他將決定多播的 MAC 地址  
    priority 120 ## 節點優先級，值范圍 0-254， MASTER 要比 BACKUP 高  
    nopreempt ## 主設備（priority 值大的）配置一定要加上 nopreempt，否則非搶占也不起作用  
    advert_int 1 ## 組播信息發送間隔，兩個節點設置必須一樣，默認 1s  
    ## 設置驗證信息，兩個節點必須一致  
    authentication {  
        auth_type PASS  
        auth_pass 180326 ## 真實生產，按需求對應該過來  
    }  
    ## 將 track_script 塊加入 instance 配置塊  
    track_script {  
        chk_haproxy ## 檢查 HAProxy 服務是否存活  
    }  
    ## 虛擬 IP 池, 兩個節點設置必須一樣  
    virtual_ipaddress {  
        172.16.3.144 ## 虛擬 ip，可以定義多個，每行一個  
    }  
}

4.檢查腳本

vi /etc/keepalived/haproxy_check.sh
#!/bin/bash  
START_HAPROXY="/etc/rc.d/init.d/haproxy start"  
STOP_HAPROXY="/etc/rc.d/init.d/haproxy stop"  
LOG_FILE="/usr/local/keepalived/log/haproxy-check.log"  
HAPS=`ps -C haproxy --no-header |wc -l`  
date "+%Y-%m-%d %H:%M:%S" >> $LOG_FILE  
echo "check haproxy status" >> $LOG_FILE  
if [ $HAPS -eq 0 ];then  
echo $START_HAPROXY >> $LOG_FILE  
$START_HAPROXY >> $LOG_FILE 2>&1  
sleep 3  
if [ `ps -C haproxy --no-header |wc -l` -eq 0 ];then  
echo "start haproxy failed, killall keepalived" >> $LOG_FILE  
killall keepalived  
fi  
fi

5.授權檢查腳本`chmod +x /etc/keepalived/haproxy_check.sh`

https://blog.csdn.net/l1028386804/article/details/76397064

6.在2個節點上啟動keepalived`systemctl start keepalived`

2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether 00:50:56:a3:d0:2e brd ff:ff:ff:ff:ff:ff
    inet 172.16.3.140/24 brd 172.16.3.255 scope global eth0
       valid_lft forever preferred_lft forever
    inet 172.16.3.144/32 scope global eth0
       valid_lft forever preferred_lft forever
    inet6 fe80::250:56ff:fea3:d02e/64 scope link 
       valid_lft forever preferred_lft forever

7.切換VIP測試

[root@haproxy01 keepalived]# ip a
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether 00:50:56:a3:d0:2e brd ff:ff:ff:ff:ff:ff
    inet 172.16.3.140/24 brd 172.16.3.255 scope global eth0
       valid_lft forever preferred_lft forever
    inet 172.16.3.144/32 scope global eth0
       valid_lft forever preferred_lft forever
    inet6 fe80::250:56ff:fea3:d02e/64 scope link 
       valid_lft forever preferred_lft forever

[root@haproxy01 keepalived]# systemctl stop keepalived
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether 00:50:56:a3:d0:2e brd ff:ff:ff:ff:ff:ff
    inet 172.16.3.140/24 brd 172.16.3.255 scope global eth0
       valid_lft forever preferred_lft forever
    inet6 fe80::250:56ff:fea3:d02e/64 scope link 
       valid_lft forever preferred_lft forever

[root@haproxy02 keepalived]# ip a
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether 00:50:56:a3:fe:0a brd ff:ff:ff:ff:ff:ff
    inet 172.16.3.141/24 brd 172.16.3.255 scope global eth0
       valid_lft forever preferred_lft forever
    inet 172.16.3.144/32 scope global eth0
       valid_lft forever preferred_lft forever
    inet6 fe80::250:56ff:fea3:fe0a/64 scope link 
       valid_lft forever preferred_lft forever

haproxy安裝

mycat部署到節點

172.16.3.140 haproxy01
172.16.3.141 haproxy02

1.部署haproxy

https://www.cnblogs.com/zhangs1986/p/6517788.html

wget http://www.haproxy.org/download/1.7/src/haproxy-1.7.3.tar.gz
[root@haproxy01 haproxy-1.7.3]# uname -a
Linux haproxy01 3.10.0-229.el7.x86_64 #1 SMP Fri Mar 6 11:36:42 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux
make TARGET=linux3100 CPU=x86_64 PREFIX=/usr/local/haproxy-1.7.3
make install PREFIX=/usr/local/haproxy-1.7.3

2.配置haproxy

mkdir -p /usr/local/haproxy-1.7.3/conf

mkdir -p /etc/haproxy

2.3創建配置文件

touch /usr/local/haproxy-1.7.3/conf/haproxy.cfg

2.4添加配置文件軟連接

ln -s /usr/local/haproxy-1.7.3/conf/haproxy.cfg   /etc/haproxy/haproxy.cfg

2.5拷貝錯誤頁面

cp -r /root/haproxy-1.7.3/examples/errorfiles  /usr/local/haproxy-1.7.3/errorfiles

2.6添加軟連接

ln -s /usr/local/haproxy-1.7.3/errorfiles  /etc/haproxy/errorfiles

mkdir -p /usr/local/haproxy-1.7.3/log

2.8創建日志文件

touch /usr/local/haproxy-1.7.3/log/haproxy.log

2.9添加軟連接

ln -s /usr/local/haproxy-1.7.3/log/haproxy.log  /var/log/haproxy.log

2.10拷貝啟動文件

cp /root/haproxy-1.7.3/examples/haproxy.init  /etc/rc.d/init.d/haproxy

2.11添加腳本執行權限

chmod +x /etc/rc.d/init.d/haproxy

2.12設置開機啟動(6.x)

chkconfig haproxy on

2.13添加軟連接

ln -s /usr/local/haproxy-1.7.3/sbin/haproxy  /usr/sbin

3.配置參數

3.1haproxy.cfg

vi /usr/local/haproxy-1.7.3/conf/haproxy.cfg
global
    chroot  /usr/local/haproxy-1.7.3
    user   haproxy
    group   haproxy
    node haproxy01
    description haproxy01
 
defaults
listen admin_stats
    bind 0.0.0.0:8089
    stats enable
    mode http 
    log global 
    stats uri /stats  
    stats realm Haproxy\ Statistics  
    stats auth admin:admin  
    stats admin if TRUE
    stats refresh 30s
    option httplog
listen mycat_service
bind :3306
mode tcp
option tcplog  
option tcpka
balance roundrobin
server mycat01 172.16.3.142:8066 check port 48700 inter 2000ms weight 10 rise 2 fall 3
server mycat02 172.16.3.143:8066 check port 48700 inter 2000ms weight 10 rise 2 fall 3
listen mycat_admin
bind 0.0.0.0:9066
mode tcp
option tcplog 
option tcpka
balance roundrobin
server mycat01 172.16.3.142:9066 check port 48700 inter 2000ms weight 10 rise 2 fall 3
server mycat02 172.16.3.143:9066 check port 48700 inter 2000ms weight 10 rise 2 fall 3
 
errorfile 403 /etc/haproxy/errorfiles/403.http
errorfile 500 /etc/haproxy/errorfiles/500.http
errorfile 502 /etc/haproxy/errorfiles/502.http
errorfile 503 /etc/haproxy/errorfiles/503.http
errorfile 504 /etc/haproxy/errorfiles/504.http

3.1創建haproxy運行用戶

groupadd haproxy
useradd -g haproxy haproxy
chown -R haproxy:haproxy /usr/local/haproxy-1.7.3/

3.2配置rsyslog

/etc/rsyslog.conf
# 在 #### RULES #### 上面增加配置
$IncludeConfig /etc/rsyslog.d/*.conf

3.3配置haproxy日志

vi /etc/rsyslog.d/haproxy.conf
#增加下內容：
$ModLoad imudp 
$UDPServerRun 514 
local2.* /var/log/haproxy.log
& stop

3.4重啟rsyslog

systemctl restart rsyslog

3.5配置網絡IP轉發

vi /etc/sysctl.conf
net.ipv4.ip_forward = 1
sysctl -p
# echo "1" > /proc/sys/net/ipv4/ip_forward

3.6在mycat服務器上增加mycat檢查腳本

1)安裝xinetdyum install xinetd -y
2)/etc/xinetd.conf 最后增加includedir /etc/xinetd.d
3)增加端口服務

vi /etc/xinetd.d/mycat_status
service mycat_status
{
        flags = REUSE
        socket_type = stream
        port = 48700
        wait = no
        user = root
        server = /usr/local/mycat/bin/mycat_status
        log_on_failure += USERID
        disable = no
}

4)增加檢查腳本

vi /usr/local/mycat/bin/mycat_status
#!/bin/bash
#/usr/local/mycat/bin/mycat_status
# This script checks if a mycat server is healthy running on localhost. It will
# return:
#
# "HTTP/1.x 200 OK\r" (if mycat is running smoothly)
#
# "HTTP/1.x 503 Internal Server Error\r" (else)
mycat=`/usr/local/mycat/bin/mycat status | grep 'not running' | wc -l`
if [ "$mycat" = "0" ];
then
/bin/echo -e "HTTP/1.1 200 OK\r\n"
else
/bin/echo -e "HTTP/1.1 503 Service Unavailable\r\n"
fi

5)增加可執行權限chmod a+x /usr/local/mycat/bin/mycat_status
6)增加服務

vi /etc/services 
mycat_status    48700/tcp               # mycat_status

7)啟動網絡服務systemctl start xinetd
8)檢查端口狀態

[root@mycat01 bin]# netstat -ano|grep 487
tcp6       0      0 :::48700                :::*                    LISTEN      off (0.00/0/0)

https://blog.csdn.net/u012758088/article/details/78654628

centos7寫入開機啟動

https://blog.csdn.net/chenxiabinffff/article/details/51374635

3.7啟動haproxy

/etc/init.d/haproxy start

3.8啟動報錯

Mar 26 13:53:15 localhost haproxy[10067]: Server mycat_servers/mycat01 is DOWN, reason: Layer4 connection problem, info: "Connection refused", check duration: 0ms. 1 active and 0 backup servers left. 0 sessions active, 0 requeued, 0 remaining in queue.
Mar 26 13:53:15 haproxy01 haproxy: [  OK  ]
Mar 26 13:53:15 haproxy01 systemd: Started SYSV: HA-Proxy is a TCP/HTTP reverse proxy which is particularly suited for high availability environments..
Mar 26 13:53:16 localhost haproxy[10067]: Server mycat_servers/mycat02 is DOWN, reason: Layer4 connection problem, info: "Connection refused", check duration: 0ms. 0 active and 0 backup servers left. 0 sessions active, 0 requeued, 0 remaining in queue.
Mar 26 13:53:16 localhost haproxy[10067]: proxy mycat_servers has no server available!

因為haproxy.conf里面的48700並沒有在mycat服務器啟動
https://blog.csdn.net/u012758088/article/details/78654628

3.9登錄狀態頁查看狀態

http://172.16.3.140:8089/stats
http://172.16.3.141:8089/stats

參考：
http://www.roncoo.com/course/view/f614343765bc4aac8597c6d8b38f06fd
https://www.jianshu.com/p/f4b02609a500
https://www.cnblogs.com/hk315523748/p/6094656.html
https://www.cnblogs.com/fxwl/p/7990906.html

壓測

1.sysbench

sysbench --test=/usr/local/share/sysbench/tests/include/oltp_legacy/select.lua \
--oltp-table-size=20000 --mysql-table-engine=innodb --mysql-user=mycatdb --mysql-password=1234567 \
--mysql-port=3306 --mysql-host=172.16.3.144 --mysql-db=test --max-requests=0 --max-time=120 \
--oltp-tables-count=20 --report-interval=10 --num_threads=10 prepare

2.直接壓測mysql

sysbench --test=/usr/local/share/sysbench/tests/include/oltp_legacy/select.lua \
--oltp-table-size=20000 --mysql-table-engine=innodb --mysql-user=root --mysql-password=123456 \
--mysql-port=3306 --mysql-host=172.16.3.153 --mysql-db=test --max-requests=0 --max-time=120 \
--oltp-tables-count=20 --report-interval=10 --num_threads=10 run

SQL statistics:
    queries performed:
        read:                            2171226
        write:                           0
        other:                           0
        total:                           2171226
    transactions:                        2171226 (18092.46 per sec.)
    queries:                             2171226 (18092.46 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

3.壓測haproxy VIP

sysbench --test=/usr/local/share/sysbench/tests/include/oltp_legacy/select.lua \
--oltp-table-size=20000 --mysql-table-engine=innodb --mysql-user=mycatdb --mysql-password=1234567 \
--mysql-port=3306 --mysql-host=172.16.3.144 --mysql-db=test --max-requests=0 --max-time=120 \
--oltp-tables-count=20 --report-interval=10 --num_threads=10 run
# 壓測haproxy的QPS/TPS比直接壓測mysql更低？？！！差了將近4倍
SQL statistics:
    queries performed:
        read:                            498794
        write:                           0
        other:                           0
        total:                           498794
    transactions:                        498794 (4156.37 per sec.)
    queries:                             498794 (4156.37 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

4壓測mycat IP

sysbench --test=/usr/local/share/sysbench/tests/include/oltp_legacy/select.lua \
--oltp-table-size=20000 --mysql-table-engine=innodb --mysql-user=mycatdb --mysql-password=1234567 \
--mysql-port=8066 --mysql-host=172.16.3.143 --mysql-db=test --max-requests=0 --max-time=120 \
--oltp-tables-count=20 --report-interval=10 --num_threads=10 run
# 基本只有haproxy的一半
SQL statistics:
    queries performed:
        read:                            233707
        write:                           0
        other:                           0
        total:                           233707
    transactions:                        233707 (1947.43 per sec.)
    queries:                             233707 (1947.43 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

https://my.oschina.net/shyloveliyi/blog/725810
http://blog.51cto.com/arthur376/2045596

不重啟mycat加載配置

更改server的配置可以Mysql>reload @@config
如果改了schema的配置,需要這個命令Mysql>reload @@config_all

使用0.5的sysbench

https://github.com/akopytov/sysbench/tree/0.5

再增加一個mycat，壓測haproxy VIP

OLTP test statistics:
    queries performed:
        read:                            658118
        write:                           0
        other:                           0
        total:                           658118
    transactions:                        0      (0.00 per sec.)
    read/write requests:                 658118 (5484.25 per sec.)
    other operations:                    0      (0.00 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

僅僅增加15W多QPS

https://blog.csdn.net/zhxdick/article/details/50813081
http://blog.51cto.com/arthur376/2045596

免責聲明！

本站轉載的文章為個人學習借鑒使用，本站對版權不負任何法律責任。如果侵犯了您的隱私權益，請聯系本站郵箱yoyou2525@163.com刪除。

猜您在找 mysql高可用架構之MHA，haproxy實現讀寫分離詳解 mysql MHA高可用+讀寫分離應用集成mycat，實現mycat的高可用與mysql的讀寫分離 MySQL 之 MHA + ProxySQL + keepalived 實現讀寫分離，高可用（二） MHA + proxysql 高可用以及讀寫分離 MHA高可用架構與Atlas讀寫分離【DB寶42】MySQL高可用架構MHA+ProxySQL實現讀寫分離和負載均衡 MHA+ProxySQL實現讀寫分離高可用 MHA + Maxscale 數據庫的高可用和讀寫分離 mysql+mycat搭建穩定高可用集群，負載均衡，主備復制，讀寫分離

haproxy mycat mysql 讀寫分離MHA高可用

主機IP信息

mycat安裝

1.部署mycat

1.1解壓復制到/usr/local/mycat

1.2安裝jdk

2.配置mycat server.xml

3.配置mycat schema

4.啟動mycat./mycat start

5.檢查端口

6.登錄讀寫分離服務8066

7.登錄mycat管理端9066

8.mycat讀寫分離驗證

keepalived安裝

1.下載解壓編譯安裝

2.拷貝文件

3.增加配置/etc/keepalived/keepalived.conf

4.檢查腳本

5.授權檢查腳本chmod +x /etc/keepalived/haproxy_check.sh

6.在2個節點上啟動keepalivedsystemctl start keepalived

7.切換VIP測試

haproxy安裝

1.部署haproxy

2.配置haproxy

3.配置參數

3.1haproxy.cfg

3.1創建haproxy運行用戶

3.2配置rsyslog

3.3配置haproxy日志

3.4重啟rsyslog

3.5配置網絡IP轉發

3.6在mycat服務器上增加mycat檢查腳本

3.7啟動haproxy

3.8啟動報錯

3.9登錄狀態頁查看狀態

壓測

1.sysbench

2.直接壓測mysql

3.壓測haproxy VIP

4壓測mycat IP

不重啟mycat加載配置

使用0.5的sysbench

再增加一個mycat，壓測haproxy VIP

免責聲明！

1.1解壓復制到`/usr/local/mycat`

4.啟動mycat`./mycat start`

3.增加配置`/etc/keepalived/keepalived.conf`

5.授權檢查腳本`chmod +x /etc/keepalived/haproxy_check.sh`

6.在2個節點上啟動keepalived`systemctl start keepalived`