Linux服務器收集到的慢日志文件拿到本地(Windows7)的虛擬機(CentOS6.5)中去分析。首先使用Samba工具配置CentOS和Windows文件共享，然后使用mysqlsla分析慢查詢日志。
環境：CentOS6.5源碼安裝多個MySQL實例及復制搭建
一、CentOS和Windows文件共享
1.1、安裝Samba
[root@VMUest ~]# yum install samba samba-client samba-swat [root@VMUest ~]# rpm -qa |grep samba [root@VMUest ~]# service smb start
1.2、修改配置文件
#備份原始配置文件 [root@VMUest ~]# cp /etc/samba/smb.conf /etc/samba/smb.conf.`date +%Y%m%d.%H%M%S` #配置文件添加 [root@VMUest ~]# vim /etc/samba/smb.conf #============================ Share Definitions ============================== [myshare] comment = myshare files path = /myshare public = yes writable = yes
1.3、創建共享目錄分配權限
#創建共享目錄分配權限 [root@VMUest ~]# mkdir /myshare [root@VMUest ~]# cd myshare/ [root@VMUest myshare]# touch samba.txt [root@VMUest myshare]# ll total 0 -rw-r--r--. 1 root root 0 Mar 29 15:22 samba.txt [root@VMUest myshare]# chown -R nobody:nobody /myshare/ [root@VMUest myshare]# ll total 0 -rw-r--r--. 1 nobody nobody 0 Mar 29 15:22 samba.txt
由於我的--Standalone Server Options--沒有設置成security = share，需配置Samba用戶
#配置Samba用戶 [root@VMUest myshare]# smbpasswd -a root New SMB password: Retype new SMB password: Added user root. [root@VMUest myshare]# service smb restart [root@VMUest myshare]# testparm
1.4、防火牆
#暫時停掉SELinux [root@VMUest myshare]# setenforce 0 [root@VMUest myshare]# getenforce #防火牆 [root@VMUest myshare]# netstat -apn |grep smb [root@VMUest myshare]# iptables -I INPUT -p tcp --dport 139 -j ACCEPT [root@VMUest myshare]# service iptables save [root@VMUest myshare]# service iptables restart [root@VMUest myshare]# iptables -L -n [root@VMUest myshare]# cat /etc/sysconfig/iptables
Windows 我的電腦->地址欄中輸入 \\192.168.85.129 (我的虛擬機IP)。如果報錯"不允許一個用戶使用一個以上用戶名與服務器或共享資源的多重連接..."，使用 net use * /del /y 命令刪除之前的連接。這樣就可以在Windows下訪問Linux共享的文件(夾)，並且可以將Windows下的文件拷貝到共享文件夾中
另外也可以修改/etc/samba/smb.conf的兩處地方，將setsebool -P samba_enable_home_dirs on打開，將homes模塊下valid users =%s語句前面的";"去掉。
二、mysqlsla
Hack MySQL has been retired.The tools are archived at https://github.com/daniel-nichter/hackmysql.com.These are retired, deprecated tools from HackMySQL.com. Do not use these tools. They are not supported. Use Percona Toolkit instead.推薦使用 Percona Toolkit代替。
2.1、下載
#下載mysqlsla [root@VMUest ~]# cd /tools [root@VMUest tools]# git clone https://github.com/daniel-nichter/hackmysql.com.git #拷貝文件夾 [root@VMUest tools]# cp -Rf /tools/hackmysql.com/mysqlsla /tools/
2.2、配置編譯安裝
#編譯安裝(中間反復報錯，逐個安裝所需文件) [root@VMUest tools]# cd mysqlsla/ [root@VMUest mysqlsla]# perl Makefile.PL Can not locate ExtUtils/MakeMaker.pm in @INC (@INC contains: /usr/local/lib/perl5 /usr/local/share/perl5 /usr/lib/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib/perl5 /usr/share/perl5 .) at Makefile.PL line 2. BEGIN failed--compilation aborted at Makefile.PL line 2. [root@VMUest mysqlsla]# #安裝perl-ExtUtils-CBuilder時會同時安裝其依賴文件perl-ExtUtils-MakeMaker，remove時並不會移除其依賴的文件 [root@VMUest mysqlsla]# yum install perl-ExtUtils-CBuilder perl-ExtUtils-MakeMaker [root@VMUest mysqlsla]# perl Makefile.PL Checking if your kit is complete... Looks good Writing Makefile for mysqlsla [root@VMUest mysqlsla]# make && make install cp lib/mysqlsla.pm blib/lib/mysqlsla.pm cp bin/mysqlsla blib/script/mysqlsla /usr/bin/perl -MExtUtils::MY -e 'MY->fixin(shift)' -- blib/script/mysqlsla Manifying blib/man3/mysqlsla.3pm Appending installation info to /usr/lib/perl5/perllocal.pod [root@VMUest mysqlsla]# [root@VMUest mysqlsla]# mysqlsla --help Can not locate Time/HiRes.pm in @INC (@INC contains: /usr/local/lib/perl5 /usr/local/share/perl5 /usr/lib/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib/perl5 /usr/share/perl5 .) at /usr/local/bin/mysqlsla line 2095. BEGIN failed--compilation aborted at /usr/local/bin/mysqlsla line 2095. [root@VMUest mysqlsla]# #安裝perl-Time-HiRes [root@VMUest mysqlsla]# yum install perl-Time-HiRes [root@VMUest mysqlsla]# mysqlsla --help Can nott locate DBI.pm in @INC (@INC contains: /usr/local/lib/perl5 /usr/local/share/perl5 /usr/lib/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib/perl5 /usr/share/perl5 .) at /usr/local/bin/mysqlsla line 2098. BEGIN failed--compilation aborted at /usr/local/bin/mysqlsla line 2098. [root@VMUest mysqlsla]# #安裝perl-DBI [root@VMUest mysqlsla]# yum install perl-DBI [root@VMUest mysqlsla]# mysqlsla --help man mysqlsla for help or visit http://hackmysql.com/mysqlsla #本次安裝的所有文件 [root@VMUest mysqlsla]# yum list perl-ExtUtils-CBuilder perl-ExtUtils-MakeMaker perl-Time-HiRes perl-DBI
到此說明mysqlsla安裝完成並能正常使用
2.3、使用
#執行時間最長的20條sql語句(默認按時長) [root@VMUest mysqlsla]# mysqlsla -lt slow --sort t_sum --top 20 /myshare/118mysqldumpslow-20161227.log #統計慢查詢文件中所有select的慢查詢sql，並顯示執行時間最長的20條sql語句 [root@VMUest mysqlsla]# mysqlsla -lt slow -sf "+select" -top 20 /myshare/118mysqldumpslow-20161227.log #統計慢查詢文件中的數據庫為ZiPai的所有select和update的慢查詢sql，並查詢次數最多的20條sql語句，並寫到sql_num.log中 [root@VMUest mysqlsla]# mysqlsla -lt slow -sf "+select,update" -top 20 -sort c_sum -db ZiPai /myshare/118mysqldumpslow-20161227.log >/tmp/sql_num.log
對比下mysqlsla和mysqldumpslow的返回結果
[root@VMUest mysqlsla]# mysqlsla -lt slow --sort c_sum --top 3 /myshare/118mysqldumpslow-20161227.log Report for slow logs: /myshare/118mysqldumpslow-20161227.log 30.88k queries total, 303 unique Sorted by 'c_sum' Grand Totals: Time 4.15k s, Lock 11 s, Rows sent 23.70M, Rows Examined 4.82G ______________________________________________________________________ 001 ___ Count : 4.29k (13.88%) Time : 1.161066 s total, 271 vg, 116 o 21.539 ms max (0.03%) 95% of Time : 1.006049 s total, 247 vg, 116 o 426 ax Lock Time (s) : 158.546 ms total, 37 vg, 15 o 20.339 ms max (1.45%) 95% of Lock : 108.351 ms total, 27 vg, 15 o 57 ax Rows sent : 9 avg, 0 to 10 max (0.16%) Rows examined : 59 avg, 10 to 99 max (0.01%) Database : Users : root@ 192.168.80.225 : 53.30% (2284) of query, 29.80% (9204) of all users root@ 192.168.80.223 : 46.70% (2001) of query, 28.95% (8940) of all users Query abstract: SET timestamp=N; SELECT * FROM goods LIMIT N,N; Query sample: SET timestamp=1482746012; select * from Goods limit 0,10; ______________________________________________________________________ 002 ___ Count : 4.24k (13.73%) Time : 2964.21 s total, 698.941 ms avg, 628.36 ms to 1.116798 s max (71.50%) 95% of Time : 2768.061991 s total, 687.205 ms avg, 628.36 ms to 862.66 ms max Lock Time (s) : 146.727 ms total, 35 vg, 17 o 537 ax (1.35%) 95% of Lock : 120.535 ms total, 30 vg, 17 o 68 ax Rows sent : 0 avg, 0 to 88 max (0.01%) Rows examined : 514.07k avg, 512.57k to 515.57k max (45.22%) Database : Zipai Users : root@ 192.168.80.223 : 51.76% (2195) of query, 28.95% (8940) of all users root@ 192.168.80.225 : 48.24% (2046) of query, 29.80% (9204) of all users Query abstract: SET timestamp=N; SELECT * FROM user WHERE nickname='S'; Query sample: SET timestamp=1482745880; select * from User where nickName='鴻運當頭'; ______________________________________________________________________ 003 ___ Count : 3.37k (10.91%) Time : 3.290222 s total, 976 vg, 76 o 4.719 ms max (0.08%) 95% of Time : 2.857869 s total, 893 vg, 76 o 2.265 ms max Lock Time (s) : 103.824 ms total, 31 vg, 16 o 2.682 ms max (0.95%) 95% of Lock : 83.589 ms total, 26 vg, 16 o 52 ax Rows sent : 21 avg, 6 to 100 max (0.30%) Rows examined : 1.71k avg, 6 to 4.64k max (0.12%) Database : Zipai Users : root@ 192.168.80.225 : 50.80% (1712) of query, 29.80% (9204) of all users root@ 192.168.80.223 : 49.20% (1658) of query, 28.95% (8940) of all users Query abstract: SET timestamp=N; SELECT * FROM ai LIMIT N,N; Query sample: SET timestamp=1482745934; select * from AI limit 0,6;
[root@VMUest mysqlsla]# mysqldumpslow -s c -t 3 /myshare/118mysqldumpslow-20161227.log Reading mysql slow query log from /myshare/118mysqldumpslow-20161227.log Count: 4285 Time=0.00s (0s) Lock=0.00s (0s) Rows=0.0 (0), root[root]@2hosts select * from Goods limit N,N Count: 4241 Time=0.00s (0s) Lock=0.00s (0s) Rows=0.0 (0), root[root]@2hosts select * from User where nickName='S' Count: 3370 Time=0.00s (0s) Lock=0.00s (0s) Rows=0.0 (0), root[root]@2hosts select * from AI limit N,N
通過對比可以看出mysqlsla返回的信息比較全面，包括平均執行時間、等待鎖時間、結果行的總數、掃描的行總數、樣例語句等。mysqldumpslow由於版本問題Time、Lock、Rows全為0，可以參考之前在Windows下分析慢查詢日志的文章：MySQL慢查詢日志
mysqlsla輸出格式說明如下
#mysqlsla輸出格式說明: queries total: 總查詢次數,unique: 去重后的sql數量 Sorted by: 輸出報表的內容排序 Count : sql的執行次數及占總的slow log數量的百分比 Time : 執行時間, 包括總時間, 平均時間, 最小, 最大時間, 時間占到總慢sql時間的百分比 95% of Time : 去除最快和最慢的sql, 覆蓋率占95%的sql的執行時間 Lock Time : 等待鎖的時間 95% of Lock : 95%的慢sql等待鎖時間 Rows sent : 結果行統計數量, 包括平均, 最小, 最大數量 Rows examined : 掃描的行數量 Database : 屬於哪個數據庫 Users : 哪個用戶,IP,占到所有用戶執行的sql百分比 Query abstract: 抽象后的sql語句 Query sample : sql樣例語句
總結：具體環境具體分析，依賴文件根據需求去安裝。