使用Prometheus和Grafana监控Mysql服务器性能

这是一篇快速入门文章，介绍了如何使用Prometheus和Grafana对Mysql服务器性能进行监控。内容基于这篇文章，结合了自己的实际实践并根据最新版本的应用进行了调整。下面是两张效果图：

概述

Prometheus是一个开源的服务监控系统，它通过HTTP协议从远程的机器收集数据并存储在本地的时序数据库上。它提供了一个简单的网页界面、一个功能强大的查询语言以及HTTP接口等等。Prometheus通过安装在远程机器上的exporter来收集监控数据，我们用到了以下两个exporter：

node_exporter – 用于机器系统数据
mysqld_exporter – 用于Mysql服务器数据

Grafana是一个开源的功能丰富的数据可视化平台，通常用于时序数据的可视化。它内置了以下数据源的支持：

并可以通过插件扩展支持的数据源。

架构图

下面是我们安装时用到的架构图：

安装和运行Prometheus

首先我们安装Prometheus：

$ wget https://github.com/prometheus/prometheus/releases/download/v1.1.3/prometheus-1.1.3.linux-amd64.tar.gz -O prometheus-1.1.3.linux-amd64.tar.gz $ mkdir /usr/local/services/prometheus $ tar zxf prometheus-1.1.3.linux-amd64.tar.gz -C /usr/local/services/prometheus --strip-components=1

然后在安装目下编辑配置文件 prometheus.yml：

global: scrape_interval: 15s evaluation_interval: 15s scrape_configs: - job_name: linux static_configs: - targets: ['192.168.204.63:9100'] labels: instance: db1 - job_name: mysql static_configs: - targets: ['192.168.204.63:9104'] labels: instance: db1

192.168.204.63是我们数据库主机的IP，端口则是对应的exporter的监听端口。

然后我们启动Prometheus：

$ ./prometheus       
INFO[0000] Starting prometheus (version=1.1.3, branch=master, revision=ac374aa6748e1382dbeb72a00abf47d982ee8fff) source=main.go:73 INFO[0000] Build context (go=go1.6.3, user=root@3e392b8b8b44, date=20160916-11:36:30) source=main.go:74 INFO[0000] Loading configuration file prometheus.yml source=main.go:221 INFO[0000] Loading series map and head chunks... source=storage.go:358 INFO[0000] 4 series loaded. source=storage.go:363 INFO[0000] Starting target manager... source=targetmanager.go:76 WARN[0000] No AlertManagers configured, not dispatching any alerts source=notifier.go:176 INFO[0000] Listening on :9090 source=web.go:235

Prometheus内置了一个web界面，我们可通过http://monitor_host:9090进行访问：

在Status->Targets页面下，我们可以看到我们配置的两个Target，它们的State为DOWN。

下一步我们需要安装并运行exporter。下载exporters并解压：

$ wget https://github.com/prometheus/node_exporter/releases/download/0.12.0/node_exporter-0.12.0.linux-amd64.tar.gz -O node_exporter-0.12.0.linux-amd64.tar.gz $ wget https://github.com/prometheus/mysqld_exporter/releases/download/v0.9.0/mysqld_exporter-0.9.0.linux-amd64.tar.gz -O mysqld_exporter-0.9.0.linux-amd64.tar.gz $ mkdir /usr/local/services/prometheus_exporters $ tar zxf node_exporter-0.12.0.linux-amd64.tar.gz -C /usr/local/services/prometheus_exporters --strip-components=1 $ tar zxf mysqld_exporter-0.9.0.linux-amd64.tar.gz -C /usr/local/services/prometheus_exporters --strip-components=1

运行node_exporter ：

$ cd /usr/local/services/prometheus_exporters $ ./node_exporter INFO[0000] Starting node_exporter (version=0.12.0, branch=master, revision=df8dcd2) source=node_exporter.go:135 INFO[0000] Build context (go=go1.6.2, user=root@ff68505a5469, date=20160505-22:14:18) source=node_exporter.go:136 INFO[0000] No directory specified, see --collector.textfile.directory source=textfile.go:57 INFO[0000] Enabled collectors: source=node_exporter.go:155 INFO[0000] - vmstat source=node_exporter.go:157 INFO[0000] - conntrack source=node_exporter.go:157 INFO[0000] - filesystem source=node_exporter.go:157 INFO[0000] - meminfo source=node_exporter.go:157 INFO[0000] - netdev source=node_exporter.go:157 INFO[0000] - stat source=node_exporter.go:157 INFO[0000] - entropy source=node_exporter.go:157 INFO[0000] - mdadm source=node_exporter.go:157 INFO[0000] - sockstat source=node_exporter.go:157 INFO[0000] - time source=node_exporter.go:157 INFO[0000] - uname source=node_exporter.go:157 INFO[0000] - diskstats source=node_exporter.go:157 INFO[0000] - filefd source=node_exporter.go:157 INFO[0000] - loadavg source=node_exporter.go:157 INFO[0000] - netstat source=node_exporter.go:157 INFO[0000] - textfile source=node_exporter.go:157 INFO[0000] Listening on :9100 source=node_exporter.go:176

mysqld_exporter需要连接到Mysql，所以需要Mysql的权限，我们先为它创建用户并赋予所需的权限：

mysql> GRANT REPLICATION CLIENT, PROCESS ON *.* TO 'prom'@'localhost' identified by 'abc123'; mysql> GRANT SELECT ON performance_schema.* TO 'prom'@'localhost';

创建.my.cnf文件并运行mysqld_exporter：

$ cd /usr/local/services/prometheus_exporters $ cat << EOF > .my.cnf [client] user=prom password=abc123 EOF $ ./mysqld_exporter -config.my-cnf=".my.cnf" INFO[0000] Starting mysqld_exporter (version=0.9.0, branch=master, revision=8400af20ccdbf6b5e0faa2c925c56c48cd78d70b) source=mysqld_exporter.go:432 INFO[0000] Build context (go=go1.6.3, user=root@2c131c66ca20, date=20160926-18:28:09) source=mysqld_exporter.go:433 INFO[0000] Listening on :9104 source=mysqld_exporter.go:451

我们再次回到Status->Targets页面，可以看到两个Target的状态已经变成UP了：

安装和运行Grafana

下载并解压Grafana：

$ wget https://grafanarel.s3.amazonaws.com/builds/grafana-3.1.1-1470047149.linux-x64.tar.gz $ mkdir /usr/local/services/grafana $ tar zxvf grafana-3.1.1-1470047149.linux-x64.tar.gz -C /usr/local/services/grafana --strip-components=1

编辑配置文件/usr/local/services/grafana/conf/defaults.ini，修改dashboards.json段落下两个参数的值：

[dashboards.json] enabled = true path = /var/lib/grafana/dashboards

安装仪表盘:

$ git clone https://github.com/percona/grafana-dashboards.git $ cp -r grafana-dashboards/dashboards /var/lib/grafana

运行以下命令为Grafana打个补丁，不然图表不能正常显示：

$ sed -i 's/expr=\(.\)\.replace(\(.\)\.expr,\(.\)\.scopedVars\(.*\)var \(.\)=\(.\)\.interval/expr=\1.replace(\2.expr,\3.scopedVars\4var \5=\1.replace(\6.interval, \3.scopedVars)/' /usr/local/services/grafana/public/app/plugins/datasource/prometheus/datasource.js $ sed -i 's/,range_input/.replace(\/"{\/g,"\\"").replace(\/}"\/g,"\\""),range_input/; s/step_input:""/step_input:this.target.step/' /usr/local/services/grafana/public/app/plugins/datasource/prometheus/query_ctrl.js

最后我们运行Grafana服务：

$ cd /usr/local/services/grafana/bin/ $ ./grafana-server INFO[09-28|12:23:33] Starting Grafana logger=main version=3.1.1 commit=a4d2708 compiled=2016-08-01T18:20:16+0800 INFO[09-28|12:23:33] Config loaded from logger=settings file=/usr/local/services/grafana/conf/defaults.ini INFO[09-28|12:23:33] Path Home logger=settings path=/usr/local/services/grafana INFO[09-28|12:23:33] Path Data logger=settings path=/usr/local/services/grafana/data INFO[09-28|12:23:33] Path Logs logger=settings path=/usr/local/services/grafana/data/log INFO[09-28|12:23:33] Path Plugins logger=settings path=data/plugins INFO[09-28|12:23:33] Initializing DB logger=sqlstore dbtype=mysql INFO[09-28|12:23:33] Starting DB migration logger=migrator INFO[09-28|12:23:33] Creating json dashboard index for path: [/var/lib/grafana/dashboards] INFO[09-28|12:23:33] Starting plugin search logger=plugins INFO[09-28|12:23:33] Server Listening logger=server address=0.0.0.0:3000 protocol=http subUrl=

我们可通过http://monitor_host:3000访问Grafana网页界面（缺省的帐号/密码为admin/admin）：

然后我们到Data Sources页面添加数据源：

最后我们就可以通过选择不同的仪表盘（左上角）和时间段（右上角）来呈现图表了：

参考资料

https://prometheus.io/
http://grafana.org/
https://github.com/percona/gr...
https://www.percona.com/blog/...

使用Prometheus和Grafana监控Mysql服务器性能

概述

架构图

安装和运行Prometheus

安装和运行Grafana

参考资料

免责声明！