一、information_schema簡介
在MySQL中,把 information_schema 看作是一個數據庫,確切說是信息數據庫。其中保存着關於MySQL服務器所維護的所有其他數據庫的信息。如數據庫名,數據庫的表,表欄的數據類型與訪問權 限等。在INFORMATION_SCHEMA中,有數個只讀表。它們實際上是視圖,而不是基本表,因此,你將無法看到與之相關的任何文件。
information_schema數據庫表說明:
1 1、SCHEMATA表:提供了當前mysql實例中所有數據庫的信息。是show databases的結果取之此表。 2 3 2、TABLES表:提供了關於數據庫中的表的信息(包括視圖)。詳細表述了某個表屬於哪個schema,表類型,表引擎,創建時間等信息。是show tables from schemaname的結果取之此表。 4 5 3、COLUMNS表:提供了表中的列信息。詳細表述了某張表的所有列以及每個列的信息。是show columns from schemaname.tablename的結果取之此表。 6 7 4、STATISTICS表:提供了關於表索引的信息。是show index from schemaname.tablename的結果取之此表。 8 9 5、USER_PRIVILEGES(用戶權限)表:給出了關於全程權限的信息。該信息源自mysql.user授權表。是非標准表。 10 11 6、SCHEMA_PRIVILEGES(方案權限)表:給出了關於方案(數據庫)權限的信息。該信息來自mysql.db授權表。是非標准表。 12 13 7、TABLE_PRIVILEGES(表權限)表:給出了關於表權限的信息。該信息源自mysql.tables_priv授權表。是非標准表。 14 15 8、COLUMN_PRIVILEGES(列權限)表:給出了關於列權限的信息。該信息源自mysql.columns_priv授權表。是非標准表。 16 17 9、CHARACTER_SETS(字符集)表:提供了mysql實例可用字符集的信息。是SHOW CHARACTER SET結果集取之此表。 18 19 10、COLLATIONS表:提供了關於各字符集的對照信息。 20 21 11、COLLATION_CHARACTER_SET_APPLICABILITY表:指明了可用於校對的字符集。這些列等效於SHOW COLLATION的前兩個顯示字段。 22 23 12、TABLE_CONSTRAINTS表:描述了存在約束的表。以及表的約束類型。 24 25 13、KEY_COLUMN_USAGE表:描述了具有約束的鍵列。 26 27 14、ROUTINES表:提供了關於存儲子程序(存儲程序和函數)的信息。此時,ROUTINES表不包含自定義函數(UDF)。名為“mysql.proc name”的列指明了對應於INFORMATION_SCHEMA.ROUTINES表的mysql.proc表列。 28 29 15、VIEWS表:給出了關於數據庫中的視圖的信息。需要有show views權限,否則無法查看視圖信息。 30 31 16、TRIGGERS表:提供了關於觸發程序的信息。必須有super權限才能查看該表
查看引擎
information_schema.ENGINS 對應於 show engines;
查看數據庫
information_schema.SCHEMATA 對應於 show databases;
查看表
information_schema.TABLES 對應於 show tables;
查看列
information_schema.COLUMNS 對應於show columns from table_name
查看索引
information_schema.STATISTICS 對應於show index from table_name
查看線程
information_schema.PROCESSLIST 對應於 show processlist
二.MySQL 庫表簡介
在mysql數據庫中,有mysql_install_db腳本初始化權限表,存儲權限的表有: 1、user表: 用戶列、權限列、安全列、資源控制列 2、db表 : 用戶列、權限列 3、host表 4、table_priv表 5、columns_priv表 6、proc_priv表
三.sys庫表簡介
sys_config : 這是在這個系統庫上存在的唯一一個表了, 表結構如下: CREATE TABLE `sys_config` ( `variable` varchar(128) NOT NULL, `value` varchar(128) DEFAULT NULL, `set_time` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP, `set_by` varchar(128) DEFAULT NULL, PRIMARY KEY (`variable`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8 • variable : 配置選項名稱 • value : 配置選項值 • set_time: 該行配置修改的時間 • set_by : 該行配置信息修改者,如果從被安裝沒有修改過,那么這個數據應該為NULL 這里寫圖片描述 以上值的會話變量為@sys.+表中variable字段,譬如:@sys.statement_truncate_len 可以set @sys.statement_truncate_len = 32 臨時改變值,在會話中會一直使用這個值,如果想要恢復使用表的默認值,只需要將這個會話值設置為null;set @sys.statement_truncate_len = null; • diagnostics.allow_i_s_tables : 默認為OFF ,如果開啟表示允許diagnostics() 存儲過程執行掃描information_schema.tables 表,如果表很多,那么可能會很耗性能, • diagnostics.include_raw : 默認為OFF , 開啟將會從metrics 視圖輸出未加工處理的數據 。 • statement_performance_analyzer.limit : 視圖在沒有加limit限制時,返回的最大行數 • statement_performance_analyzer.view • statement_truncate_len : 通過format_statement()函數返回值的最大長度 這個表非默認選項還有一個@sys.debug參數 , 可以手動加入: INSERT INTO sys_config (variable, value) VALUES('debug', 'ON'); UPDATE sys_config SET value = 'OFF' WHERE variable = 'debug'; SET @sys.debug = NULL;
四.performance_schema庫表簡介
1 performance_schema是運行在較低級別的用於監控MySQL Server運行過程中的資源消耗、資源等待等情況的一個功能特性,也是一個存儲引擎。該特性具有以下特點。 2 3 提供了一種在數據庫運行時實時檢查Server內部執行情況的方法 4 可監控任何事情以及對應的時間消耗,利用這些信息來判斷Server中的相關資源消耗 5 只被記錄在本地Server的performance_schema中,其表中數據發生變化時不會被寫入binlog中,也不會通過復制機制被復制到其他Server中 6 對於這些表可使用SELECT語句查詢,也可以使用SQL語句更新performance_schema數據庫中的表記錄,但不建議更新,會影響后續的數據收集 7 表中數據不會持久化存儲在磁盤中,而是保存在內存中,一旦服務器重啟,這些數據就會丟失 8 不會導致server的行為發生變化(查詢,優化等) 9 總體上開銷有限也不會影響性能 10 對某事件監測失敗,不影響server正常運行 11 當針對一個數據,同時被performance_schema收集和查詢,則收集優先與查詢 12 事件監測點可進行配置
- 查看是否當前數據庫是否支持
mysql> sho engines; ERROR 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'sho engines' at line 1 mysql> show engines; +--------------------+---------+----------------------------------------------------------------+--------------+------+------------+ | Engine | Support | Comment | Transactions | XA | Savepoints | +--------------------+---------+----------------------------------------------------------------+--------------+------+------------+ | FEDERATED | NO | Federated MySQL storage engine | NULL | NULL | NULL | | MEMORY | YES | Hash based, stored in memory, useful for temporary tables | NO | NO | NO | | InnoDB | DEFAULT | Supports transactions, row-level locking, and foreign keys | YES | YES | YES | | PERFORMANCE_SCHEMA | YES | Performance Schema | NO | NO | NO | | MyISAM | YES | MyISAM storage engine | NO | NO | NO | | MRG_MYISAM | YES | Collection of identical MyISAM tables | NO | NO | NO | | BLACKHOLE | YES | /dev/null storage engine (anything you write to it disappears) | NO | NO | NO | | CSV | YES | CSV storage engine | NO | NO | NO | | ARCHIVE | YES | Archive storage engine | NO | NO | NO | +--------------------+---------+----------------------------------------------------------------+--------------+------+------------+ 9 rows in set (0.00 sec)
Support 為YES 表示支持 - 查看該特性是否使能
-
1 mysql> show variables like 'performance_schema'; 2 +--------------------+-------+ 3 | Variable_name | Value | 4 +--------------------+-------+ 5 | performance_schema | ON | 6 +--------------------+-------+ 7 1 row in set (0.00 sec)
如果為off則表示未使能。該參數為只讀參數,則可在mysql.cnf中進行配置后重啟服務使用該引擎的這些表的分類
-
1)語句事件記錄表 mysql> show tables like 'events_statement%'; +----------------------------------------------------+ | Tables_in_performance_schema (events_statement%) | +----------------------------------------------------+ | events_statements_current | //當前語句事件表 | events_statements_histogram_by_digest | //歷史語句事件表 | events_statements_histogram_global | | events_statements_history | | events_statements_history_long | //長語句歷史事件表 | events_statements_summary_by_account_by_event_name | //聚合后的摘要表 | events_statements_summary_by_digest | | events_statements_summary_by_host_by_event_name | | events_statements_summary_by_program | | events_statements_summary_by_thread_by_event_name | | events_statements_summary_by_user_by_event_name | | events_statements_summary_global_by_event_name | +----------------------------------------------------+ 12 rows in set (0.00 sec) 2)等待時間記錄表 mysql> show tables like 'events_wait%'; +-----------------------------------------------+ | Tables_in_performance_schema (events_wait%) | +-----------------------------------------------+ | events_waits_current | | events_waits_history | | events_waits_history_long | | events_waits_summary_by_account_by_event_name | | events_waits_summary_by_host_by_event_name | | events_waits_summary_by_instance | | events_waits_summary_by_thread_by_event_name | | events_waits_summary_by_user_by_event_name | | events_waits_summary_global_by_event_name | +-----------------------------------------------+ 9 rows in set (0.00 sec) 3)階段事件記錄表 mysql> show tables like 'events_stage%'; +------------------------------------------------+ | Tables_in_performance_schema (events_stage%) | +------------------------------------------------+ | events_stages_current | | events_stages_history | | events_stages_history_long | | events_stages_summary_by_account_by_event_name | | events_stages_summary_by_host_by_event_name | | events_stages_summary_by_thread_by_event_name | | events_stages_summary_by_user_by_event_name | | events_stages_summary_global_by_event_name | +------------------------------------------------+ 8 rows in set (0.00 sec) 4)事務事件記錄表 mysql> show tables like 'events_transaction%'; +------------------------------------------------------+ | Tables_in_performance_schema (events_transaction%) | +------------------------------------------------------+ | events_transactions_current | | events_transactions_history | | events_transactions_history_long | | events_transactions_summary_by_account_by_event_name | | events_transactions_summary_by_host_by_event_name | | events_transactions_summary_by_thread_by_event_name | | events_transactions_summary_by_user_by_event_name | | events_transactions_summary_global_by_event_name | +------------------------------------------------------+ 8 rows in set (0.00 sec) 5)監控文件系統層調用的表 mysql> show tables like '%file%'; +---------------------------------------+ | Tables_in_performance_schema (%file%) | +---------------------------------------+ | file_instances | | file_summary_by_event_name | | file_summary_by_instance | +---------------------------------------+ 3 rows in set (0.00 sec) 6)監視內存使用的表 mysql> show tables like '%memory%'; +-----------------------------------------+ | Tables_in_performance_schema (%memory%) | +-----------------------------------------+ | memory_summary_by_account_by_event_name | | memory_summary_by_host_by_event_name | | memory_summary_by_thread_by_event_name | | memory_summary_by_user_by_event_name | | memory_summary_global_by_event_name | +-----------------------------------------+ 5 rows in set (0.00 sec) 7)動態對performance_schema進行配置的配置表 mysql> show tables like '%setup%'; +----------------------------------------+ | Tables_in_performance_schema (%setup%) | +----------------------------------------+ | setup_actors | | setup_consumers | | setup_instruments | | setup_objects | | setup_threads | +----------------------------------------+ 5 rows in set (0.01 sec)
查詢性能表進行進行分析
-
兩個基本概念 ● instruments:生產者,用於采集MySQL中各種操作產生的事件信息,對應配置表中的配置項,我們可以稱之為事件采集配置項。以下提及的生產者均統稱為instruments。 ● consumers:消費者,對應的消費者表用於存儲來自instruments采集的數據,對應配置表中的配置項,我們可以稱之為消費存儲配置項。以下提及的消費者均統稱為consumers。 1、哪類的SQL執行最多? mysql> SELECT DIGEST_TEXT,COUNT_STAR,FIRST_SEEN,LAST_SEEN FROM events_statements_summary_by_digest ORDER BY COUNT_STAR DESC -> ; +----------------------------------------------------------------------------------------------------------------------------------------+------------+----------------------------+----------------------------+ | DIGEST_TEXT | COUNT_STAR | FIRST_SEEN | LAST_SEEN | +----------------------------------------------------------------------------------------------------------------------------------------+------------+----------------------------+----------------------------+ | SHOW VARIABLES LIKE ? | 4 | 2022-01-04 18:14:24.153156 | 2022-01-04 21:25:12.396097 | | SELECT NAME , TYPE , `thread_id` , `processlist_id` FROM `performance_schema` . `threads` WHERE TYPE = ? | 3 | 2022-01-04 18:06:55.067124 | 2022-01-04 18:21:09.809550 | 2、哪類SQL的平均響應時間最多? mysql> SELECT DIGEST_TEXT,AVG_TIMER_WAIT FROM events_statements_summary_by_digest ORDER BY COUNT_STAR DESC ; +----------------------------------------------------------------------------------------------------------------------------------------+----------------+ | DIGEST_TEXT | AVG_TIMER_WAIT | +----------------------------------------------------------------------------------------------------------------------------------------+----------------+ | SHOW VARIABLES LIKE ? | 5867400000 | | SELECT NAME , TYPE , `thread_id` , `processlist_id` FROM `performance_schema` . `threads` WHERE TYPE = ? | 42246300000 | 3、哪類SQL排序記錄數最多? mysql> SELECT DIGEST_TEXT,SUM_SORT_ROWS FROM events_statements_summary_by_digest ORDER BY COUNT_STAR DESC; +----------------------------------------------------------------------------------------------------------------------------------------+---------------+ | DIGEST_TEXT | SUM_SORT_ROWS | +----------------------------------------------------------------------------------------------------------------------------------------+---------------+ | SHOW VARIABLES LIKE ? | 0 | 4、哪類SQL掃描記錄數最多? mysql> SELECT DIGEST_TEXT,SUM_ROWS_EXAMINED FROM events_statements_summary_by_digest ORDER BY COUNT_STAR DESC; +----------------------------------------------------------------------------------------------------------------------------------------+-------------------+ | DIGEST_TEXT | SUM_ROWS_EXAMINED | +----------------------------------------------------------------------------------------------------------------------------------------+-------------------+ | SHOW VARIABLES LIKE ? | 51 | 5、哪類SQL使用臨時表最多? mysql> SELECT DIGEST_TEXT,SUM_CREATED_TMP_TABLES,SUM_CREATED_TMP_DISK_TABLES FROM events_statements_summary_by_digest ORDER BY COUNT_STAR DESC; +----------------------------------------------------------------------------------------------------------------------------------------+------------------------+-----------------------------+ | DIGEST_TEXT | SUM_CREATED_TMP_TABLES | SUM_CREATED_TMP_DISK_TABLES | +----------------------------------------------------------------------------------------------------------------------------------------+------------------------+-----------------------------+ | SHOW VARIABLES LIKE ? | 4 | 0 | | SELECT NAME , TYPE , `thread_id` , `processlist_id` FROM `performance_schema` . `threads` WHERE TYPE = ? | 0 | 0 | 6、哪類SQL返回結果集最多? mysql> SELECT DIGEST_TEXT,SUM_ROWS_SENT FROM events_statements_summary_by_digest ORDER BY COUNT_STAR DESC; +-------------------------------------------------------------------------------------------------------------------------------------------------------+---------------+ | DIGEST_TEXT | SUM_ROWS_SENT | +-------------------------------------------------------------------------------------------------------------------------------------------------------+---------------+ | SHOW VARIABLES LIKE ? | 51 | | SELECT NAME , TYPE , `thread_id` , `processlist_id` FROM `performance_schema` . `threads` WHERE TYPE = ? | 38 | 7、哪個表物理IO最多? mysql> SELECT file_name,event_name,SUM_NUMBER_OF_BYTES_READ,SUM_NUMBER_OF_BYTES_WRITE FROM file_summary_by_instance ORDER BY SUM_NUMBER_OF_BYTES_READ + SUM_NUMBER_OF_BYTES_WRITE DESC; +------------------------------------------+---------------------------------------+--------------------------+---------------------------+ | file_name | event_name | SUM_NUMBER_OF_BYTES_READ | SUM_NUMBER_OF_BYTES_WRITE | +------------------------------------------+---------------------------------------+--------------------------+---------------------------+ | /var/lib/mysql/ibtmp1 | wait/io/file/innodb/innodb_data_file | 0 | 14729216 | | /var/lib/mysql/#ib_16384_1.dblwr | wait/io/file/innodb/innodb_dblwr_file | 8585216 | 0 | 8、哪個表邏輯IO最多? mysql> SELECT object_name,COUNT_READ,COUNT_WRITE,COUNT_FETCH,SUM_TIMER_WAIT FROM table_io_waits_summary_by_table ORDER BY sum_timer_wait DESC; +------------------------------------------------------+------------+-------------+-------------+----------------+ | object_name | COUNT_READ | COUNT_WRITE | COUNT_FETCH | SUM_TIMER_WAIT | +------------------------------------------------------+------------+-------------+-------------+----------------+ | books | 1 | 1 | 1 | 14683357736 | | dd_properties | 0 | 0 | 0 | 0 |
9、哪個索引訪問最多?mysql> SELECT OBJECT_NAME,INDEX_NAME,COUNT_FETCH,COUNT_INSERT,COUNT_UPDATE,COUNT_DELETE FROM table_io_waits_summary_by_index_usage ORDER BY SUM_TIMER_WAIT DESC;
+------------------------------------------------------+----------------------------------+-------------+--------------+--------------+--------------+
| OBJECT_NAME | INDEX_NAME | COUNT_FETCH | COUNT_INSERT | COUNT_UPDATE | COUNT_DELETE |
+------------------------------------------------------+----------------------------------+-------------+--------------+--------------+--------------+
| books | NULL | 1 | 1 | 0 | 0 |10、哪個索引從來沒有用過?
mysql> SELECT OBJECT_SCHEMA,OBJECT_NAME,INDEX_NAME FROM table_io_waits_summary_by_index_usage WHERE INDEX_NAME IS NOT NULL AND COUNT_STAR = 0 AND OBJECT_SCHEMA <> 'mysql' ORDER BY OBJECT_SCHEMA,OBJECT_NAME;
+--------------------+------------------------------------------------------+----------------------------------+
| OBJECT_SCHEMA | OBJECT_NAME | INDEX_NAME |
+--------------------+------------------------------------------------------+----------------------------------+
| cara_testing_db | books | PRIMARY |
| performance_schema | accounts | ACCOUNT |11、哪個等待事件消耗時間最多?
mysql> SELECT EVENT_NAME,COUNT_STAR,SUM_TIMER_WAIT,AVG_TIMER_WAIT FROM events_waits_summary_global_by_event_name WHERE event_name != 'idle' ORDER BY SUM_TIMER_WAIT DESC ;
+---------------------------------------------------------------------+------------+----------------+----------------+
| EVENT_NAME | COUNT_STAR | SUM_TIMER_WAIT | AVG_TIMER_WAIT |
+---------------------------------------------------------------------+------------+----------------+----------------+
| wait/io/file/innodb/innodb_data_file | 1103 | 686179063712 | 622102240 |
| wait/io/file/innodb/innodb_dblwr_file | 30 | 118918612832 | 3963953732 |
| wait/io/file/innodb/innodb_log_file | 109 | 66884431760 | 613618552 |12、剖析某條SQL的執行情況,包括statement信息,stege信息,wait信息
mysql> SELECT EVENT_ID,sql_text FROM events_statements_history WHERE sql_text LIKE '%count(*)%';
+----------+----------------------------+
| EVENT_ID | sql_text |
+----------+----------------------------+
| 155 | select count(*) from books |
+----------+----------------------------+
1 row in set (0.00 sec)13、查看每個階段的時間消耗
mysql> SELECT event_id,EVENT_NAME,SOURCE,TIMER_END - TIMER_START FROM events_stages_history_long WHERE NESTING_EVENT_ID = 1553
-> ;
Empty set (0.01 sec)14、查看每個階段的鎖等待情況
mysql> SELECT event_id,event_name,source,timer_wait,object_name,index_name,operation,nesting_event_id FROM events_waits_history_long;