mysql insert鎖機制


一、前言

上周遇到一個因insert而引發的死鎖問題,其成因比較令人費解。
於是想要了解一下insert加鎖機制,但是發現網上介紹的文章比較少且零散,挖掘過程比較忙亂。

本以為只需要系統學習一個較完全的邏輯,但是實際牽扯很多innodb鎖相關知識及加鎖方式。我好像並沒有那么大的能耐,把各種場景的加鎖過程一一列舉並加之分析;亦沒有太多的精力驗證網上的言論的准確性。

只好根據現在了解的內容,參考官方文檔,說說自己當前的理解。
本文僅供參考,如有誤導,概不負責。

二、現場狀態

不同的mysql版本,不同的參數設置,都可能對加鎖過程有影響。
分析加鎖機制還是應當盡可能多地列舉一下關鍵參數,例如:當前mysql版本、事務隔離級別等。
如下,僅僅只列出個別比較重要的參數。

1.數據庫版本

mysql> select version();
     
       +-----------+

       | version() |
      
       +-----------+

       | 5.6.27    |
    
       +-----------+

2. 數據庫引擎

mysql> show variables like
       '%engine%';
      
       +----------------------------+--------+
 
       | Variable_name              | Value  |
      
       +----------------------------+--------+

       | default_storage_engine     | InnoDB |
      
       | default_tmp_storage_engine | InnoDB |

       | storage_engine             | InnoDB |
      
       +----------------------------+--------+

注:InnoDB支持事務,Myisam不支持事務;InnoDB支持行鎖和表鎖;Myisam不支持行鎖。

3. 事務隔離級別

mysql> select @@global.tx_isolation, @@session.tx_isolation, @@tx_isolation;
      

       +-----------------------+------------------------+-----------------+

       | @@global.tx_isolation | @@session.tx_isolation | @@tx_isolation  |
      
       +-----------------------+------------------------+-----------------+

       | REPEATABLE-READ       | REPEATABLE-READ        | REPEATABLE-READ |
      
       +-----------------------+------------------------+-----------------+

注:幾種事務隔離級別:READ UNCOMMITTED | READ COMMITTED | REPEATABLE READ | SERIALIZABLE

4. 查看gap鎖開啟狀態

mysql> show variables like 
       'innodb_locks_unsafe_for_binlog';
      

       +--------------------------------+-------+

       | Variable_name                  | Value |

       +--------------------------------+-------+

       | innodb_locks_unsafe_
       for_binlog | OFF   |

       +--------------------------------+-------+

innodb_locks_unsafe_for_binlog:默認值為0,即啟用gap lock。
最主要的作用就是控制innodb是否對gap加鎖。
但是,這一設置變更並不影響外鍵和唯一索引(含主鍵)對gap進行加鎖的需要。
開啟innodb_locks_unsafe_for_binlog的REPEATABLE-READ事務隔離級別,很大程度上已經蛻變成了READ-COMMITTED。

參見官方文檔[^1]:

By default, the value of innodb_locks_unsafe_for_binlog is 0 (disabled), which means that gap locking is enabled: InnoDB uses next-key locks for searches and index scans. To enable the variable, set it to 1. This causes gap locking to be disabled: InnoDB uses only index-record locks for searches and index scans.

Enabling innodb_locks_unsafe_for_binlog does not disable the use of gap locking for foreign-key constraint checking or duplicate-key checking.

The effect of enabling innodb_locks_unsafe_for_binlog is similar to but not identical to setting the transaction isolation level to READ COMMITTED.

5. 查看自增鎖模式

mysql> show variables like 
       'innodb_autoinc_lock_mode';
      
       +--------------------------+-------+

       | Variable_name            | Value |
      
       +--------------------------+-------+
      
       | innodb_autoinc_lock_mode | 1     |

       +--------------------------+-------+

  innodb_autoinc_lock_mode有3種配置模式:0、1、2,分別對應”傳統模式”, “連續模式”, “交錯模式”。[^8]
傳統模式:涉及auto-increment列的插入語句加的表級AUTO-INC鎖,只有插入執行結束后才會釋放鎖。這是一種兼容MySQL 5.1之前版本的策略。
連續模式:可以事先確定插入行數的語句(包括單行和多行插入),分配連續的確定的auto-increment值;對於插入行數不確定的插入語句,仍加表鎖。這種模式下,事務回滾,auto-increment值不會回滾,換句話說,自增列內容會不連續。
交錯模式:同一時刻多條SQL語句產生交錯的auto-increment值。

由於insert語句常常涉及自增列的加鎖過程,會涉及到AUTO-INC Locks加鎖過程。
為了分步了解insert加鎖過程,本文暫不討論任何涉及自增列的加鎖邏輯。
這一參數設置相關內容可能會出現在我的下一篇文章里。

n. etc

相關的參數配置越詳情越好。

三、InnoDB鎖類型[^2]

1. 基本鎖

基本鎖:共享鎖(Shared Locks:S鎖)與排他鎖(Exclusive Locks:X鎖)

mysql允許拿到S鎖的事務讀一行,允許拿到X鎖的事務更新或刪除一行。
加了S鎖的記錄,允許其他事務再加S鎖,不允許其他事務再加X鎖;
加了X鎖的記錄,不允許其他事務再加S鎖或者X鎖。

mysql對外提供加這兩種鎖的語法如下:
加S鎖:select…lock in share mode
加X鎖:select…for update

2. 意向鎖(Intention Locks)

InnoDB為了支持多粒度(表鎖與行鎖)的鎖並存,引入意向鎖。
意向鎖是表級鎖,可分為意向共享鎖(IS鎖)和意向排他鎖(IX鎖)。

InnoDB supports multiple granularity locking which permits coexistence of row-level locks and locks on entire tables. To make locking at multiple granularity levels practical, additional types of locks called intention locks are used. Intention locks are table-level locks in InnoDB that indicate which type of lock (shared or exclusive) a transaction will require later for a row in that table. There are two types of intention locks used in InnoDB (assume that transaction T has requested a lock of the indicated type on table t):
Intention shared (IS): Transaction T intends to set S locks on individual rows in table t.
Intention exclusive (IX): Transaction T intends to set X locks on those rows.

事務在請求S鎖和X鎖前,需要先獲得對應的IS、IX鎖。

Before a transaction can acquire an S lock on a row in table t, 
it must first acquire an IS or stronger lock on t.
Before a transaction can acquire an X lock on a row,
it must first acquire an IX lock on t.

意向鎖產生的主要目的是為了處理行鎖和表鎖之間的沖突,用於表明“某個事務正在某一行上持有了鎖,或者准備去持有鎖”。

The main purpose of IX and IS locks is to show that someone is locking a row, or going to lock a row in the table.

共享鎖、排他鎖與意向鎖的兼容矩陣如下:

思考

從官方文檔字面意思上看意向鎖是表級鎖,但是大牛不認為“Intention lock 是表級鎖”[^5]?
另外,由於意向鎖主要用於解決行鎖與表鎖間沖突問題,鑒於平時表級操作特別少,在分析加鎖過程是否可以不用過多考慮意向鎖的問題?

3. 行鎖

記錄鎖(Record Locks)

記錄鎖, 僅僅鎖住索引記錄的一行。
單條索引記錄上加鎖,record lock鎖住的永遠是索引,而非記錄本身,即使該表上沒有任何索引,那么innodb會在后台創建一個隱藏的聚集主鍵索引,那么鎖住的就是這個隱藏的聚集主鍵索引。所以說當一條sql沒有走任何索引時,那么將會在每一條聚集索引后面加X鎖,這個類似於表鎖,但原理上和表鎖應該是完全不同的。

參見官方文檔[^3]:

If the table has no PRIMARY KEY or suitable UNIQUE index, InnoDB internally generates 
a hidden clustered index on a synthetic column containing row ID values. The rows are ordered by the ID
that InnoDB assigns to the rows in such a table. The row ID is a 6-byte field that increases monotonically

as new rows are inserted. Thus, the rows ordered by the row ID are physically in insertion order.

間隙鎖(Gap Locks)

區間鎖, 僅僅鎖住一個索引區間(開區間)。
在索引記錄之間的間隙中加鎖,或者是在某一條索引記錄之前或者之后加鎖,並不包括該索引記錄本身。

next-key鎖(Next-Key Locks)

record lock + gap lock, 左開右閉區間。

A next-key lock is a combination of a record lock on the index record and a gap lock on the gap before the index record.

By default, InnoDB operates in REPEATABLE READ transaction isolation level and with the innodb_locks_unsafe_for_binlog system variable disabled. 

In this case, InnoDB uses next-key locks for searches and index scans, which prevents phantom rows。

默認情況下,innodb使用next-key locks來鎖定記錄。
但當查詢的索引含有唯一屬性的時候,Next-Key Lock 會進行優化,將其降級為Record Lock,即僅鎖住索引本身,不是范圍。

插入意向鎖(Insert Intention Locks)

  Gap Lock中存在一種插入意向鎖(Insert Intention Lock),在insert操作時產生。在多事務同時寫入不同數據至同一索引間隙的時候,並不需要等待其他事務完成,不會發生鎖等待。
假設有一個記錄索引包含鍵值4和7,不同的事務分別插入5和6,每個事務都會產生一個加在4-7之間的插入意向鎖,獲取在插入行上的排它鎖,但是不會被互相鎖住,因為數據行並不沖突。

An insert intention lock is a type of gap lock set by INSERT operations prior to row insertion. 
This lock signals the intent to insert in such a way that multiple transactions inserting into the same index
gap need not wait for each other if they are not inserting at the same position within the gap.
Suppose that there are index records with values of 4 and 7. Separate transactions that attempt to insert values of 5 and 6,
respectively, each lock the gap between 4 and 7 with insert intention locks prior to obtaining the exclusive lock on the inserted row,
but do not block each other because the rows are nonconflicting.

注:插入意向鎖並非意向鎖,而是一種特殊的間隙鎖。

4. 行鎖的兼容矩陣[^4]

表注:橫向是已經持有的鎖,縱向是正在請求的鎖。

由於S鎖和S鎖是完全兼容的,因此在判別兼容性時只考慮持有的鎖與請求的鎖是這三種組合情形:X、S和S、X和X、X。
另外,需要提醒注意的是進行兼容判斷也只是針對於加鎖涉及的行有交集的情形。

分析兼容矩陣可以得出如下幾個結論:

    • INSERT操作之間不會有沖突。
    • GAP,Next-Key會阻止Insert。
    • GAP和Record,Next-Key不會沖突
    • Record和Record、Next-Key之間相互沖突。
    • 已有的Insert鎖不阻止任何准備加的鎖。

5. 自增鎖(AUTO-INC Locks)

AUTO-INC鎖是一種特殊的表級鎖,發生涉及AUTO_INCREMENT列的事務性插入操作時產生。

官方解釋如下[^3]:

An AUTO-INC lock is a special table-level lock taken by transactions inserting into tables with AUTO_INCREMENT columns. 

In the simplest case, if one transaction is inserting values into the table, any other transactions must wait to do their own inserts into that table,
so that rows inserted by the first transaction receive consecutive primary key values.

四、insert加鎖過程

官方文檔[^6]對於insert加鎖的描述如下:

INSERT sets an exclusive lock on the inserted row. This lock is an index-record lock, not a next-key lock (that is, there is no gap lock) and does not prevent other sessions from inserting into the gap before the inserted row.

Prior to inserting the row, a type of gap lock called an insert intention gap lock is set. This lock signals the intent to insert in such a way that multiple transactions inserting into the same index gap need not wait for each other if they are not inserting at the same position within the gap. Suppose that there are index records with values of 4 and 7. Separate transactions that attempt to insert values of 5 and 6 each lock the gap between 4 and 7 with insert intention locks prior to obtaining the exclusive lock on the inserted row, but do not block each other because the rows are nonconflicting.

If a duplicate-key error occurs, a shared lock on the duplicate index record is set. This use of a shared lock can result in deadlock should there be multiple sessions trying to insert the same row if another session already has an exclusive lock.

  簡單的insert會在insert的行對應的索引記錄上加一個排它鎖,這是一個record lock,並沒有gap,所以並不會阻塞其他session在gap間隙里插入記錄。

不過在insert操作之前,還會加一種鎖,官方文檔稱它為insertion intention gap lock,也就是意向的gap鎖。這個意向gap鎖的作用就是預示着當多事務並發插入相同的gap空隙時,只要插入的記錄不是gap間隙中的相同位置,則無需等待其他session就可完成,這樣就使得insert操作無須加真正的gap lock。
假設有一個記錄索引包含鍵值4和7,不同的事務分別插入5和6,每個事務都會產生一個加在4-7之間的插入意向鎖,獲取在插入行上的排它鎖,但是不會被互相鎖住,因為數據行並不沖突。

假設發生了一個唯一鍵沖突錯誤,那么將會在重復的索引記錄上加讀鎖。當有多個session同時插入相同的行記錄時,如果另外一個session已經獲得該行的排它鎖,那么將會導致死鎖。

思考:Insert Intention Locks作用

Insert Intention Locks的引入,我理解是為了提高數據插入的並發能力。
如果沒有Insert Intention Locks的話,可能就需要使用Gap Locks來代替。

 

 

參考文章:

https://blog.csdn.net/zhanghongzheng3213/article/details/53436240


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM