Python自動化之pytest常用插件

1、失敗重跑 pytest-rerunfailures

　　安裝：pip install pytest-rerunfailures

　　使用：pytest test_class.py --reruns 5 --reruns-delay 1 -vs  （失敗后重新運行5次，每次間隔1秒）

　　　　　@pytest.mark.flaky(reruns = 5 ,reruns-delay = 1 )　指定某個用例

#!/usr/bin/python
# -*- coding: UTF-8 -*-
"""
@author:chenshifeng
@file:test_calc2.py
@time:2020/09/16
"""

import pytest


@pytest.mark.parametrize('a,b,result', [
    (1, 1, 3),
    (2, 2, 4),
    (100, 100, 200),
    (0.1, 0.1, 0.2),
    (-1, -1, -2)
], ids=['int', 'int', 'bignum', 'float', 'fushu'])  # 參數化
def test_add(a, b, result):
    # cal = Calculator()
    assert result == a + b

命令行執行：

pytest test_calc2.py --reruns 5 --reruns-delay 1 -vs

結果如下：

============================================================================= test session starts =============================================================================
platform darwin -- Python 3.6.4, pytest-6.0.2, py-1.9.0, pluggy-0.13.1 -- /Library/Frameworks/Python.framework/Versions/3.6/bin/python3.6
cachedir: .pytest_cache
rootdir: /Users/chenshifeng/MyCode/PythonCode/SFDSZL/test_pytest, configfile: pytest.ini
plugins: rerunfailures-9.1, dependency-0.5.1, ordering-0.6, assume-2.3.2
collected 5 items                                                                                                                                                             

test_calc2.py::test_add[int0] RERUN
test_calc2.py::test_add[int0] RERUN
test_calc2.py::test_add[int0] RERUN
test_calc2.py::test_add[int0] RERUN
test_calc2.py::test_add[int0] RERUN
test_calc2.py::test_add[int0] FAILED
test_calc2.py::test_add[int1] PASSED
test_calc2.py::test_add[bignum] PASSED
test_calc2.py::test_add[float] PASSED
test_calc2.py::test_add[fushu] PASSED

================================================================================== FAILURES ===================================================================================
_______________________________________________________________________________ test_add[int0] ________________________________________________________________________________

a = 1, b = 1, result = 3

    @pytest.mark.parametrize('a,b,result', [
        (1, 1, 3),
        (2, 2, 4),
        (100, 100, 200),
        (0.1, 0.1, 0.2),
        (-1, -1, -2)
    ], ids=['int', 'int', 'bignum', 'float', 'fushu'])  # 參數化
    def test_add(a, b, result):
        cal = Calculator()
>       assert result == cal.add(a, b)
E       assert 3 == 2
E         +3
E         -2

test_calc2.py:26: AssertionError
=========================================================================== short test summary info ===========================================================================
FAILED test_calc2.py::test_add[int0] - assert 3 == 2
==================================================================== 1 failed, 4 passed, 5 rerun in 5.11s =====================================================================

通過裝飾器設置重跑次數與延時時間

#!/usr/bin/python
# -*- coding: UTF-8 -*-
"""
@author:chenshifeng
@file:test_calc2.py
@time:2020/09/16
"""

import pytest


@pytest.mark.parametrize('a,b,result', [
    (1, 1, 3),
    (2, 2, 4),
    (100, 100, 200),
    (0.1, 0.1, 0.2),
    (-1, -1, -2)
], ids=['int', 'int', 'bignum', 'float', 'fushu'])  # 參數化
# 通過裝飾器設置重跑次數
@pytest.mark.flaky(reruns=6, reruns_delay=2)
def test_add(a, b, result):
    # cal = Calculator()
    assert result == a + b

結果：

Testing started at 10:10 下午 ...
/usr/local/bin/python3.6 "/Applications/PyCharm CE.app/Contents/plugins/python-ce/helpers/pycharm/_jb_pytest_runner.py" --target test_calc2.py::test_add
Launching pytest with arguments test_calc2.py::test_add in /Users/chenshifeng/MyCode/PythonCode/SFDSZL/test_pytest/testcode

============================= test session starts ==============================
platform darwin -- Python 3.6.4, pytest-6.0.2, py-1.9.0, pluggy-0.13.1 -- /usr/local/bin/python3.6
cachedir: .pytest_cache
rootdir: /Users/chenshifeng/MyCode/PythonCode/SFDSZL/test_pytest, configfile: pytest.ini
plugins: rerunfailures-9.1, dependency-0.5.1, ordering-0.6, assume-2.3.2
collecting ... collected 5 items

test_calc2.py::test_add[int0] RERUN                                      [ 20%]
test_calc2.py::test_add[int0] RERUN                                      [ 20%]
test_calc2.py::test_add[int0] RERUN                                      [ 20%]
test_calc2.py::test_add[int0] RERUN                                      [ 20%]
test_calc2.py::test_add[int0] RERUN                                      [ 20%]
test_calc2.py::test_add[int0] RERUN                                      [ 20%]
test_calc2.py::test_add[int0] FAILED                                     [ 20%]
testcode/test_calc2.py:11 (test_add[int0])
3 != 2

Expected :2
Actual   :3
<Click to see difference>

a = 1, b = 1, result = 3

    @pytest.mark.parametrize('a,b,result', [
        (1, 1, 3),
        (2, 2, 4),
        (100, 100, 200),
        (0.1, 0.1, 0.2),
        (-1, -1, -2)
    ], ids=['int', 'int', 'bignum', 'float', 'fushu'])  # 參數化
    # 通過裝飾器設置重跑次數
    @pytest.mark.flaky(reruns=6, reruns_delay=2)
    def test_add(a, b, result):
        # cal = Calculator()
>       assert result == a + b
E       assert 3 == 2

test_calc2.py:23: AssertionError
PASSED                                     [ 40%]PASSED                                   [ 60%]PASSED                                    [ 80%]PASSED                                    [100%]
Assertion failed

Assertion failed

Assertion failed

Assertion failed

test_calc2.py::test_add[int1] 
test_calc2.py::test_add[bignum] 
test_calc2.py::test_add[float] 
test_calc2.py::test_add[fushu] 

=================================== FAILURES ===================================
________________________________ test_add[int0] ________________________________

a = 1, b = 1, result = 3

    @pytest.mark.parametrize('a,b,result', [
        (1, 1, 3),
        (2, 2, 4),
        (100, 100, 200),
        (0.1, 0.1, 0.2),
        (-1, -1, -2)
    ], ids=['int', 'int', 'bignum', 'float', 'fushu'])  # 參數化
    # 通過裝飾器設置重跑次數
    @pytest.mark.flaky(reruns=6, reruns_delay=2)
    def test_add(a, b, result):
        # cal = Calculator()
>       assert result == a + b
E       assert 3 == 2

test_calc2.py:23: AssertionError
=========================== short test summary info ============================
FAILED test_calc2.py::test_add[int0] - assert 3 == 2
==================== 1 failed, 4 passed, 6 rerun in 12.13s =====================

Process finished with exit code 1

Assertion failed

Assertion failed

Assertion failed

Assertion failed

2、多重校驗 pytest-assume

　　正常情況下一條用例如果有多條斷言，一條斷言失敗了，其他斷言就不會執行了，而使用pytest-assume可以繼續執行下面的斷言

　　　　安裝  ：  pip install  pytest-assume

　　　　執行  ： pytest.assume(1==3)

for example：

#!/usr/bin/python
# -*- coding: UTF-8 -*-
"""
@author:chenshifeng
@file:test_calc2.py
@time:2020/09/16
"""

import pytest


def test_assume():
    print('登錄操作')
    pytest.assume(1 == 2)
    print('搜索操作')
    pytest.assume(2 == 2)
    print('加購操作')
    pytest.assume(3 == 2)

運行結果：

Testing started at 10:23 下午 ...
/usr/local/bin/python3.6 "/Applications/PyCharm CE.app/Contents/plugins/python-ce/helpers/pycharm/_jb_pytest_runner.py" --target test_calc2.py::test_assume
Launching pytest with arguments test_calc2.py::test_assume in /Users/chenshifeng/MyCode/PythonCode/SFDSZL/test_pytest/testcode

============================= test session starts ==============================
platform darwin -- Python 3.6.4, pytest-6.0.2, py-1.9.0, pluggy-0.13.1 -- /usr/local/bin/python3.6
cachedir: .pytest_cache
rootdir: /Users/chenshifeng/MyCode/PythonCode/SFDSZL/test_pytest, configfile: pytest.ini
plugins: rerunfailures-9.1, dependency-0.5.1, ordering-0.6, assume-2.3.2
collecting ... collected 1 item

test_calc2.py::test_assume FAILED                                        [100%]登錄操作
搜索操作
加購操作

testcode/test_calc2.py:11 (test_assume)
tp = <class 'pytest_assume.plugin.FailedAssumption'>, value = None, tb = None

    def reraise(tp, value, tb=None):
        try:
            if value is None:
                value = tp()
            if value.__traceback__ is not tb:
>               raise value.with_traceback(tb)
E               pytest_assume.plugin.FailedAssumption: 
E               2 Failed Assumptions:
E               
E               test_calc2.py:14: AssumptionFailure
E               >>    pytest.assume(1 == 2)
E               AssertionError: assert False
E               
E               test_calc2.py:18: AssumptionFailure
E               >>    pytest.assume(3 == 2)
E               AssertionError: assert False

/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/six.py:702: FailedAssumption

Assertion failed

Assertion failed


=================================== FAILURES ===================================
_________________________________ test_assume __________________________________

tp = <class 'pytest_assume.plugin.FailedAssumption'>, value = None, tb = None

    def reraise(tp, value, tb=None):
        try:
            if value is None:
                value = tp()
            if value.__traceback__ is not tb:
>               raise value.with_traceback(tb)
E               pytest_assume.plugin.FailedAssumption: 
E               2 Failed Assumptions:
E               
E               test_calc2.py:14: AssumptionFailure
E               >>    pytest.assume(1 == 2)
E               AssertionError: assert False
E               
E               test_calc2.py:18: AssumptionFailure
E               >>    pytest.assume(3 == 2)
E               AssertionError: assert False

/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/six.py:702: FailedAssumption
----------------------------- Captured stdout call -----------------------------
登錄操作
搜索操作
加購操作
=========================== short test summary info ============================
FAILED test_calc2.py::test_assume - pytest_assume.plugin.FailedAssumption: 
============================== 1 failed in 0.09s ===============================

Process finished with exit code 1

Assertion failed

Assertion failed

Assertion failed

Assertion failed

3、設定執行順序 pytest-ordering

　　正常情況下，用例默認執行順序是自上而下的，對於一些有上下文依賴關系的用例，可是通過  pytest-ordering 來設置執行順序，當然，通過setup、teardown和fixture來解決也是可以的

　　安裝插件  ：  pip install  pytest-ordering

　　使用方法  ：  @pytest.mark.run(order=2)

　　需要注意的是，當有多個裝飾器的時候，可能會發生沖突（比如參數化）

For example, this:

import pytest

@pytest.mark.run(order=2)
def test_foo():
    assert True

@pytest.mark.run(order=1)
def test_bar():
    assert True

Yields this output:

============================= test session starts ==============================
platform darwin -- Python 3.6.4, pytest-6.0.2, py-1.9.0, pluggy-0.13.1 -- /usr/local/bin/python3.6
cachedir: .pytest_cache
rootdir: /Users/chenshifeng/MyCode/PythonCode/SFDSZL/test_pytest, configfile: pytest.ini
plugins: rerunfailures-9.1, dependency-0.5.1, ordering-0.6, assume-2.3.2
collecting ... collected 2 items

test_ordering.py::test_bar 
test_ordering.py::test_foo 

============================== 2 passed in 0.02s ===============================

4、用例依賴（pytest-dependency）

使用該插件可以標記一個testcase作為其他testcase的依賴，當依賴項執行失敗時，那些依賴它的test將會被跳過。

安裝  ： pip install pytest-dependency

使用方法： 用 @pytest.mark.dependency()對所依賴的方法進行標記，使用@pytest.mark.dependency(depends=["test_name"])引用依賴,test_name可以是多個。

上用例：

import pytest

@pytest.mark.dependency()
def test_01():
    assert False

@pytest.mark.dependency(depends=["test_01"])
def test_02():
    print("執行測試2")

output：

=========================== short test summary info ============================
FAILED test_ordering.py::test_01 - assert False
========================= 1 failed, 1 skipped in 0.06s =========================

Process finished with exit code 1

 5.分布式測試(pytest-xdist)

• 平常我們功能測試用例非常多時，比如有1千條用例，假設每個用例執行需要1分鍾，如果單個測試人員執行需要1000分鍾才能跑完
• 當項目非常緊急時，會需要協調多個測試資源來把任務分成兩部分，於是執行時間縮短一半，如果有10個小伙伴，那么執行時間就會變成十分之一，大大節省了測試時間
• 為了節省項目測試時間，10個測試同時並行測試，這就是一種分布式場景

　分布式執行用例的原則：

• • • • 用例之間是獨立的，沒有依賴關系，完全可以獨立運行
      • 用例執行沒有順序要求，隨機順序都能正常執行
      • 每個用例都能重復運行，運行結果不會影響其他用例

　　插件安裝：
　　　　　　pip3 install pytest-xdist -i http://pypi.douban.com/simple/ --trusted-host pypi.douban.com

　　使用方法：

　　　　　　pytest  -n  2   (2代表2個CPU)

　　　　　　pytest  -n  auto  

• • 　　n auto：可以自動檢測到系統的CPU核數；從測試結果來看，檢測到的是邏輯處理器的數量，即假12核
  • 　　使用auto等於利用了所有CPU來跑用例，此時CPU占用率會特別高

6.生成報告（pytest-html）

pytest-html是一個插件，pytest用於生成測試結果的HTML報告。兼容Python 2.7,3.6

安裝插件： pip install pytest-html

使用方法： pytest --html=report.html