社區對OpenStack平台功能性的測試工具采用Tempest,性能測試采用Rally。
1、什么是Tempest
tempest
├── api # API的測試集
├── cli # OpenStack的命令行工具測試集
├── common # 一些公共的工具類和函數
├── scenario # 對OpenStack的常用場景進行測試,包括基本的啟動VM,掛載volumn和網絡配置等
├── services # tempest自己實現的OpenStack API Client,自己實現是為了不讓一些bug隱藏在官方實現的Client里面。
├── stress # 壓力測試集,利用multiprocessing來啟動多個進程來同時對OpenStack發起請求。
├── thirdparty # EC2兼容的API測試集
├── whitebox # 白盒測試集,主要是對DB操作,然后發起請求,然后比對結果
2、tempest是通過nose驅動的,python語言編寫,使用testtools和testresources等幾個測試工具庫
3、tempest.test.BaseTestCase,BaseTestCase聲明config屬性,讀取配置文件
4、tempest.test.TestCase聲明很多工具函數,供調用
5、每個測試可以分別測試JSON格式和XML格式
2、安裝Tempest
##下載源碼
git clone https://github.com/openstack/tempest.git cd tempest vim requirements.txt
##添加
discover>=0.4.0
###查看python版本
python --version
###如若是2.6執行如下,2.7不需要
wget https://pypi.python.org/packages/source/u/unittest2/unittest2-0.5.1.tar.gz tar zxvf unittest2-0.5.1.tar.gz cd unittest2-0.5.1 python setup.py install
###查看xslt-config命令是否存在
[root@controller001 ~]# whereis xslt-config xslt-config: /usr/bin/xslt-config(代表存在)
###如果沒有執行安裝命令
[root@controller001 ~]#yum install libxslt-devel
###檢查是否有gcc環境,沒有則安裝
[root@controller001 ~]#yum install gcc-c++
###安裝一些相關的包
[root@controller001 ~]#yum install libevent-devel openssl-devel libffi-devel python-devel
[root@controller001 ~]#/usr/bin/easy_install pip
###進入tempest目錄進行安裝(沒有安裝虛擬機環境)
[root@controller001 ~]#python setup.py install
(可選)###如果不想將tempest安裝在真實環境中那么執行如下命令
[root@controller001 ~]#pip install -U virtualenv
[root@controller001 ~]#virtualenv .venv
[root@controller001 ~]#. .venv/bin/activate
[root@controller001 ~]#python setup.py install
###安裝junitxml,是測試報告輸出為xml格式
[root@controller001]#pip install junitxml
###由於tempest在Icehouse時期上使用是有bug的,bug如下:
###在/root/tempest/tempest/openstack/common/log.py文件下添加
注意:在Juno版本時期,此bug已修復,故而可以跳過。
###修改tempest.conf文件,注意創建外網的時候不要共享,否則在測試啟動虛擬機以及進行網絡測試的時候會報錯
cp etc/tempest.conf.sample etc/tempest.conf
[root@controller001 etc]# egrep "^[^#]" tempest.conf [DEFAULT] lock_path =keystone [auth] [baremetal] [boto] [cli] cli_dir = /usr/bin (是否測試cli命令)
enabled=true [compute]
catalog_type= compute (keystone service-list命令顯示type的值) endpoint_type = publicURL (keystone endpoint-list命令顯示) fixed_network_name=53f6877e-2f46-43e3-93b7-7e22786cacb2
flavor_ref = 1
flavor_ref_alt = 2 floating_ip_range = 172.16.101.0/24 image_ref = 7e4b08b4-d7a1-4eff-9757-25e2234ca4db (鏡像id) image_ref_alt = 7e4b08b4-d7a1-4eff-9757-25e2234ca4db region =RegionOne (與keystone endpoint-list命令列出值region值相同) ssh_user = root use_floatingip_for_ssh = true volume_device_name = vdb (掛載雲硬盤) [compute-admin] domain_name = nova password =admin tenant_name = admin username = admin [compute-feature-enabled] live_migration = true rescue = true resize = true shelve = true snapshot = true suspend = true vnc_console = true [dashboard] dashboard_url = http://172.16.100.162/dashboard/ login_url = http://172.16.100.162/auth/login/ [data_processing] [database] [debug] [identity] (keystone方面的配置) admin_password = admin admin_role = admin admin_tenant_name = admin admin_username = admin alt_password = tempest alt_tenant_name = tempest alt_username = tempest catalog_type = identity endpoint_type = publicURL password = admin region = RegionOne tenant_name = admin uri = http://172.16.100.162:35357/v2.0 uri_v3 = 172.16.100.162 username = admin [identity-feature-enabled] api_v2 = true api_v3 = true [image] (glance方面的配置) catalog_type = image endpoint_type = publicURL http_image = http://download.cirros-cloud.net/0.3.1/cirros-0.3.1-x86_64-uec.tar.gz region =RegionOne [image-feature-enabled] api_v1 = true api_v2 = true
[input-scenario]
[messaging]
[negative]
catalog_type = network
dns_servers = 8.8.8.8,8.8.4.4
endpoint_type = publicURL
public_network_id =53f6877e-2f46-43e3-93b7-7e22786cacb2
public_router_id =ac4a4d9b-27c7-492b-824a-ae384710ab2a region =RegionOne tenant_network_cidr = 10.100.0.0/16 tenant_network_mask_bits = 28 tenant_networks_reachable = true [network-feature-enabled] [object-storage] [object-storage-feature-enabled] [orchestration] [scenario] [service_available] (這里配置需要測試哪些模塊) ceilometer = false cinder = true glance = true heat = false horizon = true ironic = false neutron = true nova = true sahara = false swift = false trove = false zaqar = false [stress] [telemetry] [volume] [volume-feature-enabled] multi_backend =true (測試cinder的后端存儲有多個backend)
###修改好配置文件之后,進行測試(以測試keystone當中token為例)
[root@controller001 tempest]# nosetests tempest/api/identity/admin/test_tokens.py --with-xunit --xunit-file=/root/keystone_test_tokens.xml
----------------------------------------------------------------------
Ran 2 tests in 1.532s
OK
[root@controller001 ~]# cat keystone_test_tokens.xml <?xml version="1.0" encoding="UTF-8"?><testsuite name="nosetests" tests="2" errors="0" failures="0" skip="0"><testcase classname="tempest.api.identity.admin.test_tokens.TokensTestJSON" name="test_create_get_delete_token[gate]" time="0.270"><system-out><![CDATA[I want to the url'value and body's value tenants,{"tenant": {"enabled": true, "name": "tenant--1612865724", "description": ""}} I want to the url'value and body's value users,{"user": {"tenantId": "b8f636519ff949d19405e59fce2f78ac", "password": "pass--1460623961", "name": "user--1945966900", "email": ""}} I want to the url'value and body's value http://172.16.100.162:35357/v2.0/tokens,{"auth": {"tenantName": "tenant--1612865724", "passwordCredentials": {"username": "user--1945966900", "password": "pass--1460623961"}}} ]]></system-out></testcase><testcase classname="tempest.api.identity.admin.test_tokens.TokensTestJSON" name="test_rescope_token[gate]" time="0.526"><system-out><![CDATA[I want to the url'value and body's value users,{"user": {"password": "pass--46178537", "name": "user--996425809", "email": ""}} I want to the url'value and body's value tenants,{"tenant": {"enabled": true, "name": "tenant--781047271", "description": ""}} I want to the url'value and body's value tenants,{"tenant": {"enabled": true, "name": "tenant--1886860973", "description": ""}} I want to the url'value and body's value OS-KSADM/roles,{"role": {"name": "role--684861165"}} I want to the url'value and body's value http://172.16.100.162:35357/v2.0/tokens,{"auth": {"passwordCredentials": {"username": "user--996425809", "password": "pass--46178537"}}} I want to the url'value and body's value http://172.16.100.162:35357/v2.0/tokens,{"auth": {"token": {"id": "MIIDLgYJKoZIhvcNAQcCoIIDHzCCAxsCAQExCTAHBgUrDgMCGjCCAYQGCSqGSIb3DQEHAaCCAXUEggFxeyJhY2Nlc3MiOiB7InRva2VuIjogeyJpc3N1ZWRfYXQiOiAiMjAxNS0wMS0yMlQwNTo1MDowNy42NDg5NjIiLCAiZXhwaXJlcyI6ICIyMDE1LTAxLTIyVDA2OjUwOjA3WiIsICJpZCI6ICJwbGFjZWhvbGRlciIsICJhdWRpdF9pZHMiOiBbIkpIZ0U0eDgwVFJXSkJORjJFUjdXV3ciXX0sICJzZXJ2aWNlQ2F0YWxvZyI6IFtdLCAidXNlciI6IHsidXNlcm5hbWUiOiAidXNlci0tOTk2NDI1ODA5IiwgInJvbGVzX2xpbmtzIjogW10sICJpZCI6ICI4OGQwNGVkZmU0YWE0MmEyYWUzZWQxZjAyNzVmYWQ3NCIsICJyb2xlcyI6IFtdLCAibmFtZSI6ICJ1c2VyLS05OTY0MjU4MDkifSwgIm1ldGFkYXRhIjogeyJpc19hZG1pbiI6IDAsICJyb2xlcyI6IFtdfX19MYIBgTCCAX0CAQEwXDBXMQswCQYDVQQGEwJVUzEOMAwGA1UECAwFVW5zZXQxDjAMBgNVBAcMBVVuc2V0MQ4wDAYDVQQKDAVVbnNldDEYMBYGA1UEAwwPd3d3LmV4YW1wbGUuY29tAgEBMAcGBSsOAwIaMA0GCSqGSIb3DQEBAQUABIIBAAjoxz4e-hnwHy45cd+o3tgQI1SdvidiOIfRrDAg5hMc0Fn9pGxnt-fYmZIBRH9b0LMjkjJa32OO2M0xmlcwCmaALsMMpBk5ouaECzNEJNGb2UyFW6Lpi5r5seM5HBO40brE0muMraOnzoRqkmGijEXf0RDn84iFrX40pvwo-htACNsB9fm1BkqUg8A+ANOJNHRGnqY80fIj+ipp5-53drN0VxbakHZvYJHAut5GsOdK-+TThj3fvbDA1fM-wa-SmZNV7xl-X8F9NChbe7VV3AFdE4XQHpdFZr+c4ZEDGlcq6VVRyD0OpeM2Nt9GbN8gevNWJpK2qjVJ2dxXgCZnDZg="}, "tenantName": "tenant--781047271"}} I want to the url'value and body's value http://172.16.100.162:35357/v2.0/tokens,{"auth": {"token": {"id": "MIIDLgYJKoZIhvcNAQcCoIIDHzCCAxsCAQExCTAHBgUrDgMCGjCCAYQGCSqGSIb3DQEHAaCCAXUEggFxeyJhY2Nlc3MiOiB7InRva2VuIjogeyJpc3N1ZWRfYXQiOiAiMjAxNS0wMS0yMlQwNTo1MDowNy42NDg5NjIiLCAiZXhwaXJlcyI6ICIyMDE1LTAxLTIyVDA2OjUwOjA3WiIsICJpZCI6ICJwbGFjZWhvbGRlciIsICJhdWRpdF9pZHMiOiBbIkpIZ0U0eDgwVFJXSkJORjJFUjdXV3ciXX0sICJzZXJ2aWNlQ2F0YWxvZyI6IFtdLCAidXNlciI6IHsidXNlcm5hbWUiOiAidXNlci0tOTk2NDI1ODA5IiwgInJvbGVzX2xpbmtzIjogW10sICJpZCI6ICI4OGQwNGVkZmU0YWE0MmEyYWUzZWQxZjAyNzVmYWQ3NCIsICJyb2xlcyI6IFtdLCAibmFtZSI6ICJ1c2VyLS05OTY0MjU4MDkifSwgIm1ldGFkYXRhIjogeyJpc19hZG1pbiI6IDAsICJyb2xlcyI6IFtdfX19MYIBgTCCAX0CAQEwXDBXMQswCQYDVQQGEwJVUzEOMAwGA1UECAwFVW5zZXQxDjAMBgNVBAcMBVVuc2V0MQ4wDAYDVQQKDAVVbnNldDEYMBYGA1UEAwwPd3d3LmV4YW1wbGUuY29tAgEBMAcGBSsOAwIaMA0GCSqGSIb3DQEBAQUABIIBAAjoxz4e-hnwHy45cd+o3tgQI1SdvidiOIfRrDAg5hMc0Fn9pGxnt-fYmZIBRH9b0LMjkjJa32OO2M0xmlcwCmaALsMMpBk5ouaECzNEJNGb2UyFW6Lpi5r5seM5HBO40brE0muMraOnzoRqkmGijEXf0RDn84iFrX40pvwo-htACNsB9fm1BkqUg8A+ANOJNHRGnqY80fIj+ipp5-53drN0VxbakHZvYJHAut5GsOdK-+TThj3fvbDA1fM-wa-SmZNV7xl-X8F9NChbe7VV3AFdE4XQHpdFZr+c4ZEDGlcq6VVRyD0OpeM2Nt9GbN8gevNWJpK2qjVJ2dxXgCZnDZg="}, "tenantName": "tenant--1886860973"}} ]]></system-out></testcase></testsuite>
若有不足之處,歡迎批評指正!
相關鏈接:http://www.oschina.net/question/129540_146999
http://docs.openstack.org/developer/tempest/configuration.html