Test classification in openstack

OpenStack Test classification in It can be divided into the following types : 

1) unit testing (small test / unit tests)

• Unit tests are stored in the code base of each component , such as nova The unit tests of are put in nova/tests Catalog
• Unit testing is mainly aimed at source level testing . The test is function level code
• Need data or simulation environment ? Use Mock To simulate
• unit test Generally only for public Level functions  

2) A functional test (Medium Tests)

• Functional tests are also stored in the code base of each component , such as nova The unit tests of are put in nova/tests Catalog
• Compared with unit testing , Functional testing should be based on the real dependency environment ( database , file IO System , Hypvervisor wait ) 

3) Integration testing (Large Tests)

Integration test tools -- SmokeStack ( be based on UI Integrated testing tools )

https://wiki.openstack.org/wiki/Smokestack

be based on Ruby Integrated testing tools

https://github.com/dprince/torpedo

Integration test tools -- Tempest

http://docs.openstack.org/developer/tempest/

• The code of integration test is placed in an independent project, such as tempest in
• Integration tests should be run in a complete deployment environment , For example, a complete deployment OpenStack Environment
• Integration testing focuses on system functions , integrity , And integration with real hardware environment
• Generally, it is not used in integration test code fake / mock 

4) Interface tests (UI tests)

There is a project in the community , It's about Horizon Interface for automated testing

https://wiki.openstack.org/wiki/Horizon/Testing/UI 

• This test tool uses selenium Yes Horizon Conducted integration test
• Before running the test , We need to start first. OpenStack Server, And ensure Horizon It's working . 

5) Performance testing (stress tests / performance tests)

There is a project in the community Rally, For performance testing

https://wiki.openstack.org/wiki/Rally 

• Rally Will automatically deploy one OpenStack Environment , And run tempest To verify the environment
• Rally Will simulate the generation of user loads , To observe performance test problems
• Rally adopt Ceilomter To collect Hypervisor and VM The data of , And put it on Rally In the database of
• Rally Will eventually generate Performance test report  

6) International testing (globalization tests)

https://launchpad.net/openstack-i18n

• Globalization Will test whether the text translation can be switched normally , And the grammar is correct
• Globalization Make sure the text is encoded correctly , And conform to the reading habits of different languages ( For example, Arabic is a right to left reading habit ) 

7) Upgrade test (upgrade tests)

Use DevStack, Yes OpenStack Do upgrade testing

https://wiki.openstack.org/wiki/Grenade