Casablanca Specific Tests
Test No. | Category (Stability, Resiliency, Scalability) | Description | Status (Not Started, In-Progress, Pass, Fail) | Notes |
|---|---|---|---|---|
| 1 | Stability | Execute Restart Test for 72 hour period | PASS Single instance of restart test executed successfully from JMX - 5/11 All tests executed successfully 16:50GMT 6/11
Stability test abandoned due to DMaaP errors from JMX Edited JMX to use randomised consumerGroup in DMaaP call to fix DMaaP errors and restarted test at 11:55pm. Test succeeding for first 20 minutes and VMs being start stop rebuild restart succesfully Test ongoing at 7:30AM GMT 11/9 - still logging successes in JTL file and successfully carrying out start/stop/restart/rebuild operations on VMs as confirmed from Windriver OpenStack GUI. Test ongoing at 5:00PM GMT 11/9 Test completed at 11:56pm GMT 11/9
| |
| 2 | Stability | Execute Rebuild Test for 72 hour period | PASS Test started 11/10 01:10GMT nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_run72hr_01:10GMT_11_10.jtl >/dev/null 2>&1 & | |
| 3 | Stability | Execute Start Test for 72 hour period | PASS Test started 19:54GMT 11/28 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_11_28_19_54.jtl >/dev/null 2>&1 & Tests running successfully 10:00GMT 11/29 Tests running successfully 18:00GMT 11/29 Tests running successfully 08:00GMT 11/30 Tests running successfully 18:00GMT 11/30 Tests running successfully 11:00GMT 12/1 Test completed successfully 19:54GMT 12/1 | |
| 4 | Stability | Execute Stop Test for 72 hour period | PASS Test started 21:00GMT 12/1 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_12_01_21_00.jtl >/dev/null 2>&1 & Tests running successfully 14:00GMT 12/2 Tests running successfully 08:00GMT 12/3 Tests running successfully towards 1/3 of VMs 08:00GMT 12/4 Tests running successfully towards 1/3 of VMs 18:00GMT 12/4 Tests completed successfully towards 1/3 of VMs 21:00GMT 12/4 |
Regression Tests
TC No. | Action | Heat | OOM | LCM API Provider | Query AAI | NetConf | Via DMaaP | Status | Notes |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Healthcheck | Yes | Yes | Yes | Yes | NA | Yes | PASSED | |
| 2 | Config Modify | Yes | Yes | Yes | Yes | Yes | Yes | PASSED | |
| 3 | Restart | Yes | Yes | Yes | Yes | NA | Yes | PASSED | |
| 4 | Rebuild | Yes | Yes | Yes | Yes | NA | Yes | PASSED | |
| 5 | Stop | Yes | Yes | Yes | Yes | NA | Yes | PASSED | |
| 6 | Start | Yes | Yes | Yes | Yes | NA | Yes | PASSED | |
| 7 | Reboot | Yes | Yes | Yes | Yes | NA | Yes | PASSED | Fixed APPC-1226 |
Postman Collection for Regression Testing
Refer Testing with Postman page to work in postman
Use Regression Test Scripts & Windriver Environment to test all the above test cases.
1 Comment
Takamune Cho
thank you, Joss!