Casablanca Specific Tests
Test No. | Category (Stability, Resiliency, Scalability) | Description | Status (Not Started, In-Progress, Pass, Fail) | Notes | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Stability | Execute Restart Test for 72 hour period | PASS Single instance of restart test executed successfully from JMX - 5/11 All tests executed successfully 16:50GMT 6/11
Stability test abandoned due to DMaaP errors from JMX Edited JMX to use randomised consumerGroup in DMaaP call to fix DMaaP errors and restarted test at 11:55pm. Test succeeding for first 20 minutes and VMs being start stop rebuild restart succesfully Test ongoing at 7:30AM GMT 11/9 - still logging successes in JTL file and successfully carrying out start/stop/restart/rebuild operations on VMs as confirmed from Windriver OpenStack GUI. Test ongoing at 5:00PM GMT 11/9 Test completed at 11:56pm GMT 11/9
|
| ||||||||||||||||||
2 | Stability | Execute Rebuild Test for 72 hour period | PASS Test started 11/10 01:10GMT nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_run72hr_01:10GMT_11_10.jtl >/dev/null 2>&1 & | |||||||||||||||||||
3 | Stability | Execute Start Test for 72 hour period | PASS Test started 19:54GMT 11/28 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_11_28_19_54.jtl >/dev/null 2>&1 & Tests running successfully 10:00GMT 11/29 Tests running successfully 18:00GMT 11/29 Tests running successfully 08:00GMT 11/30 Tests running successfully 18:00GMT 11/30 Tests running successfully 11:00GMT 12/1 Test completed successfully 19:54GMT 12/1 |
| ||||||||||||||||||
4 | Stability | Execute Stop Test for 72 hour period |
PASS Test started 21:00GMT 12/1 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_12_01_21_00.jtl >/dev/null 2>&1 & Tests running successfully 14:00GMT 12/2 Tests running successfully 08:00GMT 12/3 Tests running successfully towards 1/3 of VMs 08:00GMT 12/4 Tests running successfully towards 1/3 of VMs 18:00GMT 12/4 Tests completed successfully towards 1/3 of VMs 21:00GMT 12/4 |
|
Regression Tests
TC No. | Action | Heat | OOM | LCM API |
---|
Provider |
---|
Query AAI | NetConf | Via DMaaP | Status | Notes | |
---|---|---|---|---|---|
1 | Healthcheck | Yes | Yes | Yes | Yes |
NA | Yes |
AAI connection issue in OOM
Unable to view Karaf log in OOM
Appc tried to make connection to VNF but no VNF exist. This case is fine once VNF is available
Unable to view Karaf log in OOM
| |||||||||||||||
2 | Config Modify | Yes | Yes | Yes | Yes | Yes | Yes |
| |||||||
3 | Restart | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
4 | Rebuild | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
5 | Stop | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
6 | Start | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
7 | Reboot | Yes | Yes | Yes | Yes | NA | Yes |
| Fixed APPC-1226 |
Postman Collection for Regression Testing
Refer Testing with Postman page to work in postman
Use Regression Collection.json Test Scripts & Windriver Environment.json to test all the above test cases.