Casablanca Specific Tests
Test No. | Category (Stability, Resiliency, Scalability) | Description | Status (Not Started, In-Progress, Pass, Fail) | Notes |
---|---|---|---|---|
1 | Stability | Execute Restart Test for 72 hour period | PASS Single instance of restart test executed successfully from JMX - 5/11 All tests executed successfully 16:50GMT 6/11
Stability test abandoned due to DMaaP errors from JMX Edited JMX to use randomised consumerGroup in DMaaP call to fix DMaaP errors and restarted test at 11:55pm. Test succeeding for first 20 minutes and VMs being start stop rebuild restart succesfully Test ongoing at 7:30AM GMT 11/9 - still logging successes in JTL file and successfully carrying out start/stop/restart/rebuild operations on VMs as confirmed from Windriver OpenStack GUI. Test ongoing at 5:00PM GMT 11/9 Test completed at 11:56pm GMT 11/9 | |
2 | Stability | Execute Rebuild Test for 72 hour period | PASS Test started 11/10 01:10GMT nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_run72hr_01:10GMT_11_10.jtl >/dev/null 2>&1 & | |
3 | Stability | Execute Start Test for 72 hour period | IN PROGRESS Restarted 16:00GMT 11/20 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_11_20_16_00.jtl >/dev/null 2>&1 & 10:00GMT 11/21 Tests running successfully against 1.4.3 software 13:00GMT 11/22 Faults in VMs causing outages for tests 1) JMX logging errors connecting to DMaaP 1542892966853,998,Submit request via DMaaP,Non HTTP response code: java.net.ConnectException,Non HTTP response message: Connection refused (Connection refused),Stability-Test-VM3 LCM Group 3-1,text,false,,2058,0,1,3,0,0,998 2) Stablity Test VM errors 3) APPC VM Reboot 4) Cluster problems logging in APPC 2018-11-22 13:37:46,865 | WARN | lt-dispatcher-98 | NettyTransport | 57 - com.typesafe.akka.slf4j - 2.5.11 | Remote connection to [null] failed with java.net.ConnectException: Connection refused: onap-appc-2.appc-cluster.onap/10.42.0.70:2550 | |
4 | Stability | Execute Stop Test for 72 hour period |
Regression Tests
TC No. | Action | Heat | OOM | LCM API Provider | Query AAI | NetConf | Via DMaaP | Status | Notes |
---|---|---|---|---|---|---|---|---|---|
1 | Healthcheck | Yes | Yes | Yes | Yes | NA | Yes | PASSED | |
2 | Config Modify | Yes | Yes | Yes | Yes | Yes | Yes | PASSED | |
3 | Restart | Yes | Yes | Yes | Yes | NA | Yes | PASSED | |
4 | Rebuild | Yes | Yes | Yes | Yes | NA | Yes | PASSED | |
5 | Stop | Yes | Yes | Yes | Yes | NA | Yes | PASSED | |
6 | Start | Yes | Yes | Yes | Yes | NA | Yes | PASSED | |
7 | Reboot | Yes | Yes | Yes | Yes | NA | Yes | PASSED | Fixed APPC-1226 |
Postman Collection for Regression Testing
Refer Testing with Postman page to work in postman
Use Regression Test Scripts & Windriver Environment to test all the above test cases.