...
Test No. | Category (Stability, Resiliency, Scalability) | Description | Status (Not Started, In-Progress, Pass, Fail) | Notes | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Stability | Execute Restart Test for 72 hour period | PASS Single instance of restart test executed successfully from JMX - 5/11 All tests executed successfully 16:50GMT 6/11
Stability test abandoned due to DMaaP errors from JMX Edited JMX to use randomised consumerGroup in DMaaP call to fix DMaaP errors and restarted test at 11:55pm. Test succeeding for first 20 minutes and VMs being start stop rebuild restart succesfully Test ongoing at 7:30AM GMT 11/9 - still logging successes in JTL file and successfully carrying out start/stop/restart/rebuild operations on VMs as confirmed from Windriver OpenStack GUI. Test ongoing at 5:00PM GMT 11/9 Test completed at 11:56pm GMT 11/9
|
| ||||||||||||||||||
2 | Stability | Execute Rebuild Test for 72 hour period | PASS Test started 11/10 01:10GMT nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_run72hr_01:10GMT_11_10.jtl >/dev/null 2>&1 & | |||||||||||||||||||
3 | Stability | Execute Start Test for 72 hour period | PASS Test started 19:54GMT 11/28 ABANDONED Restarted 16:00GMT 11/20 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_11_2028_1619_0054.jtl >/dev/null 2>&1 & Tests running successfully 10:00GMT 11/21 29 Tests running successfully against 1.4.3 software18:00GMT 11/29 Tests running successfully 0813:00GMT 11/22 Faults in VMs causing outages for tests 1) JMX logging errors connecting to DMaaP 1542892966853,998,Submit request via DMaaP,Non HTTP response code: java.net.ConnectException,Non HTTP response message: Connection refused (Connection refused),Stability-Test-VM3 LCM Group 3-1,text,false,,2058,0,1,3,0,0,998 2) Stablity Test VM errors 3) APPC VM Reboot 4) Cluster problems logging in APPC 2018-11-22 13:37:46,865 | WARN | lt-dispatcher-98 | NettyTransport | 57 - com.typesafe.akka.slf4j - 2.5.11 | Remote connection to [null] failed with java.net.ConnectException: Connection refused: onap-appc-2.appc-cluster.onap/10.42.0.70:2550 Abandoning test 17:00GMT 11/22 APPC deployment has most pods running morning of 11/23 but onap-appc-2 pod is not connectable and is reporting: onap-appc-2 1/2 Running 0 13h 10.44.0.107 k8s-appc1 <none> 30 Tests running successfully 18:00GMT 11/30 Tests running successfully 11:00GMT 12/1 Test completed successfully 19:54GMT 12/1 |
| ||||||||||||||||||
4 | Stability | Execute Stop Test for 72 hour period | PASS Test started 21:00GMT 12/1 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_12_01_21_00.jtl >/dev/null 2>&1 & Tests running successfully 14:00GMT 12/2 Tests running successfully 08:00GMT 12/3 Tests running successfully towards 1/3 of VMs 08:00GMT 12/4 Tests running successfully towards 1/3 of VMs 18:00GMT 12/4 Tests completed successfully towards 1/3 of VMs 21:00GMT 12/4 |
| 4 | Stability | Execute Stop Test for 72 hour period |
Regression Tests
TC No. | Action | Heat | OOM | LCM API Provider | Query AAI | NetConf | Via DMaaP | Status | Notes | ||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Healthcheck | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
2 | Config Modify | Yes | Yes | Yes | Yes | Yes | Yes |
| |||||||
3 | Restart | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
4 | Rebuild | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
5 | Stop | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
6 | Start | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
7 | Reboot | Yes | Yes | Yes | Yes | NA | Yes |
| Fixed APPC-1226 |
...