Casablanca Specific Tests
Test No. | Category (Stability, Resiliency, Scalability) | Description | Status (Not Started, In-Progress, Pass, Fail) | Notes |
---|---|---|---|---|
1 | Stability | Execute Restart Test for 72 hour period |
PASS Single instance of restart test executed successfully from JMX - 5/11 All tests executed successfully 16:50GMT 6/11 |
"DMaaP Too many requests" error no longer occurring but many of the requests timing out.
Stability test abandoned due to DMaaP errors from JMX Edited JMX to use randomised consumerGroup in DMaaP call to fix DMaaP errors and restarted test at 11:55pm. Test succeeding for first 20 minutes and VMs being start stop rebuild restart succesfully Test ongoing at 7:30AM GMT 11/9 - still logging successes in JTL file and successfully carrying out start/stop/restart/rebuild operations on VMs as confirmed from Windriver OpenStack GUI. Test ongoing at 5:00PM GMT 11/9 Test completed at 11:56pm GMT 11/9
|
|
Timing out errors:
1)
2018-11-05 17:33:08,447 | ERROR | pc-dispatcher-37 | ProviderServerOperation | 553 - appc-iaas-adapter - 1.4.1.SNAPSHOT | APPC0049E Exception ZoneException waiting for server with name Stability-Test-VM3 (and id 3b3d77e0-a79d-4c10-bfac-1b3914af1a14) to reach one of READY, RUNNING, ERROR, SUSPENDED, PAUSED states, current state is PENDING
cause=PALOS0014E Exception OpenStackResponseException (with status code 504 = Gateway Timeout) while processing service request refreshServerStatus. Original exception message was:
Unexpected status received from Openstack <html><body><h1>504 Gateway Time-out</h1>
The server didn't respond in time.
</body></html>
Service request state context:
SERVICE_URL=http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3, SERVER=Server: id(3b3d77e0-a79d-4c10-bfac-1b3914af1a14), name(Stability-Test-VM3), created(Nov 5, 2018 5:27:07 PM), updated(null), status(PENDING), PROVIDER=OpenStackProvider, PRINCIPAL=APPC-admin, METHOD=refreshServerStatus, LINE_NUMBER=1297, SERVICE=Compute, class="com".att.cdp.openstack.v2.OpenStackComputeService, TENANT=APPC, THREAD=appc-dispatcher-37
2018-11-05 17:33:08,449 | ERROR | pc-dispatcher-37 | ProviderServerOperation | 553 - appc-iaas-adapter - 1.4.1.SNAPSHOT | Exception in thread appc-dispatcher-37 com.att.cdp.exceptions.ZoneException: PALOS0014E Exception OpenStackResponseException (with status code 504 = Gateway Timeout) while processing service request refreshServerStatus. Original exception message was:
Unexpected status received from Openstack <html><body><h1>504 Gateway Time-out</h1>
The server didn't respond in time.
</body></html>
Service request state context:
SERVICE_URL=http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3, SERVER=Server: id(3b3d77e0-a79d-4c10-bfac-1b3914af1a14), name(Stability-Test-VM3), created(Nov 5, 2018 5:27:07 PM), updated(null), status(PENDING), PROVIDER=OpenStackProvider, PRINCIPAL=APPC-admin, METHOD=refreshServerStatus, LINE_NUMBER=1297, SERVICE=Compute, class="com".att.cdp.openstack.v2.OpenStackComputeService, TENANT=APPC, THREAD=appc-dispatcher-37
2)
2018-11-05 17:37:08,478 | ERROR | pc-dispatcher-37 | ProviderServerOperation | 553 - appc-iaas-adapter - 1.4.1.SNAPSHOT | APPC0049E Exception InvalidRequestException waiting for server with name Stability-Test-VM3 (and id 3b3d77e0-a79d-4c10-bfac-1b3914af1a14) to reach one of READY, RUNNING, ERROR, SUSPENDED, PAUSED states, current state is PENDING
cause=PAL0034E The poll timeout value (-300) must be greater than or equal to the poll interval (20)
2018-11-05 17:37:08,479 | ERROR | pc-dispatcher-37 | ProviderServerOperation | 553 - appc-iaas-adapter - 1.4.1.SNAPSHOT | Exception in thread appc-dispatcher-37 com.att.cdp.exceptions.InvalidRequestException: PAL0034E The poll timeout value (-300) must be greater than or equal to the poll interval (20)
3)
2018-11-05 17:38:08,533 | INFO | pc-dispatcher-37 | GraphExecutor | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | NEW KEY = input.action -- Rebuild
2018-11-05 17:38:08,533 | INFO | pc-dispatcher-37 | GraphExecutor | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | NEW KEY = payload -- {"vm-id":"http://10.12.25.2:8774/v2.1/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "identity-url": "http://10.12.25.2:5000/v2.0","skip-hypervisor-check":"true"}
2018-11-05 17:38:08,534 | INFO | pc-dispatcher-37 | FlowControlNode | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | Handling Response for transaction Id 1
2018-11-05 17:38:08,534 | INFO | pc-dispatcher-37 | DefaultResponseHandler | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | Transaction Input params Transaction [transactionId=1, action=Rebuild, actionLevel=vm, actionIdentifier=null, parameters=null, executionType=graph, uId=null, statusCode=401, pswd=null, executionEndPoint=null, executionModule=APPC, executionRPC=RebuildVM, state=null, precheck=null, payload={"vm-id":"http://10.12.25.2:8774/v2.1/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "identity-url": "http://10.12.25.2:5000/v2.0","skip-hypervisor-check":"true"}, responses=[Response [responseCode=null, responseMessage=null, responseAction=ResponseAction [wait=null, retry=null, jump=null, ignore=false, stop=true, intermediateMessage=false], responseActionHanlder=null]], status=failure]
2018-11-05 17:38:08,535 | INFO | pc-dispatcher-37 | FlowControlNode | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | Executed all the transaction successfully
2018-11-05 17:38:08,535 | ERROR | pc-dispatcher-37 | FlowControlNode | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | Error occurred in processFlow
org.onap.ccsdk.sli.core.sli.SvcLogicException: Waiting for State Change:APPC0055E Connection to provider OpenStackProvider at service http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3 failed after all retry attempts.
| ||||||||||||||||
2 | Stability | Execute Rebuild Test for 72 hour period | PASS Test started 11/10 01:10GMT nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_run72hr_01:10GMT_11_10.jtl >/dev/null 2>&1 & | |||||||||||||
3 | Stability | Execute Start Test for 72 hour period | PASS Test started 19:54GMT 11/28 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_11_28_19_54.jtl >/dev/null 2>&1 & Tests running successfully 10:00GMT 11/29 Tests running successfully 18:00GMT 11/29 Tests running successfully 08:00GMT 11/30 Tests running successfully 18:00GMT 11/30 Tests running successfully 11:00GMT 12/1 Test completed successfully 19:54GMT 12/1 |
| ||||||||||||
4 | Stability | Execute Stop Test for 72 hour period | PASS Test started 21:00GMT 12/1 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_12_01_21_00.jtl >/dev/null 2>&1 & Tests running successfully 14:00GMT 12/2 Tests running successfully 08:00GMT 12/3 Tests running successfully towards 1/3 of VMs 08:00GMT 12/4 Tests running successfully towards 1/3 of VMs 18:00GMT 12/4 Tests completed successfully towards 1/3 of VMs 21:00GMT 12/4 |
|
Regression Tests
TC No. | Action | Heat | OOM | LCM API Provider | Query AAI | NetConf | Via DMaaP | Status | Notes | ||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Healthcheck | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
2 | Config Modify | Yes | Yes | Yes | Yes | Yes | Yes |
| |||||||
3 | Restart | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
4 | Rebuild | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
5 | Stop | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
6 | Start | Yes | Yes | Yes | Yes | NA | Yes |
| |||||||
7 | Reboot | Yes | Yes | Yes | Yes | NA | Yes |
| Fixed APPC-1226 |
...