Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Casablanca Specific Tests

Test No.

Category

(Stability, Resiliency, Scalability)

Description

Status

(Not Started, In-Progress, Pass, Fail)

Notes
1StabilityExecute Restart Test for 72 hour period
In Progress

PASS

Single instance of restart test executed successfully from JMX - 5/11

All tests executed successfully 16:50GMT 6/11

"DMaaP Too many requests" error no longer occurring but many of the requests timing out.

72 hour Stability test started 16:52GMT

Stability test abandoned due to DMaaP errors from JMX

Edited JMX to use randomised consumerGroup in DMaaP call to fix DMaaP errors and restarted test at 11:55pm. Test succeeding for first 20 minutes and VMs being start stop rebuild restart succesfully

Test ongoing at 7:30AM GMT 11/9 - still logging successes in JTL file and successfully carrying out start/stop/restart/rebuild operations on VMs as confirmed from Windriver OpenStack GUI.

Test ongoing at 5:00PM GMT 11/9

Test completed at 11:56pm GMT 11/9

View file
namekaraf.log
height250

Image AddedImage AddedImage Added

View file
nameJMX-restartTestLog.txt
height250

Timing out errors:

1)

2018-11-05 17:33:08,447 | ERROR | pc-dispatcher-37 | ProviderServerOperation | 553 - appc-iaas-adapter - 1.4.1.SNAPSHOT | APPC0049E Exception ZoneException waiting for server with name Stability-Test-VM3 (and id 3b3d77e0-a79d-4c10-bfac-1b3914af1a14) to reach one of READY, RUNNING, ERROR, SUSPENDED, PAUSED states, current state is PENDING
cause=PALOS0014E Exception OpenStackResponseException (with status code 504 = Gateway Timeout) while processing service request refreshServerStatus. Original exception message was:
Unexpected status received from Openstack <html><body><h1>504 Gateway Time-out</h1>
The server didn't respond in time.
</body></html>

Service request state context:
SERVICE_URL=http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3, SERVER=Server: id(3b3d77e0-a79d-4c10-bfac-1b3914af1a14), name(Stability-Test-VM3), created(Nov 5, 2018 5:27:07 PM), updated(null), status(PENDING), PROVIDER=OpenStackProvider, PRINCIPAL=APPC-admin, METHOD=refreshServerStatus, LINE_NUMBER=1297, SERVICE=Compute, class="com".att.cdp.openstack.v2.OpenStackComputeService, TENANT=APPC, THREAD=appc-dispatcher-37
2018-11-05 17:33:08,449 | ERROR | pc-dispatcher-37 | ProviderServerOperation | 553 - appc-iaas-adapter - 1.4.1.SNAPSHOT | Exception in thread appc-dispatcher-37 com.att.cdp.exceptions.ZoneException: PALOS0014E Exception OpenStackResponseException (with status code 504 = Gateway Timeout) while processing service request refreshServerStatus. Original exception message was:
Unexpected status received from Openstack <html><body><h1>504 Gateway Time-out</h1>
The server didn't respond in time.
</body></html>

Service request state context:
SERVICE_URL=http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3, SERVER=Server: id(3b3d77e0-a79d-4c10-bfac-1b3914af1a14), name(Stability-Test-VM3), created(Nov 5, 2018 5:27:07 PM), updated(null), status(PENDING), PROVIDER=OpenStackProvider, PRINCIPAL=APPC-admin, METHOD=refreshServerStatus, LINE_NUMBER=1297, SERVICE=Compute, class="com".att.cdp.openstack.v2.OpenStackComputeService, TENANT=APPC, THREAD=appc-dispatcher-37

2)

2018-11-05 17:37:08,478 | ERROR | pc-dispatcher-37 | ProviderServerOperation | 553 - appc-iaas-adapter - 1.4.1.SNAPSHOT | APPC0049E Exception InvalidRequestException waiting for server with name Stability-Test-VM3 (and id 3b3d77e0-a79d-4c10-bfac-1b3914af1a14) to reach one of READY, RUNNING, ERROR, SUSPENDED, PAUSED states, current state is PENDING
cause=PAL0034E The poll timeout value (-300) must be greater than or equal to the poll interval (20)
2018-11-05 17:37:08,479 | ERROR | pc-dispatcher-37 | ProviderServerOperation | 553 - appc-iaas-adapter - 1.4.1.SNAPSHOT | Exception in thread appc-dispatcher-37 com.att.cdp.exceptions.InvalidRequestException: PAL0034E The poll timeout value (-300) must be greater than or equal to the poll interval (20)

3)

2018-11-05 17:38:08,533 | INFO | pc-dispatcher-37 | GraphExecutor | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | NEW KEY = input.action -- Rebuild
2018-11-05 17:38:08,533 | INFO | pc-dispatcher-37 | GraphExecutor | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | NEW KEY = payload -- {"vm-id":"http://10.12.25.2:8774/v2.1/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "identity-url": "http://10.12.25.2:5000/v2.0","skip-hypervisor-check":"true"}
2018-11-05 17:38:08,534 | INFO | pc-dispatcher-37 | FlowControlNode | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | Handling Response for transaction Id 1
2018-11-05 17:38:08,534 | INFO | pc-dispatcher-37 | DefaultResponseHandler | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | Transaction Input params Transaction [transactionId=1, action=Rebuild, actionLevel=vm, actionIdentifier=null, parameters=null, executionType=graph, uId=null, statusCode=401, pswd=null, executionEndPoint=null, executionModule=APPC, executionRPC=RebuildVM, state=null, precheck=null, payload={"vm-id":"http://10.12.25.2:8774/v2.1/cf142fb96ce24770946c0f7117c0aeb3/servers/3b3d77e0-a79d-4c10-bfac-1b3914af1a14", "identity-url": "http://10.12.25.2:5000/v2.0","skip-hypervisor-check":"true"}, responses=[Response [responseCode=null, responseMessage=null, responseAction=ResponseAction [wait=null, retry=null, jump=null, ignore=false, stop=true, intermediateMessage=false], responseActionHanlder=null]], status=failure]
2018-11-05 17:38:08,535 | INFO | pc-dispatcher-37 | FlowControlNode | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | Executed all the transaction successfully
2018-11-05 17:38:08,535 | ERROR | pc-dispatcher-37 | FlowControlNode | 563 - org.onap.appc.flow.controller - 1.4.1.SNAPSHOT | Error occurred in processFlow
org.onap.ccsdk.sli.core.sli.SvcLogicException: Waiting for State Change:APPC0055E Connection to provider OpenStackProvider at service http://10.12.25.2:8774/v2/cf142fb96ce24770946c0f7117c0aeb3 failed after all retry attempts.

View file
nameJMX_log_all_operations_6_11.txt
height250


2StabilityExecute Rebuild Test for 72 hour period

PASS

Test started 11/10 01:10GMT

nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_run72hr_01:10GMT_11_10.jtl >/dev/null 2>&1 &



3StabilityExecute Start Test for 72 hour period

PASS

Test started 19:54GMT 11/28

nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_11_28_19_54.jtl >/dev/null 2>&1 &

Tests running successfully 10:00GMT 11/29

Tests running successfully 18:00GMT 11/29

Tests running successfully 08:00GMT 11/30

Tests running successfully 18:00GMT 11/30

Tests running successfully 11:00GMT 12/1

Test completed successfully 19:54GMT 12/1


View file
nameAPPC-LCM-Action-V1_12_01_21_00.jtl
height250
View file
namekaraf_run3.log
height250

4StabilityExecute Stop Test for 72 hour period

PASS

Test started 21:00GMT 12/1

 nohup /home/ubuntu/testing/apache-jmeter-4.0/bin/jmeter.sh -n -t ./infinite_APPC-LCM-Action-V1.jmx -l ./APPC-LCM-Action-V1_12_01_21_00.jtl >/dev/null 2>&1 &

Tests running successfully 14:00GMT 12/2

Tests running successfully 08:00GMT 12/3

Tests running successfully towards 1/3 of VMs 08:00GMT 12/4

Tests running successfully towards 1/3 of VMs 18:00GMT 12/4

Tests completed successfully towards 1/3 of VMs 21:00GMT 12/4


View file
namekaraf-run4.log
height250
View file
nameAPPC-LCM-Action-V1_12_01_21_00.jtl
height250

2StabilityExecute Rebuild Test for 72 hour period3StabilityExecute Start Test for 72 hour period4StabilityExecute Stop Test for 72 hour period


Regression Tests


TC No.

Action Heat

OOM

LCM API ProviderQuery AAINetConfVia DMaaPStatusNotes
1HealthcheckYesYesYesYesNAYes

Status
colourGreen
titlePassed


2Config ModifyYesYesYesYesYesYes

Status
colourGreen
titlePassed


3RestartYesYesYesYesNAYes

Status
colourGreen
titlePassed


4RebuildYesYesYesYesNAYes

Status
colourGreen
titlePassed


5StopYesYesYesYesNAYes

Status
colourGreen
titlePassed


6StartYesYesYesYesNAYes

Status
colourGreen
titlePassed


7RebootYesYesYesYesNAYes

Status
colourGreen
titlePassed

Fixed APPC-1226

...