CSIT and Testsuite Tests
Triggered by merges in policy/distribution
https://github.com/onap/policy-docker/blob/master/csit/distribution/tests/distribution-test.robot
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab |
|---|---|---|---|---|---|
1 | Perform healthcheck of the component | Policy distribution docker image is available | API – healthcheck Method - GET Endpoint: https://<host>:6969/policy/distribution/v1/healthcheck | The component should return health status as “true” | CSIT External Lab |
| 2 | Query component for statistics | Policy distribution docker image is available | API - statistics Method - GET Endpoint: https://<host>:6969/policy/distribution/v1/statistics | The component should return the current statistics of the component. | CSIT |
| 3 | InvokeDistributionUsingFile And RunEventOnApexEngine |
Triggered by merges in policy/pap
https://github.com/onap/policy-docker/blob/master/csit/pap/tests/pap-test.robot
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab |
|---|---|---|---|---|---|
| 1 | Perform all component Healthcheck | PAP docker image is available | API - component healthcheck METHOD - GET Endpoint: https://<host>:6969/policy/pap/v1/components/healthcheck | CSIT - 200 but only the pap should return "healthy" since not all the components are running. TESTSUITE: 200 and all components should return "healthy" | CSIT |
| 1 | Perform healthcheck | PAP docker image is available | API – healthcheck Method - GET Endpoint: https://<host>:6969/policy/pap/v1/healthcheck | The component should return health status as “true” | CSIT External Lab |
| 2 | Query component for statistics | PAP docker image is available | API - statistics Method - GET Endpoint: https://<host>:6969/policy/pap/v1/statistics | The component should return the current statistics of the component. | CSIT External Lab |
| 3 | Query pdp group information | PAP docker image is available | API - pdps Method - GET Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should return the list of PDP groups and subgroups together with the policies that are deployed on each PDP group and subgroup. | CSIT |
| 4 | Create PDP group & subgroup | PAP docker image is available | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should create the relevant PDP group & subgroup in the database and return with operation success message/code. | CSIT |
| 5 | Create a Policy | API docker image is available | API – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | The Policy API should return code 201 and message "A new policy has been successfully created." | CSIT |
| 6 | Deploy policy to PDP group & subgroup | PAP docker image is available API docker image is available DMaaP simulator docker image is needed; a PDP can be simulated using curl | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should map the relevant policies with the corresponding PDP group & subgroup in database. Deploy the policy in relevant PDP and return with operation success message/code. | CSIT |
| 7 | UnDeploy policy to PDP group & subgroup | PAP docker image is available API docker image is available NOTE: PDP's not needed for this test in Dublin. | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | Based on test #5 - undeploy those policies | CSIT |
Triggered by merges in policy/drools-pdp
https://github.com/onap/policy-docker/blob/master/csit/drools-pdp/tests/drools-pdp-test.robot
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
|---|---|---|---|---|---|
| 1 | Alive | Verify that a PDP-D with no applications comes alive | API – telemetry Method - GET Endpoint: https://<host>:9696/policy/pdpd/v1/engine | Verify alive field | CSIT |
Triggered by merges in policy/drools-applications
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
|---|---|---|---|---|---|
| 1 | Alive | Verify that the PDP-D + Control Loop Apps come alive | API – telemetry Method - GET Endpoint: https://<host>:9696/policy/pdp/engine | Verify alive field is set to 'true' | CSIT |
| 2 | Healthcheck | Verify that the PDP-D + Control Loop Apps passes healthchecks | API – telemetry Method - GET Endpoint: https://<host>:6969/healthcheck | Verify that the healthy field at the root object is set to 'true' | CSIT |
| 3 | Frankfurt | Verify that the PDP-D + Control Loop Apps - Frankfurt controller has been successfully brought up | API – telemetry Method - GET Endpoint: https://<host>:6969/policy/pdp/engine/controllers/frankfurt/drools/facts | Verify that a 200 OK is received indicating that there is a drools session associated with this controller that has been successfully instantiated. | CSIT |
| 4 | vFW | Verify vFW use case. Simulators should be installed. |
| Verify vFirewall completes successfully | CSIT |
| 5 | vDNS | Verify Scale out use case. Simulators should be installed. |
| Verify scale out completes successfully | CSIT |
| 6 | vCPE | Verify vCPE use case. Simulators should be installed. |
| Verify vCPE completes successfully | CSIT |
Triggered by merges in policy/xacml-pdp
https://github.com/onap/policy-docker/blob/master/csit/xacml-pdp/tests/xacml-pdp-test.robot
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab |
|---|---|---|---|---|---|
| 1 | Health Check | Xacml-PDP docker image available | API – healthcheck Method - GET Endpoint: http://<host>:6969/policy/pdpx/v1/healthcheck | The component should return health status as “true” Status code 200 | CSIT External Lab |
| 2 | Statistics | Xacml-PDP docker image available | API – statistics Method - GET Endpoint: http://<host>:6969/policy/pdpx/v1/statistics | The Xacml PDP should return statistics report consisting of 0 policies loaded and 0 decisions Status code 200 | CSIT |
| 3 | ExecuteXacmlPolicy | ||||
| 3a | CreateNewMonitorPolicy | API docker image available | API – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | The Policy API should return code 201 and message "A new policy has been successfully created." | CSIT |
| 3b | DeployMonitorPolicy | Xacml-PDP and PAP docker images available Policy created on the PAP | API – deployPolicy Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/deployPolicy | Successfully deploy a policy to the XACML PDP Statistics should increment policy count Status code 201 | CSIT |
| 3c | GetAbbreviatedDecisionResult | Xacml-PDP docker image available Test Case 4 success | API – decision Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/decision?abbrev=true | The Xacml PDP should return a Decision object containing the decision and abbreviated policy results Status code 200 | CSIT |
| 3c | GetAbbreviatedDecisionResult | Xacml-PDP docker image available Test Case 4 success | API – decision Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/decision?abbrev=true | The Xacml PDP should return a Decision object containing the decision and abbreviated policy results Status code 200 | CSIT/External Lab (stretch) |
| 3d | GetDecision | Xacml-PDP docker image available Test Case 5 success | API – decision Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/decision | The Xacml PDP should return a Decision object containing the decision Status code 200 | CSIT/External Lab (stretch) |
Triggered by merges in policy/apex-pdp
https://github.com/onap/policy-docker/blob/master/csit/apex-pdp/tests/apex-pdp-test.robot
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
|---|---|---|---|---|---|
1 | Perform healthcheck of the component | Apex PDP docker image is available | API – healthcheck Method - GET Endpoint: https://<host>:6969/policy/apex-pdp/v1/healthcheck | The component should return health status as “true” Status code 200 | CSIT External Lab |
| 2 | ExecuteApexPolicy | ||||
| 2a | CreateOperationalPolicyType | API docker image available | API – policytypes Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 | CSIT External Lab |
| 2b | CreateNewOperationalPolicy | API docker image available | API – policytypes/onap.policies.controlloop.operational.Apex/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.controlloop.operational.Apex/versions/1.0.0/policies | 200 | CSIT External Lab |
| 2c | DeployOperationalPolicy | APEX-PDP and PAP docker images available DMaaP Simulator available. Policy created | API – pdps/deployments/batch Method - POST Endpoint: http://<host>:6969/policy/pap/v1/pdps/deployments/batch | 200 | CSIT External Lab |
| 2d | RunEventOnApexEngine | APEX-PDP docker image available 2c succeeds | API – /apex/FirstConsumer/EventIn Method - POST Endpoint: http://<APEX_IP>:23324/apex/FirstConsumer/EventIn | 200 | CSIT External Lab |
| 3 | Query component for statistics | Apex PDP docker image is available | API - statistics Method - GET Endpoint: https://<host>:6969/policy/apex-pdp/v1/statistics | The component should return the current statistics of the component. | CSIT |
Triggered by merges in policy/api
https://github.com/onap/policy-docker/blob/master/csit/api/tests/api-test.robot
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT External Labs |
|---|---|---|---|---|---|
1 | Healthcheck Perform healthcheck for policy design API service |
| API – healthcheck Method - GET Endpoint: http://<host>:6969/policy/api/v1/healthcheck | 200 | CSIT External Lab |
| 2 | Statistics Retrieve statistics of policy design API invocation |
| API – statistics Method - GET Endpoint: http://<host>:6969/policy/api/v1/statistics | 200 | CSIT External Lab |
| 3 | RetrievePolicyTypes Retrieve pre-loaded generic policy types |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 - all preloaded policy types | CSIT |
| 4 | CreateTCAPolicyTypeV1 |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 406 - policy type v1 is already preloaded | CSIT |
| 5 | CreateTCAPolicyTypeV2 |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 - v2 created | CSIT |
| 6 | RetrieveMonitoringPolicyTypes |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 - both v1 and v2 retrieved | CSIT |
| 7 | CreateNewMonitoringPolicyV1 Create a new TCA policy type for DCAE TCA microservice |
| API – policytypes Method - POST Endpoint: http://<host>:6969/ /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | 200 | CSIT |
| 8 | SimpleCreateNewMonitoringPolicyV1 Trying to create an existing policy with any change and same version should cause error. |
| /policy/api/v1/policies | 406 - must supply new version | CSIT |
| 9 | SimpleCreateNewMonitoringPolicyV2 Create a new Monitoring TCA policiy version 2 using simple endpoint | /policy/api/v1/policies | 200 - v2 created | CSIT | |
| 10 | RetrievePoliciesOfType Retrieve Monitoring related policy types |
| API – policytypes/onap.policies.Monitoring Method - GET Endpoint: http://<host>:6969/ /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | 200 - contains both v1 and v2 | CSIT |
| 11, 12 | DeleteSpecificPolicyV1 Delete the Monitoring Policy Version 1 of the TCA Policy Type |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/1.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT |
| 13, 14 | DeleteSpecificPolicyV2 Delete the Monitoring Policy Version 2 of the TCA Policy Type |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/2.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT |
| 15, 16 | DeleteSpecificPolicyTypeV1 |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT |
| 17, 18 | DeleteSpecificPolicyTypeV2 |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/2.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT |
Triggered by merges in policy/clamp
https://github.com/onap/policy-docker/blob/master/csit/clamp/tests/policy-clamp-test.robot
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT External Labs |
|---|---|---|---|---|---|
1 | Commission control loop | Controlloop-runtime docker image is available, mariadb is up | API – commission Method - POST Endpoint: https://<host>:6969/onap/controlloop/v2/commission | Commissioning is success Status code 200 | CSIT |
| 2 | Instantiate control loop | Controlloop-runtime, mariadb, participants and dmaap docker images are up | API – instantiation Method - POST Endpoint: http://<host>:6969/onap/controlloop/v2/instantiation | 200 | CSIT |
| 3 | Passivate control loop | Controlloop-runtime, mariadb, participants and dmaap docker images are up | API – instantiation/command Method - POST Endpoint: http://<host>:6969/onap/controlloop/v2/instantiation/command | 200 | CSIT |
| 4 | Runs Policy Participant Query New Policies | Controlloop-runtime, mariadb, participants, policy-api and dmaap docker images are up Policy created | API – /policy/api/v1/policies Method - GET Endpoint: http://<host>:6969/policy/api/v1/policies | 200 | CSIT |
| 5 | Runs Policy Participant Query New Policy Types | Controlloop-runtime, mariadb, participants, policy-api and dmaap docker images are up Policy Types created | API – /policy/api/v1/policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 | CSIT |
| 6 | ControlLoop State Change to RUNNING. | Controlloop-runtime, mariadb, participants and dmaap docker images are up | API - /onap/controlloop/v2/instantiation/command Method - POST Endpoint: https://<host>:6969/onap/controlloop/v2/instantiation/command | 200 | CSIT |
| 7 | Get Instantiated ControlLoops | Controlloop-runtime, mariadb, participants and dmaap docker images are up | API – /onap/controlloop/v2/instantiation Method - GET Endpoint: http://<host>:6969/onap/controlloop/v2/instantiation | 200 | CSIT |
Smoke Testing
The following smoke tests will be performed:
POLICY-3614 - Getting issue details... STATUS
Results will be documented in the corresponding readthedocs section: Running the smoke tests
Pairwise Testing
The following pairwise activities will be performed:
POLICY-3661 - Getting issue details... STATUS
Results will be documented in the corresponding readthedocs section: Running the pairwise tests
Stability and Performance Testing
POLICY-3385 - Getting issue details... STATUS
Results will be documented in the corresponding readthedocs section: Running the stability and performance tests