Table of Contents |
---|
CSIT and Testsuite Tests
Triggered by merges in policy/distribution
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab |
---|---|---|---|---|---|
1 | Perform healthcheck of the component | Policy distribution docker image is available | API – healthcheck Method - GET Endpoint: https://<host>:6969/policy/distribution/v1/healthcheck | The component should return health status as “true” | CSIT - DONE External Lab |
2 | Query component for statistics | Policy distribution docker image is available | API - statistics Method - GET Endpoint: https://<host>:6969/policy/distribution/v1/statistics | The component should return the current statistics of the component. | CSIT - DONE |
3 | InvokeDistributionUsingFile And RunEventOnApexEngine |
Triggered by merges in policy/pap
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Perform healthcheck of the componentall component Healthcheck | PAP docker image is available | API – - component healthcheck Method METHOD - GET Endpoint: https://<host>:6969/policy/pap/v1/healthcheck/components/healthcheck | CSIT - 200 but only the pap should return "healthy" since not all the components are running. TESTSUITE: 200 and all components should return "healthy" | CSIT - TBD Testsuite -
| ||||||||
1 | Perform healthcheck | The component should return health status as “true” | CSIT - DONE External Lab - DONE | 2 | Query component for statistics | PAP docker image is available | API - statistics – healthcheck Method - GET Endpoint: https://<host>:6969/policy/pap/v1/statisticshealthcheck | The component should return the current statistics of the component.health status as “true” | CSIT - DONE External Lab - DONE | ||||
32 | Query pdp group informationcomponent for statistics | PAP docker image is available | API - statistics Method - GET Endpoint: https://<host>:6969/policy/pap/v1/statistics | The component should return the current statistics of the component. | CSIT - DONE External Lab | ||||||||
3 | Query pdp group information | PAP docker image is available | API - pdps Method - GET Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should return the list of PDP groups and subgroups together with the policies that are deployed on each PDP group and subgroup. | CSIT - DONE | ||||||||
4 | Create PDP group & subgroup | PAP docker image is available | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should create the relevant PDP group & subgroup in the database and return with operation success message/code. | CSIT - DONE | ||||||||
5 | Create a Policy | API docker image is available | API – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | The Policy API should return code 201 and message "A new policy has been successfully created." | CSIT | ||||||||
6 | Deploy policy to PDP group & subgroup | PAP docker image is available API docker image is available DMaaP simulator docker image is needed; a PDP can be simulated using curl | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should map the relevant policies with the corresponding PDP group & subgroup in database. Deploy the policy in relevant PDP and return with operation success message/code. | CSIT | ||||||||
7 | UNDeploy policy to PDP group & subgroup | PAP docker image is available API docker image is available NOTE: PDP's not needed for this test in Dublin. | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | Based on test #5 - undeploy those policies | CSIT - DONE | ||||||||
|
|
| |||||||||||
|
|
|
...
Triggered by merges in policy/drools-pdp
Test Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs | |||
---|---|---|---|---|---|---|---|---|
1 | Alive | Verify that base barebone a PDP-D with no applications comes alive | API – telemetry Method - GET Endpoint: https://<host>:9696/policy/pdpd/v1/engine | Verify alive field | CSIT-DONE | 2 (stretch) | Dynamic Controller Creation | Verify dynamic addition of a PDP-D controller |
Triggered by merges in policy/drools-applications
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
---|---|---|---|---|---|
1 | Alive | Verify that the PDP-D + Control Loop Apps come alive |
API – telemetry Method - GET Endpoint: https://<host>:9696/policy/ |
Triggered by merges in policy/drools-applications
pdp/engine | Verify alive field is set to 'true' | CSIT - DONE | |||
2 | Healthcheck | Verify that the PDP-D + Control Loop Apps passes healthchecks | |||
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
---|---|---|---|---|---|
1 | Healthcheck | Verify that base barebone PDP-D comes alive | API – telemetry Method - GET Endpoint: https://<host>:6969/policy/pdpd/v1/engine/healthcheck | Verify healthcheck | CSIT |
2 | vFW | Verify vFW use case. Simulators should be installed. |
| Verify vFirewall completes successfully | CSIT |
that the healthy field at the root object is set to 'true' | CSIT - DONE | ||||
3 | Frankfurt | Verify that the PDP-D + Control Loop Apps - Frankfurt controller has been successfully brought up | API – telemetry Method - GET Endpoint: https://<host>:6969/policy/pdp/engine/controllers/frankfurt/drools/facts | Verify that a 200 OK is received indicating that there is a drools session associated with this controller that has been successfully instantiated. | CSIT - DONE |
4 | vFW | Verify vFW use case. Simulators should be installed. |
| Verify vFirewall completes successfully | CSIT |
53 | vDNS | Verify Scale out use case. Simulators should be installed. |
| Verify scale out completes successfully | CSIT |
46 | vCPE | Verify vCPE use case. Simulators should be installed. |
| Verify vCPE completes successfully | CSIT |
Triggered by merges in policy/xacml-pdp
Test Case Id | Description | Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab |
---|---|---|---|---|---|---|---|
1 | Health Check | Xacml-PDP docker image available | API – healthcheck Method - GET Endpoint: http://<host>:6969/policy/pdpx/v1/healthcheck | The component should return health status as “true” Status code 200 | CSIT - DONE External Lab | ||
2 | Statistics | Xacml-PDP docker image available | API – statistics Method - GET Endpoint: http://<host>:6969/policy/pdpx/v1/statistics | The Xacml PDP should return statistics report consisting of 0 policies loaded and 0 decisions Status code 200 | CSIT - DONE | ||
3 | ExecuteXacmlPolicy | ||||||
3a | CreateNewMonitorPolicy | 3 | Create policy | API docker image available | API – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | The Policy API should return code 201 and message "A new policy has been successfully created." | CSIT |
33b | Deploy Policy DeployMonitorPolicy | Xacml-PDP and PAP docker images available Policy created on the PAP | API – deployPolicy Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/deployPolicy | Successfully deploy a policy to the XACML PDP Statistics should increment policy count Status code 201 | CSIT/External Lab (stretch) | ||
3c | GetAbbreviatedDecisionResult | 4 | Statistics | Xacml-PDP and PAP docker images image available Test Case 3 4 success | API – statisticsdecision Method - GETPOST Endpoint: http://<host>:6969/policy/pdpx/v1/statisticsdecision?abbrev=true | The Xacml PDP should return statistics report consisting of 1 policy loaded and 0 decisionsa Decision object containing the decision and abbreviated policy results Status code 200 | CSIT |
3c | GetAbbreviatedDecisionResult | 5 | Decision API with abbreviated result | Xacml-PDP docker image available Test Case 4 success | API – decision Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/decision?abbrev=true | The Xacml PDP should return a Decision object containing the decision and abbreviated policy results Status code 200 | CSIT/External Lab (stretch) |
63d | Decision API GetDecision | Xacml-PDP docker image available Test Case 5 success | API – decision Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/decision | The Xacml PDP should return a Decision object containing the decisionStatistics should increment decision count Status code 200 | CSIT/External Lab (stretch) | ||
7 | Statistics | Xacml-PDP docker image available Test Case 6 success | API – statistics Method - GET Endpoint: http://<host>:6969/policy/pdpx/v1/statistics | Xacml PDP should return a statistics report consisting of 1 policy loaded and 1 decisions Status code 200 | CSIT | 8 | Undeploy Policy |
Triggered by merges in policy/apex-pdp
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
---|---|---|---|---|---|
1 | Perform healthcheck of the component | Apex PDP docker image is available | API – healthcheck Method - GET Endpoint: https://<host>:6969/policy/ |
apex-pdp/v1/ |
Successfully undeploy of policy from the Xacml PDP
Statistics should decrement the policy counthealthcheck | The component should return health status as “true” Status code |
200 | CSIT |
- DONE External Lab | |||||
2 | ExecuteApexPolicy | ||||
2a | CreateOperationalPolicyType | API |
docker image available |
Test Case 8 success
API – |
policytypes Method - |
POST Endpoint: http://<host>:6969/policy/ |
api/v1/ |
Xacml PDP should return a statistics report consisting of 0 policies loaded and 1 decision
Status code 200
Triggered by merges in policy/apex-pdp
policytypes | 200 | CSIT - DONE External Lab | |
2b | CreateNewOperationalPolicy | API docker image available | API – policytypes/onap.policies.controlloop.operational.Apex/versions/1.0.0/policies Method - POST Endpoint: http |
Test Case Id
Description
Pre-conditions
Test Steps
Expected Results
1
Perform healthcheck of the component
Apex PDP docker image is available
API – healthcheck
Method - GET
Endpoint: https://<host>:6969/policy/ |
api/v1 |
/policytypes/onap.policies.controlloop.operational.Apex/versions/1.0.0/policies | 200 | CSIT |
The component should return health status as “true”
- DONE External Lab |
API - statistics
Method - GET
Endpoint: https2c | DeployOperationalPolicy | APEX-PDP and PAP docker images available DMaaP Simulator available. Policy created | API – pdps/deployments/batch Method - POST Endpoint: http://<host>:6969/policy/ |
pap/v1 |
3
Create Operational policies for the following use cases
- SampleDomain
- BBS (if this is not a POC)
Policy components up and running
(Will be added once API page approved)
(Current integration tests for REST client moved to CSIT)
Operational Policy should be created in apex-pdp
CSIT (Stretch)
Triggered by merges in policy/api
/pdps/deployments/batch | 200 | CSIT - DONE External Lab | |||
2d | RunEventOnApexEngine | APEX-PDP docker image available 2c succeeds | API – /apex/FirstConsumer/EventIn Method - POST Endpoint: http://<APEX_IP>:23324/apex/FirstConsumer/EventIn | 200 | CSIT - DONE External Lab |
3 | Query component for statistics | Apex PDP docker image is available | API - statistics |
Test Case Id
Description
Pre-conditions
Test Steps
Expected Results
1
Healthcheck
Perform healthcheck for policy design API service
- Policy API docker image available
Method - GET Endpoint: |
https://<host>:6969/policy/ |
apex-pdp/v1/statistics | The component should return the current statistics of the component. | CSIT (Stretch) |
Triggered by merges in policy/api
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT External Labs | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Healthcheck Perform healthcheck for policy design API service | 200 | CSIT External Lab | |||||||||
2 | Statistics Retrieve statistics of policy design API invocation |
| API – statistics Method - GET Endpoint: http://<host>:6969/policy/api/v1/statistics | 200 | CSIT External Lab | |||||||
3 |
| API – | policytypeshealthcheck Method - GET Endpoint: http://<host>:6969/policy/api/v1/ | policytypeshealthcheck | 200 | - all preloaded policy typesCSIT | 4 | External Lab | ||||
2 | Statistics Retrieve statistics of policy design API invocation CreateTCAPolicyTypeV1 |
| API – policytypesstatistics Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypesstatistics | 200406 - policy type v1 is already preloaded | CSIT | 5External Lab | ||||||
3 | RetrievePolicyTypes Retrieve pre-loaded generic policy types |
| CreateTCAPolicyTypeV2 |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 - v2 createdall preloaded policy types | CSIT | |||||
64 | RetrieveMonitoringPolicyTypesCreateTCAPolicyTypeV1 |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 406 - both v1 and v2 retrievedpolicy type v1 is already preloaded | CSIT | |||||||
75 | CreateNewMonitoringPolicyV1 Create a new TCA policy type for DCAE TCA microservice | CreateTCAPolicyTypeV2 |
| API – policytypes Method - POSTGET Endpoint: http://<host>:6969/ /policypolicy/api/v1/policytypes /onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | 200 - v2 created200 | CSIT | ||||||
86 | SimpleCreateNewMonitoringPolicyV1 Trying to create an existing policy with any change and same version should cause error. | RetrieveMonitoringPolicyTypes |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/ policiespolicytypes | 406 - must supply new version200 - both v1 and v2 retrieved | CSIT | ||||||
97 | SimpleCreateNewMonitoringPolicyV2 CreateNewMonitoringPolicyV1 Create a new MonitoringTCA policiy version 2 using simple endpoint | /policy/api/v1/policies | 200 - v2 created | CSIT | policy type for DCAE TCA microservice |
| 10 | RetrievePoliciesOfType Retrieve Monitoring related policy types |
| API – policytypes/onap.policies.Monitoring Method - GETPOST Endpoint: http://<host>:6969/ /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | 200 - contains both v1 and v2 | CSIT |
118 | SimpleCreateNewMonitoringPolicyV1 Trying to create an existing policy with any change and same version should cause error. DeleteSpecificPolicyV1 Delete the Monitoring Policy Version 1 of the TCA Policy Type |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/1.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT | 12 | DeleteSpecificPolicyV2 Delete the Monitoring Policy Version 2 of the TCA Policy Type |
| 406 - must supply new version | CSIT | ||
9 | SimpleCreateNewMonitoringPolicyV2 Create a new Monitoring TCA policiy version 2 using simple endpoint | /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/2.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT | policies | 200 - v2 created | CSIT | |||||
10 | RetrievePoliciesOfType Retrieve Monitoring related policy types | 13 | DeleteSpecificPolicyTypeV1 |
| API – policytypes/onap.policies.Monitoring Method - GET Endpoint: http://<host>:6969/ //policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT | contains both v1 and v2 | CSIT | |||
11, 12 | DeleteSpecificPolicyV1 Delete the Monitoring Policy Version 1 of the TCA Policy Type |
| 14 | DeleteSpecificPolicyTypeV2 |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/2.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/1.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT | |
13, 14 | DeleteSpecificPolicyV2 Delete the Monitoring Policy Version 2 of the TCA Policy Type |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/2.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT | |||||||
15, 16 | DeleteSpecificPolicyTypeV1 |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT | |||||||
17, 18 | DeleteSpecificPolicyTypeV2 |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/2.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT |
Pairwise Testing
POLICY Pair Wise Testing for Frankfurt Release
Stability and Performance Testing
Jira | ||||||
---|---|---|---|---|---|---|
|
Results will be documented in the readthedocs: https://docs.onap.org/en/latest/submodules/policy/parent.git/docs/development/devtools/devtools.html#running-the-stability-performance-tests