Table of Contents |
---|
CSIT and Testsuite Tests
Triggered by merges in policy/distribution
...
Test Case Id
...
Description
...
Pre-conditions
...
Test Steps
...
Expected Results
...
1
...
Perform healthcheck of the component
...
distribution
...
API – healthcheck
Method - GET
...
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Perform healthcheck of the component | <host>:6969/policy/distribution/v1/healthcheckThe component should return health status as “true” | CSIT - DONE External Lab | 2 | Query component for statisticsPolicy distribution docker image is available | API | - statistics– healthcheck Method - GET Endpoint: https://<host>:6969/policy/distribution/v1/ | statisticshealthcheck | The component should return | the current statistics of the component.health status as “true” | CSIT - DONE |
Triggered by merges in policy/pap
External Lab | ||
2 | Query component for statistics | Policy distribution docker |
Test Case Id
Description
Pre-conditions
Test Steps
Expected Results
image is available | API |
- statistics Method - GET Endpoint: https://<host>:6969/policy/ |
distribution/v1/ |
statistics | The component should return |
the current statistics of the component. | CSIT - DONE | ||||
3 | InvokeDistributionUsingFile And RunEventOnApexEngine |
Triggered by merges in policy/pap
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Perform all component Healthcheck | |||||||||||||||
2 | Query component for statistics | PAP docker image is available | API - statistics Method - GET Endpoint: https://<host>:6969/policy/pap/v1/statistics | The component should return the current statistics of the component. | CSIT - DONE External Lab | |||||||||||
3 | Query pdp group information | PAP docker image is available | API - pdpscomponent healthcheck Method METHOD - GET Endpoint: https:{url}:{port}//<host>:6969/policy/pap/v1/components/pdps | The component should return the list of PDP groups and subgroups together with the policies that are deployed on each PDP group and subgroup. | CSIT - DONE | healthcheck | CSIT - 200 but only the pap should return "healthy" since not all the components are running. TESTSUITE: 200 and all components should return "healthy" | CSIT - TBD Testsuite -
| ||||||||
1 | Perform healthcheck | 4 | Create PDP group & subgroup | PAP docker image is available | API - pdps – healthcheck Method - POSTGET Endpoint: https:{url}:{port}//<host>:6969/policy/pap/v1/pdpshealthcheck | The component should create the relevant PDP group & subgroup in the database and return with operation success message/code.return health status as “true” | CSIT - DONE External Lab - DONE | |||||||||
2 | Query component for statistics | PAP | 5 | Create a Policy | API docker image is available | API – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | The Policy API should return code 201 and message "A new policy has been successfully created." | CSIT | - statistics Method - GET Endpoint: https://<host>:6969/policy/pap/v1/statistics | The component should return the current statistics of the component. | CSIT - DONE External Lab | |||||
3 | Query pdp group information | 6 | Deploy policy to PDP group & subgroup | PAP docker image is available | API docker image is available DMaaP simulator docker image is needed; a PDP can be simulated using curl API - - pdps Method - POSTGET Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should map the relevant policies with the corresponding PDP group & subgroup in database. Deploy the policy in relevant PDP and return with operation success message/code. | CSIT | return the list of PDP groups and subgroups together with the policies that are deployed on each PDP group and subgroup. | CSIT - DONE | |||||||
4 | Create PDP | 7 | UNDeploy policy to PDP group & subgroup | PAP docker image is availableAPI docker image is available NOTE: PDP's not needed for this test in Dublin. | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | Based on test #5 - undeploy those policies | The component should create the relevant PDP group & subgroup in the database and return with operation success message/code. | CSIT CSIT - DONE | ||||||||
5 | Create a Policy | API
| API - pdps
|
| ||||||||||||
|
|
|
Triggered by merges in policy/drools-pdp
– policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | The Policy API should return code 201 and message "A new policy has been successfully created." | CSIT | |||
6 | Deploy policy to PDP group & subgroup | PAP docker image is available API docker image is available DMaaP simulator docker image is needed; a PDP can be simulated using curl | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | The component should map the relevant policies with the corresponding PDP group & subgroup in database. Deploy the policy in relevant PDP and return with operation success message/code. | CSIT |
7 | UNDeploy policy to PDP group & subgroup | PAP docker image is available API docker image is available NOTE: PDP's not needed for this test in Dublin. | API - pdps Method - POST Endpoint: https:{url}:{port}/policy/pap/v1/pdps | Based on test #5 - undeploy those policies | CSIT - DONE |
|
|
Test Case Id
Description
Pre-conditions
Test Steps
Expected Results
API – telemetry
Method - GET
Endpoint: https://<host>:9696/policy/pdpd/v1/engine
API – telemetry
Method - GET
Endpoint: https://<host>:9696/policy/pdpd/v1/controllers/<controller>
|
|
|
|
Triggered by merges in policy/drools-applications
...
Test Case Id
...
Description
...
Pre-conditions
...
Test Steps
...
Expected Results
...
API – telemetry
Method - GET
Endpoint: https://<host>:6969/policy/pdpd/v1/engine/healthcheck
...
Verify vFW use case.
Simulators should be installed.
...
- Add vFW Operational Policy
- Inject ONSET
- Trace the vFW use case across the complete sequence of messages
...
Verify Scale out use case.
Simulators should be installed.
...
- Add vDNS Operational Policy
- Inject ONSET
- Trace the vDNS use case across complete sequence of messages
...
Verify vCPE use case.
Simulators should be installed.
...
- Add vCPE Operational Policy
- Inject ONSET
- Trace the vCPE use case across the complete sequence of messages
...
|
| ||||
|
|
|
Triggered by merges in policy/drools-pdp
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
---|---|---|---|---|---|
1 | Alive | Verify that a PDP-D with no applications comes alive | API – telemetry Method - GET Endpoint: https://<host>:9696/policy/pdpd/v1/engine | Verify alive field | CSIT-DONE |
Triggered by merges in policy/drools-applications
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
---|---|---|---|---|---|
1 | Alive | Verify that the PDP-D + Control Loop Apps come alive | API – telemetry Method - GET Endpoint: https://<host>:9696/policy/pdp/engine | Verify alive field is set to 'true' | CSIT - DONE |
2 | Healthcheck | Verify that the PDP-D + Control Loop Apps passes healthchecks | API – telemetry Method - GET Endpoint: https://<host>:6969/healthcheck | Verify that the healthy field at the root object is set to 'true' | CSIT - DONE |
3 | Frankfurt | Verify that the PDP-D + Control Loop Apps - Frankfurt controller has been successfully brought up | API – telemetry Method - GET Endpoint: https://<host>:6969/policy/pdp/engine/controllers/frankfurt/drools/facts | Verify that a 200 OK is received indicating that there is a drools session associated with this controller that has been successfully instantiated. | CSIT - DONE |
4 | vFW | Verify vFW use case. Simulators should be installed. |
| Verify vFirewall completes successfully | CSIT |
5 | vDNS | Verify Scale out use case. Simulators should be installed. |
| Verify scale out completes successfully | CSIT |
6 | vCPE | Verify vCPE use case. Simulators should be installed. |
| Verify vCPE completes successfully | CSIT |
Triggered by merges in policy/xacml-pdp
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab |
---|---|---|---|---|---|
1 | Health Check | Xacml-PDP docker image available | API – healthcheck Method - GET Endpoint: http://<host>:6969/policy/pdpx/v1/healthcheck | The component should return health status as “true” Status code 200 | CSIT External Lab |
2 | Statistics | Xacml-PDP docker image available | API – statistics Method - GET Endpoint: http://<host>:6969/policy/pdpx/v1/statistics | The Xacml PDP should return statistics report consisting of 0 policies loaded and 0 decisions Status code 200 | CSIT |
3 | ExecuteXacmlPolicy | ||||
3a | CreateNewMonitorPolicy | API docker image available | API – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/api/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | The Policy API should return code 201 and message "A new policy has been successfully created." | CSIT |
3b | DeployMonitorPolicy | Xacml-PDP and PAP docker images available Policy created on the PAP | API – deployPolicy Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/deployPolicy | Successfully deploy a policy to the XACML PDP Statistics should increment policy count Status code 201 | CSIT |
3c | GetAbbreviatedDecisionResult | Xacml-PDP docker image available Test Case 4 success | API – decision Method - POST |
Triggered by merges in policy/xacml-pdp
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Lab | |||||
---|---|---|---|---|---|---|---|---|---|---|
1 | Health Check | Xacml-PDP docker image available | API – healthcheck Method - GET Endpoint: http://<host>:6969/policy/pdpx/v1/healthcheckdecision?abbrev=true | The component should return health status as “true”Xacml PDP should return a Decision object containing the decision and abbreviated policy results Status code 200 | CSIT External Lab | |||||
3c | GetAbbreviatedDecisionResult | 2 | Statistics | Xacml-PDP docker image available Test Case 4 success | API – statisticsdecision Method - GETPOST Endpoint: http://<host>:6969/policy/pdpx/v1/statisticsdecision?abbrev=true | The Xacml PDP should return statistics report consisting of 0 policies loaded and 0 decisionsa Decision object containing the decision and abbreviated policy results Status code 200 | CSIT/External Lab (stretch) | |||
3d | GetDecision | Xacml-PDP | 3 | ExecuteXacmlPolicy | 3a | CreateNewMonitorPolicy | API docker image available Test Case 5 success | API – decisionAPI – policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies Method - POST Endpoint: http://<host>:6969/policy/apipdpx/v1/policytypes/onap.policies.Monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | The Policy API should return code 201 and message "A new policy has been successfully created." | CSIT |
3b | DeployMonitorPolicy | Xacml-PDP and PAP docker images available Policy created on the PAP | API – deployPolicy Method - POST Endpoint: http://<host>:6969/policy/pdpx/v1/deployPolicy | Successfully deploy a policy to the XACML PDP Statistics should increment policy count Status code 201 | CSIT | 3c | GetAbbreviatedDecisionResult | Xacml-PDP docker image available Test Case 4 success | ||
/decision | The Xacml PDP should return a Decision object containing the decision Status code 200 | CSIT/External Lab (stretch) |
Triggered by merges in policy/apex-pdp
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT/External Labs |
---|---|---|---|---|---|
1 | Perform healthcheck of the component | Apex PDP docker image is available | API – healthcheck Method - GET Endpoint: https://<host>:6969/policy/ |
apex-pdp/v1/ |
healthcheck | The |
component should return health status as “true” Status code 200 | CSIT |
GetAbbreviatedDecisionResult
- DONE External Lab | |||||
2 | ExecuteApexPolicy | ||||
2a | CreateOperationalPolicyType | API |
docker image available |
API – |
policytypes Method - POST Endpoint: http |
The Xacml PDP should return a Decision object containing the decision and abbreviated policy results
Status code 200
GetDecision
Xacml-PDP docker image available
Test Case 5 success
API – decision
://<host>:6969/policy/api/v1/policytypes | 200 | CSIT - DONE External Lab | |
2b | CreateNewOperationalPolicy | API docker image available | API – policytypes/onap.policies.controlloop.operational.Apex/versions/1.0.0/policies |
Method - POST Endpoint: http://<host>:6969/policy/ |
api/v1/ |
The Xacml PDP should return a Decision object containing the decision
Status code 200
Triggered by merges in policy/apex-pdp
policytypes/onap.policies.controlloop.operational.Apex/versions/1.0.0/policies | 200 | CSIT - DONE External Lab | |
2c | DeployOperationalPolicy | APEX-PDP and PAP docker images available DMaaP Simulator available. Policy created | API – pdps/deployments/batch Method - POST Endpoint: http |
Test Case Id
Description
Pre-conditions
Test Steps
Expected Results
1
Perform healthcheck of the component
Apex PDP docker image is available
API – healthcheck
Method - GET
Endpoint: https://<host>:6969/policy/ |
pap/v1/pdps/ |
deployments/batch | 200 | CSIT - DONE External Lab |
2d | RunEventOnApexEngine | APEX-PDP docker image |
available |
2c succeeds | API – /apex/FirstConsumer/EventIn Method - |
POST Endpoint: |
http:// |
<APEX_IP>:23324/apex |
/ |
FirstConsumer/ |
3
Create Operational policies for the following use cases
- SampleDomain
- BBS (if this is not a POC)
Policy components up and running
(Will be added once API page approved)
(Current integration tests for REST client moved to CSIT)
Operational Policy should be created in apex-pdp
CSIT (Stretch)
...
EventIn | 200 | CSIT - DONE External Lab | |||
3 | Query component for statistics | Apex PDP docker image is available | API - statistics Method - GET Endpoint: https://<host>:6969/policy/apex-pdp/v1/statistics | The component should return the current statistics of the component. | CSIT (Stretch) |
Triggered by merges in policy/api
Test Case Id | Description | Pre-conditions | Test Steps | Expected Results | CSIT External Labs | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Healthcheck Perform healthcheck for policy design API service |
| API – healthcheck Method - GET Endpoint: http://<host>:6969/policy/api/v1/healthcheck | 200 | CSIT External Lab | |||||||
2 | Statistics Retrieve statistics of policy design API invocation |
| API – statistics Method - GET Endpoint: http://<host>:6969/policy/api/v1/statistics | 200 | CSIT External Lab | |||||||
3 | RetrievePolicyTypes Retrieve pre-loaded generic policy types |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 - all preloaded policy types | CSIT | |||||||
4 | CreateTCAPolicyTypeV1 |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 406 - policy type v1 is already preloaded | CSIT | |||||||
5 | CreateTCAPolicyTypeV2 |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 - v2 created | CSIT | |||||||
6 | RetrieveMonitoringPolicyTypes |
| API – policytypes Method - GET Endpoint: http://<host>:6969/policy/api/v1/policytypes | 200 - both v1 and v2 retrieved | CSIT | |||||||
7 | 6 | CreateNewMonitoringPolicyV1 Create a new TCA policy type for DCAE TCA microservice RetrieveMonitoringPolicyTypes |
| API – policytypes Method - GETPOST Endpoint: http://<host>:6969/ /policy/api/v1/policytypes /onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | 200200 - both v1 and v2 retrieved | CSIT | ||||||
78 | SimpleCreateNewMonitoringPolicyV1 Trying to create an existing policy with any change and same version should cause error. CreateNewMonitoringPolicyV1 Create a new TCA policy type for DCAE TCA microservice |
API – policytypes Method - POST | /policy/api/v1/policies | 406 - must supply new version | CSIT | |||||||
9 | SimpleCreateNewMonitoringPolicyV2 Create a new Monitoring TCA policiy version 2 using simple endpoint Endpoint: http://<host>:6969/ | /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | 200 - v2 created | CSIT | ||||||||
810 | RetrievePoliciesOfType Retrieve Monitoring related policy types SimpleCreateNewMonitoringPolicyV1 Trying to create an existing policy with any change and same version should cause error. |
| /policy/api/v1/policies | 406 - must supply new version | CSIT | 9 | API – policytypes/onap.policies.Monitoring Method - GET Endpoint: http://<host>:6969/ SimpleCreateNewMonitoringPolicyV2 Create a new Monitoring TCA policiy version 2 using simple endpoint/policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies | 200 - contains both v1 and v2 created | CSIT | |||
1011, 12 | RetrievePoliciesOfTypeDeleteSpecificPolicyV1 Retrieve Monitoring related policy typesDelete the Monitoring Policy Version 1 of the TCA Policy Type |
| API – policytypes / onap.policies.MonitoringMethod - GET Endpoint: http://<host>:6969/ /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/1.0.0 | 200 - contains both v1 and v2delete successful 404 - not found on 2nd delete attempt | CSIT | |||||||
1113, 1214 | DeleteSpecificPolicyV1DeleteSpecificPolicyV2 Delete the Monitoring Policy Version 1 2 of the TCA Policy Type |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/12.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT | |||||||
1315, 1416 | DeleteSpecificPolicyTypeV1 DeleteSpecificPolicyV2 Delete the Monitoring Policy Version 2 of the TCA Policy Type |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0/policies/onap.restart.tca/versions/2/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/1.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT | |||||||
1517, 1618 | DeleteSpecificPolicyTypeV1DeleteSpecificPolicyTypeV2 |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/12.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT | 17, 18 | DeleteSpecificPolicyTypeV2 |
| /policy/api/v1/policytypes/onap.policies.monitoring.cdap.tca.hi.lo.app/versions/2.0.0 | 200 - delete successful 404 - not found on 2nd delete attempt | CSIT404 - not found on 2nd delete attempt | CSIT |
Pairwise Testing
POLICY Pair Wise Testing for Frankfurt Release
Stability and Performance Testing
Jira | ||||||
---|---|---|---|---|---|---|
|
Results will be documented in the readthedocs: https://docs.onap.org/en/latest/submodules/policy/parent.git/docs/development/devtools/devtools.html#running-the-stability-performance-tests