Policy R9 Istanbul Team Scrums

https://logs.onap.org/onap-integration/daily/

Check Honolulu, Guilin, Frankfurt and master Health check

(NOTE: in future may need to check other tests)

some lab tests latest honolulu - opened 3454 some errors accessing swagger endpoint in drools-apps.

I think this relates to the CDS addition, some changes in transitive libraries dependencies underneath causing the issue

Fixed APEX CSIT.

Continue with POLICY-3336 - cleanup of task fields

Internal Workshop

POLICY-3410: multicluster; add unique name to PdpMessage

POLICY-3405: multi-cluster; handling of PdpStatistics

POLICY-3077: sonars in various repos

POLICY-3405: continue

POLICY-3450: Provide ability in pap to turn on/off pdp statistics

Code reviews

POLICY-3418: Control Loop Monitoring and Reporting

POLICY-3410: multicluster; add unique name to PdpMessage

POLICY-3405: multi-cluster; handling of PdpStatistics

POLICY-3406: multi-cluster; handling of consolidated health check

Apex-PDP prod issue

Code reviews

Internal meetings

POLICY-3336 Functionality implementation part merged.

POLICY-3418: Control Loop Monitoring and Reporting

POLICY-3383 Standardize policy deployment vs undeployment count in PdpStatistics

POLICY-3305: master branch cherry pick

INT-1938: oparent upgrades

POLICY-3426: multicluster; always check DB on PDP response

POLICY-3410: multicluster; add unique name to PdpMessage

POLICY-3329: Released apex-pdp & distribution docker image from honolulu branch

POLICY-3382: Cherry pick the changes to Honolulu branch of models & parent.

Code reviews

Apex-PDP prod issue

POLICY-3367: create-tables.sql: add IF NOT EXISTS clauses

POLICY-3305: xacml-pdp private to protected methods - Honolulu

Released xacml-pdp

Bump xacml-pdp Honolulu version

POLICY-3305: master branch cherry pick

POLICY-3329: release api, pap for Honolulu

POLICY-2898: support multi-cluster/multiple PAPs

POLICY-3329: Released apex-pdp & distribution maven artifacts from Honolulu branch

Internal apex-pdp prod issue

Code reviews

POLICY-3336 - multiple outputs from a state in APEX - Raised a review

Continue

POLICY-3305: xacml-pdp private to protected methods

POLICY-3382: Review raised for adding policy chaining section in drools-apps document.

POLICY-3329: Released common & models from Honolulu branch

Code reviews

POLICY-3336 - multiple outputs from a state in APEX

Updating existing policies to do the testing.

POLICY-3403: Code Coverage for clamp-common; Review Raised

POLICY-3242: Test Jar for examples; Review Raised

Continue with Code Coverage for Participant

Look into POLICY-3341: Enhance TOSCA and Control Loop Life Cycle Management

POLICY-2898: support multi-cluster/multiple PAPs

Internal tasks

POLICY-3382: Review raised for adding PNF policy chaining example in models.

POLICY-3329: Released parent from Honolulu branch

Code reviews

POLICY-3336 - multiple outputs from a state in APEX

Doing initial round of testing at the moment.

POLICY-3403: Code Coverage for clamp-common; Review Raised

POLICY-3242: Test Jar for examples; Review Raised

Continue with Code Coverage for Participant

Look into POLICY-3341: Enhance TOSCA and Control Loop Life Cycle Management

Internal + 3386: liveness to recover  against stuck sessions

POLICY-3077: new checkstyle warnings

POLICY-3389: use lombok annotations

POLICY-2898: support multi-cluster/multiple PAPs

POLICY-3382: Review for adding VNF policy chaining example.

Code reviews

Internal sprint ceremonies

3386: liveness to recover  against stuck sessions

3397: drools-pdp build was failing, dependency changes surfaced wrong leaked nonnull annnotations.

POLICY-3094: sonars - filters in models

POLICY-3390: onap docker image upgrade

POLICY-3308: fix broken models build

POLICY-3394: lombok in policy-common

POLICY-3382: Tested and added a policy chaining example for drools-pdp for VNF

Code reviews

Setting up new laptop (Installing OS etc.)

POLICY-3242: Move examples in the TOSCA POC into a test Jar; Fixing review

POLICY-2899 - testing changes manually and audits are being created on deploy

got PAP docker running for e2e testing

3386: liveness to recover  against stuck sessions

3289: sonar security issues

POLICY-3077: sonars in models; updates to pap

POLICY-3390: update onap docker version

Policy Framework upgrade to Honolulu discussions

Code reviews

3289: other security issues,

3386: look into improving liveness checks in pdpd if sessions stuck.

POLICY-3077: sonars in pap, xacml, and models

POLICY-3384: rename simulator container, private keys in github

Assisting intern with environment setup

Drools-PDP prod issue 

POLICY-3382: Drools-PDP documents

Code reviews

POLICY-3242: Move examples in the TOSCA POC into a test Jar

POLICY-3077: sonars in pap, xacml, and models

POLICY-3384: used signed certificates in CSITs; use "message-router" for target names

POLICY-3242: Move examples in the TOSCA POC into a test Jar

Review CL Design and Architecture Page

POLICY-3333: field name in bean validation error messages

POLICY-2874: slow API call

Testing latest PAP & Drools PDP snapshot in policy-k8s lab

Code reviews

POLICY-3333: field name in bean validation error messages

POLICY-2874: slow API call

POLICY-3338: CDS upgrade work. Synced up with CDS team and they seem to know about breaking the backward compatibility and probably missed informing clients.

Internal Honolulu upgrade plan work out.

Code reviews

Swagger documentation generation for Control Loop

Code Reviews

Studying the documentation on CL

POLICY-2899

PAP side - registering the audits

POLICY-3331: continue + look into CLAMP installation

POLICY-3077: sonars in common, models

POLICY-2898: multi-cluster support

POLICY-3317: update document tracking table

POLICY-3333: field name in bean validation error messages

Created POLICY-3340 for PAP rest api to fetch audit information.

Updated the swagger, final version available here - PAP REST API changes for Istanbul release

Discussions with Robertas on duplicate records returning 406 in policy-api.

Internal sync up on PF upgrade to Honolulu version

Code reviews

Swagger documentation generation for Control Loop

POLICY-3339: Verify that "policies" field has been removed from other resources - Review raised

Studying the documentation on CL

POLICY-2899

PAP side - registering the audits

Updated the pap swagger as per feedback from everyone - PAP REST API changes for Istanbul release

Discussions with Adheli on work for storing audit information in DB for deploy/undeploy

Looked at CPS project on how they are utilizing liquibase

Code reviews

Swagger documentation generation for Control Loop

POLICY-3339: Verify that "policies" field has been removed from other resources - Review raised

Studying the documentation on CL

POLICY-2899

PAP side - registering the audits

Internal

Trying to create a PDP group with configuration (PapDb,json) in charts, but this file is embedded in jar and always starts with defaultGroup

Continue

POLICY-2418: use bean validation, if appropriate, in xacml-pdp

POLICY-3329: Released pap 2.4.3 maven & docker artifacts

Code reviews

Testing delta policy changes in APEX.

OOO

Going through Control Loop documentation

POLICY:3323;POLICY-3263 - reviews 

POLICY-3188: support policy deltas in xacml-pdp

POLICY-2874: add indexes to Op History table

POLICY-3298: broken junits in policy-distribution

POLICY-2898: multi-cluster support

Created swagger specifications for the PAP REST API changes - PAP REST API changes for Istanbul release

Code reviews

POLICY-2899 - models code review

working on PAP - create audits

Set up lab for Ajith with honolulu official

Regression tests with snapshot and configuration in pfpp tenant (honolulu base + snapshots)

AAF generated certificates have old names in OOM, and incorrect names for drools, there's no side effects as only used for telemetry, but better clean up entries and fix them.

Set up the other lab policy-k8s with master (pfpp in honolulu)

Finishing up testing around OOM changes.

Internal meetings.

Set up the other lab policy-k8s with master (pfpp in honolulu)

Set up lab for Ajith with honolulu official

Regression tests with snapshot and configuration in pfpp tenant (honolulu base + snapshots)

POLICY-2898: policy should work in multi-cluster environment

Investigate issues that Perapalla is experiencing

Investigate csit verify jobs

POLICY-3257: Cherry pick all the csit test changes done in master branch to honolulu.

All the verify csit & build csit jobs are working in honolulu branch as well.

Code reviews

OOO yesterday afternoon

POLICY-3321: Apex-pdp should reply with complete policy list

Continue testing.

Release xacml and drools.

PTL JIRAs for M1

Continue

POLICY-2898: policy should work in multi-cluster environment

POLICY-3232: Provide capability in apex-pdp oom helm charts to mount truststore file during startup.

Made some good progress. import-custom-cert script in common had to be moved from bash to sh.

Continue.

POLICY-3320: investigation of CSITs for clamp.

Continue.

Updating wiki page.

POLICY-2429: archive policy-engine and mark it read-only/unmaintained

tagged policy repos

PTL JIRAs for M1

Continue

POLICY-2898: policy should work in multi-cluster environment

POLICY-3257: Investigating how to trigger verify csit in policy/docker gerrit reviews.

Worked with Ajith on testing certificate work in oom.

Code reviews

Working on feedback on POLICY-3263

POLICY-3255: Create Policy API calls for SimpleToscaServiceTemplateProvider → testing

Continue

POLICY-3256 Create new methods in tosca provider for get and delete of non-default policies

POLICY-3155 Use python3 for CSITs

3257: sonar security vulnerabilities

3230: disable https/auth telemetry, conform with removal of keystore - csits

3257: csits, robot failing honolulu - 0 facts

Internal

continue

POLICY-3307: remove frankfurt jobs from jenkins

POLICY-2429: remove policy-engine jobs from jenkins

POLICY-3299: trigger CSITs on docker mergers

POLICY-2429: archive policy-engine and mark it read-only/unmaintained

POLICY-2898: policy should work in multi-cluster environment

POLICY-3269: disable guard checks

POLICY-3257: Removal of csit files from individual repos.

Code reviews

POLICY-3232: Provide capability in apex-pdp oom helm charts to mount truststore file during startup. 

Waiting for feedback from Sylvain.

POLICY-3255: Create Policy API calls for SimpleToscaServiceTemplateProvider → test changes today

Draft doc on PAP work

Continue

3230: http/https and credentials detection in scripts: review out

3289: vulnerabilities sonar reports

Working on CSIT.

also working on sonar fixes for policy-gui.

POLICY-3257: Looked at csit test failures

Code reviews

Discussion about audit logging feature with Adheli & others.

POLICY-3306: Fix issue where apex-pdp test is failing in gitlab.

POLICY-3232: Provide capability in apex-pdp oom helm charts to mount truststore file during startup

POLICY-3255: Create Policy API calls for SimpleToscaServiceTemplateProvider

POLICY-3263: Changed to WIP → Wiki created to work on solution

Documentation started on PAP work

Continue

POLICY-2899 - meeting about aligning the solution and wiki created.

POLICY-3257: Raised multiple reviews to fix xacml-pdp & drools-applications tests.

Code reviews

POLICY-3263: Working on review comments - WIP

• Creating a Wiki page so we can collaborate on a solution for this.

POLICY-3255: Create Policy API calls for SimpleToscaServiceTemplateProvider

Continue POLICY-3255

POLICY-2899 - review on suggested database changes

POLICY-3252 - checking the oom repo for mariadb configurations

POLICY-3303: Update the default logback.xml in APEX to log to STDOUT

POLICY-3232: Provide capability in apex-pdp oom helm charts to mount truststore file during startup.

POLICY-3263: Review raised

POLICY-3255: Create Policy API calls for SimpleToscaServiceTemplateProvider

Continue POLICY-3255

Continue

POLICY-3269: disable guard check

POLICY-3257: Review raised for drools-pdp, drools-apps, xacml-pdp, distribution csit test cases.

POLICY-3195: Validation done successfully, closed the jira.

Code reviews

POLICY-3107: Updated documentation and postman collection for testing apex-pdp changes for handling delta policies (Test Cases for Apex-pdp recent changes)

POLICY-3263: Review Ready

Continue, POLICY-3255

Moved db related jiras into their own epic POLICY-3297 

Created Jira relationships WIKI: JIRA Relationships and Sequencing - Developer Wiki - Confluence (onap.org)

POLICY-3257: Review raised for pap csit test cases.

POLICY-3195: Worked with Ajith on validation of Kafka SSL with Bell Preprod Setup. The test was successful. Now we need to move on and work on OOM charts for the same.

Code reviews

Continue, POLICY-3255, POLICY-3263

POLICY-3257: Review raised for csit test cases to cover statistics & status api's.

POLICY-3195: Worked with Ajith on validation of Kafka SSL with Bell Setup. We were able to execute a policy end to end using Kafka as input & output mechanism.

Code reviews

Looking into stackoverflow issue in APEX. Raised a review.

Continue

POLICY-3255: Create Policy API calls for SimpleToscaServiceTemplateProvider 

POLICY-3263: Update PAP to only check for deployed policies

POLICY-3265: CSITs

POLICY-3262: Refactor UsecasesEventManager

POLICY-3261: Rules need a way to release locks

POLICY-3262: Continue

POLICY-3257: Create csit test cases for statistics & status api's.

POLICY-3195: Validation of Kafka SSL with Bell Setup.

Code reviews

POLICY-3255: Create Policy API calls for SimpleToscaServiceTemplateProvider 

POLICY-3263: Update PAP to only check for deployed policies

POLICY-3248: Refreshed the policy-k8s lab and verified the fix. PdpHeartbeat processing seems fine.

Code reviews

Continue

Validate few other API's in PAP & API.

Start on POLICY-3195 in parallel.

POLICY-3227 Changing executionProperties to improve context album handling.

Helping folks with issues in APEX standalone setup.

POLICY-2899 - store audit details of deploy/undeploy op

Continue

• testing if envers configuration can be applied to policy pdp models

POLICY-3248: Worked with Ajith on fixing the issue. Will be testing it again in the lab today.

Code reviews

POLICY-3248 PdpHeartbeats are not getting processed by PAP

POLICY-3227 Changing executionProperties to improve context album handling.

POLICY-3170: Review Comments 

Internal Training