OOM Meeting Notes - 2021-03-31

Agenda:

• RC0/RC1: Sylvain Desbureaux Krzysztof Opasiak
  • what's left:
    • SDNC / CDS / A1P version bump: https://gerrit.onap.org/r/c/oom/+/118284
      • Dan Timoney pushed the patch on February 23th
      • with OOM break, it has not been touched for 2 weeks
      • after it, we saw it wasn't working last week
      • lots of change done during these last days
      • it seems that SDNC behaves OK since yesterday
      • but gate has still random results
    • a new SO component / change: https://gerrit.onap.org/r/c/oom/+/120022
      • renaming VFC adapter to sol 005 adapter
      • version bump
      • should be OK to merge if gate is OK
    • UUI: https://gerrit.onap.org/r/c/oom/+/119844: waiting for TSC vote
    • DCAE: https://gerrit.onap.org/r/c/oom/+/119996 is for Honolul (Bootstrap bump in order to remove Holmes). Other are for Istanbul
    • DOC: https://gerrit.onap.org/r/c/oom/+/114380
    • OOF STDOUT: https://gerrit.onap.org/r/c/oom/+/113414
    • DMAAP : https://gerrit.onap.org/r/c/oom/+/114278 (make ZK and Kafka be able to scale up/down)
• Maintenance release: Sylvain Desbureaux
  • two patches on guilin:
    • certificates update for MR: https://gerrit.onap.org/r/c/oom/+/119912 / https://gerrit.onap.org/r/c/oom/+/118913
    • CCSDK mount bugfix: https://gerrit.onap.org/r/c/oom/+/119418
• Resuming merge of new patches:
  • will be done as soon as we have branched honolulu (the day of RC0)
• Too many certificates requests with AAF: Andreas Geissler

On guilin "old" deployment

• • problem started on DCAE pods because of issue when retrieving certificates from AAF
  • msg from AAF:

    INFO [service] user=deployer@people.osaaf.org[BAth],ip=10.233.68.159,port=42750,ms=211.37689,status=403,meth=PUT,path=/cert/local,msg="Request New Certificate/ErrResp [SVC1403] Forbidden: There are too many Certificates generated for CN=dcae for dcae@dcae.onap.org" 

  • if you have more than 200 entries, you need to remove entries in `cert` and `x509` databases:

  • cqlsh> use authz; 
    cqlsh:authz> delete from cred where id = 'dcae@dcae.onap.org';
    cqlsh:authz> select * from cred where id = 'dcae@dcae.onap.org'; id | type | expires | cred | notes | ns | other | prev | tag
    ----+------+---------+------+-------+----+-------+------+-----(0 rows)cqlsh:authz> select count(*) from x509 where ca = 'local' and id = 'dcae@dcae.onap.org';
    -> if there are more than 200, you need to delete them manuallycqlsh:authz> select ca, serial from x509 where ca = 'local' and id = 'dcae@dcae.onap.org';
    cqlsh:authz> delete  from x509 where ca = 'local' and serial = 0x00e591f558ae34e9f0;
    ...
    
    
    

  • short term:
    • cronjob?
    • add it as workaround in OOM release note and main release note
  • medium term:
    • get rid of AAF
    • finalize prototyping of Service Mesh (istio)
• Tracing tools and ONAP: Illia Halych Valdi
  • today nothing is really in place
  • service mesh can be used
  • but to have full fledged tracing, things have to be done on components:
    • look at https://gerrit.onap.org/r/c/so/+/119420
    • with this patch:
      • if on service mesh, it should work "out of the box"
      • if not, it should work by configuring jaeger endpoint (see spring sleuth configuration https://spring.io/projects/spring-cloud-sleuth)
• Proposal for intern: adjourned to next week

postmortem of last so gates: