Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Use just for today - real meeting busted - zoom.us/j/7939937123


Meeting every 2 weeks at 1100 EST Tue - https://zoom.us/j/519971638

...

https://jira.onap.org/secure/RapidBoard.jspa?rapidView=143&view=planning.nodetail&epics=visible

Agenda

  • Michael: status no progress on logging related jiras involving dublin scope (code/tech) last week
  • Passed M2
  • Discussed in TSC and PTL meets - issue related to manifest vs k8s values.yaml overrides for casablanca and CMR releases
  • In architecture review for M3 -  (Addressed comments) Logging Dublin M3 Architecture Review
  • Working more for OOM lately - Created RKE script to replace rancher - pending work is to test HA - https://gerrit.onap.org/r/#/c/79067/ for 
    Jira
    serverONAP JIRA
    serverId425b2b0a-557c-3c0c-b515-579789cceedb
    keyOOM-1670
  • Assisting with ONS April demo prep - 2 or more ONAP installations working together - one as an edge cloud
  • Focused on onap devops - primarily for 2 customers deploying ONAP
  • 5G training next week
  • April 3-5 ONS
  • PTL position is open - let me know if anyone would like to take it.
  • Also quickly discussed idea of rolling LOG into OOM - should revisit
  • Pending committer for pomba - Committer Request for Trevor Tait and Committer Request for Pierre Rioux - will send out reviews once stats are completed - TSC review will be needed

Attendees 

Items

Attendees

Luke Parker , Prudence Au , Michael O'Brien , Sanjay,  Lorraine Welch

Agenda

Attendees 


Items


PTL 2019-01-14

Log Streaming Compliance and API

discussed at last PTL meet with Jason Hunt

Image Removed

El-Alto 1.4 logging spec change - plan only

todo merge with Dave's below

Dublin Scope Planning

Michael O'BrienRTD documentationGreenOpen

restart log4j format and files

exampleYellowIn Progress

https://gerrit.onap.org/r/#/c/62405/

for 630

and

PRITitleResponsible

Status

Status
colourGreen
titleOpen

PRITitleResponsible

Status

Status
colourGreen
titleOpen

Status
colourBlue
titleDone

In DublinLast Worked onStartNotes
Security Vulnerability templateOngoingIN20190122M1 template

Status
colourBlue
titleDone

IN2019012420190122ONS NA 2019 April Talk proposal

Status
colourBlue
titleDone

IN20190122

pending 20190208 decision

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-947

Use manifest generation over raw oom values.yaml docker image tag names

Status
colourBlue
titleDone

IN2019012420190117

pending documentation in RTD

Team,

    In the TSC it was decided to treat the diff between oom and the manifest by always running the manifest generated yaml in your deployments – you will not need to do this for master work – just for Casablanca and RC0-2 work

 

Working out the details in

https://jira.onap.org/browse/LOG-929

 https://onap.readthedocs.io/en/casablanca/submodules/integration.git/docs/index.html?highlight=manifest

/michael

S3P Logging compliance TSC/PTL

Status
colourYellow
titleIn Progress

IN2019011520190114

Status
colourYellow
titleIn Progress

IN20190122

Status
colourBlue
titleDone

IN20190124

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-707

Logging Dublin M1 Release Planning

In DublinLast Worked onStartNotes

Security Vulnerability templateOngoingIN
20190122

M1 template

Status
colour

Blue
title

Done

IN20180129Attending Thu 1130-1230 meets2019012420190122

ONS NA 2019 April Talk proposal

Status
colour

Blue
title

Done

IN20190111520190108
20190122

pending 20190208 decision

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-178

Log Streaming Compliance and API#DeploymentProfiles

Work with portal/sdk libraryMichael O'Brien

Status
colourYellow
titleIn Progress

IN2019012920190115

Update: 20190129 - Existing eclipse environ for the RI being retrofitted

At the pom stage bringing in the jar via

portal/sdk in use by aai, dmaap, sdk, vid (vid link into so maybe?)

Code Block
themeMidnight
<groupId>org.onap.portal.sdk</groupId>

epic

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-600

Jira

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyPORTAL-348

review investigation in

Logging Developer Guide

Log Streaming Compliance and API#ExistingLibraryResearch\

Luke Parker discussion

need to use the portal library in an initiating project for tx processing

working likely with the SO team - via the work we are doing for them in https://gerrit.onap.org/r/#/c/69947/

(check the original spec - ODL specific - check appc/sdnc use of ccsdk)

New Committers

Status
colourGreen
titleOpen

20190115

We have room for 2-5 committers and will be reviewing the list

Logging Enhancements Project Proposal#KeyProjectFacts

add your details to

Logging Committer Promotion Requests

20190129 status - waiting on contributor documentation from each contributor

OPNFV/ONAP Paris

947


Use manifest generation over raw oom values.yaml docker image tag names

Status
colourBlue
titleDone

IN2019012420190117

pending documentation in RTD

Team,

    In the TSC it was decided to treat the diff between oom and the manifest by always running the manifest generated yaml in your deployments – you will not need to do this for master work – just for Casablanca and RC0-2 work

 

Working out the details in

https://jira.onap.org/browse/LOG-929

 https://onap.readthedocs.io/en/casablanca/submodules/integration.git/docs/index.html?highlight=manifest

/michael


S3P Logging compliance TSC/PTL

Status
colourYellow
titleIn Progress

IN2019011520190114

PTL 2019-01-14

Log Streaming Compliance and API

discussed at last PTL meet with Jason Hunt

Image Added



El-Alto 1.4 logging spec change - plan only


todo merge with Dave's below

Status
colourYellow
titleIn Progress

IN20190122


Dublin Scope Planning


Status
colourBlue
titleDone

20190108

https://ddfplugfest19.sched.com/ Tue-Thu

Clover Gambia on prior https://zoom.us/j/115579117 - 7 hours ahead

https://ddfplugfest19.sched.com/event/K1Gy/opnfv-clover-utilizing-cloud-native-technologies-for-nfv

IN20190124

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-707

Logging Dublin M1 Release Planning


RTD documentationSecurity badging

Status
colourYellowGreen
titleIn ProgressOpen

IN20190129Need to restart this20180129
Attending Thu 1130-1230 meets

restart log4j format and files

example

Security Vulnerabilities

Status
colourYellow
titleIn Progress

IN20190129lower - but for M4

s3p Secure https endpoints

LOG + POMBA

Status
colourGreen
titleOpen

IN

Discussion on whether we need to lock down the nodeport exposed ports

Can key off POMBA work already done

todo: get s3p page

Format compliance - working with AAI team

+ perf

Status
colourYellow
titleIn Progress

IN201901152018110120190111520190108

https://gerrit.onap.org/r/#/c/62405/

for

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-630

and

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-178

Log Streaming Compliance and API#DeploymentProfiles


Work with portal/sdk libraryMichael O'Brien

Status
colourYellow
titleIn Progress

IN2019012920190115

Update: 20190129 - Existing eclipse environ for the RI being retrofitted

At the pom stage bringing in the jar via

portal/sdk in use by aai, dmaap, sdk, vid (vid link into so maybe?)

Code Block
themeMidnight
<groupId>org.onap.portal.sdk</groupId>

epic

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-600

Jira

(plus) 20190115 - casablanca cherry pick in queue logstack 5 to 3 and 1

https://gerrit.onap.org/r/#/c/75702/

(+) 20190109
from aai team
https://wiki.onap.org/display/DW/2019-01-17+AAI+Developers+Meeting+Open+Agenda
"hector has discovered that the stress test jar (liveness probe?) in aai-cassandra is hammering the cpu/ram/hd on the vm that aai is on - this breaks the etcd cluster (not the latency/network issues we suspected that may cause pod rescheduling) "

#6 on 2018-12-20 AAI Developers Meeting around

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-376

Discussion with @Sanjay Agraharam and [~pau2882] on checking how cassandra is running on the vm and if debug levels are on should be verified

use labelling to split aai-cs and ls - no DaemonSet

Michael O'Brien to reduce core count for ls to 1 from 3

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-915

edited 2019-01-10 AAI Developers Meeting

for the 10th

AAI team - 2 types of logging AOP/non-AOP

PORTAL-348

review investigation in

Logging Developer Guide

Log Streaming Compliance and API#ExistingLibraryResearch\

Luke Parker discussion

need to use the portal library in an initiating project for tx processing

working likely with the SO team - via the work we are doing for them in https://gerrit.onap.org/r/#/c/69947/

(check the original spec - ODL specific - check appc/sdnc use of ccsdk)





New Committers

Status
Status
colourGreen
titleOpen

IN20181101#22 on 2018-12-20 AAI Developers MeetingLogging requests from Vendors
20190115

We have room for 2-5 committers and will be reviewing the list

Logging Enhancements Project Proposal#KeyProjectFacts

add your details to

Logging Committer Promotion Requests

20190129 status - waiting on contributor documentation from each contributor


OPNFV/ONAP Paris

Status
colour

Green

Blue
title

Open

Done


20190108

https://ddfplugfest19.sched.com/ Tue-Thu

Clover Gambia on prior https://zoom.us/j/115579117 - 7 hours ahead

https://ddfplugfest19.sched.com/event/K1Gy/opnfv-clover-utilizing-cloud-native-technologies-for-nfv


Security badging

Status
colourYellow
titleIn Progress

IN20190129
Need to restart this
Security Vulnerabilities

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-877

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-876

#15,19 and 37 on SP priorities for Dublin

LOG Streaming compliance

Status
colourYellow
titleIn Progress

IN

Log Streaming Compliance and API

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-487

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-487

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-852

and

PTL 2019-01-14

opentracing via

https://opentracing.io/

IN (planning/POC for sure)20190123

@Sanjay

discuss integration - out of band processing -

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-104

see zipkin arch https://zipkin.io/pages/architecture.html

possibly tie both as a client of es ?

Tie in to ONS NA 2019 April demo booth for LF

https://lists.onap.org/g/onap-discuss/message/15066?p=,,,20,0,0,0::Created,,opentracing,20,2,0,22460823

20190129
lower - but for M4

s3p Secure https endpoints

LOG + POMBA

Status
colourGreen
titleOpen

IN

Discussion on whether we need to lock down the nodeport exposed ports

Can key off POMBA work already done

todo: get s3p page


Format compliance - working with AAI team

+ perf

Status
colourYellow
titleIn Progress

IN2019011520181101

(plus) 20190115 - casablanca cherry pick in queue logstack 5 to 3 and 1

https://gerrit.onap.org/r/#/c/75702/

(+) 20190109
from aai team
https://wiki.onap.org/display/DW/2019-01-17+AAI+Developers+Meeting+Open+Agenda
"hector has discovered that the stress test jar (liveness probe?) in aai-cassandra is hammering the cpu/ram/hd on the vm that aai is on - this breaks the etcd cluster (not the latency/network issues we suspected that may cause pod rescheduling) "


#6 on 2018-12-20 AAI Developers Meeting around

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-376

Discussion with @Sanjay Agraharam and [~pau2882] on checking how cassandra is running on the vm and if debug levels are on should be verified

use labelling to split aai-cs and ls - no DaemonSet

Michael O'Brien to reduce core count for ls to 1 from 3

Jira
serverONAP JIRA
serverId425b2b0a-

discussion - remove20190108

discuss tick/tock logging spec behaviour - cassablanca implemented in dublin, dublin implemented in elalto

Log CheckerOUT20190109MIke to review with HoraceSearch GuardMichael O'Brien

Status
colourGreen
titleOpen

Maybe20180109

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-494

spec changes for DublinIN (planning)2019010920190109

Dublin spec changes for Elalto

environment name

release name

check mail for reply Michael O'Brien

Prudence Au proposal of renaming the log file name itself for the release ie: 3.0.0-ONAP - will discuss later for next week

Cluster logging behaviour

S3P

IN

server name in clustered environments - I will add the details and the Jira right after this meet

-915

edited 2019-01-10 AAI Developers Meeting

for the 10th


AAI team - 2 types of logging AOP/non-AOP


Status
colourGreen
titleOpen

IN
20181101#22 on 2018-12-20 AAI Developers Meeting
Logging requests from Vendors

Status
colourGreen
titleOpen




Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-877

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-876

#15,19 and 37 on SP priorities for Dublin


LOG Streaming compliance

Status
colourYellow
titleIn Progress

IN

LOG ELK stack indexing/dashboards

with Prometheus below

Status
colourGreen
titleOpen

IN20190123

Casablanca 3.0.1 work until 10th Jan

Including POMBA

DONE2019012220190113

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-913

revert Jira for data-router off TSC-92 -

pending merge of https://gerrit.onap.org/r/#/c/75999/

LOG openlab tenant devops

cluster creation/testing

Done pending vFWIN

We have 2 clusters a 1+4 and 1+13 used for testing deployments and running the vFW

Logging DevOps Infrastructure

487

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-487

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-852

and

PTL 2019-01-14


opentracing via

https://opentracing.io/



IN (planning/POC for sure)20190123
Wiki edits, RTD review

Status
colourGreen
titleOpen

INRequiring Updates, Merges or Marked DeprecatedMetric Streaming and Prometheus

Status
colourYellow
titleIn Progress

IN20181207

@Sanjay

discuss integration - out of band processing -

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-

911 - experimental chart on http

104

see zipkin arch https://zipkin.io/pages/architecture.html

possibly tie both as a client of es ?

Tie in to ONS NA 2019 April demo booth for LF

https://lists.onap.org/g/onap-discuss/message/15066?p=,,,20,0,0,0::Created,,opentracing,20,2,0,22460823


discussion - remove


20190108

discuss tick/tock logging spec behaviour - cassablanca implemented in dublin, dublin implemented in elalto


Log Checker
OUT20190109
MIke to review with Horace
Search Guard

Status
colourGreen
titleOpen

Maybe20180109secure.solar:30000/graph

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-773

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-861

work with Vaibhav Chopra

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyOOM-1504

@Sanjay - note the prom chart assumes a k8s environment - what about bare metal

LOG-494


spec changes for Dublin
IN (planning)2019010920190109

Dublin spec changes for Elalto

environment name

release name

check mail for reply Michael O'Brien

Prudence Au proposal of renaming the log file name itself for the release ie: 3.0.0-ONAP - will discuss later for next week



Cluster logging behaviour

S3P


IN

server name in clustered environments - I will add the details and the Jira right after this meet



LOG ELK stack indexing/dashboards

with Prometheus below


Status
colourGreen
titleOpen

IN20190123


Casablanca 3.0.1 work until 10th Jan

Including POMBA

DONE
2019012220190113

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-913

revert Jira for data-router off TSC-92 -

Finish SO filebeat additions

Status
colourYellow
titleIn Progress

IN20181207

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keySO-1110

https://gerrit.onap.org/r/#/c/69947/

Finish LOG common charts

Status
colourGreen
titleOpen

OUT to El-alto2019012320181207

James MacNider - bring in Prianka's common eLK charts and use them in Clamp, LOG, SDC, POMBA

pending merge of

https://gerrit.onap.org/r/#/c/6476775999/

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyOOM-1276

rever to El-alto under

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-936

Team Members Thank you and review


LOG openlab tenant devops

cluster creation/testing

Done pending vFWIN

We have 2 clusters a 1+4 and 1+13 used for testing deployments and running the vFW

Logging DevOps Infrastructure


Wiki edits, RTD review

Status
colourGreen
titleOpen

IN

Requiring Updates, Merges or Marked Deprecated
Metric Streaming and Prometheus

Status
colourGreenYellow
titleOpenIn Progress

IN
20181207

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-911
- experimental chart on http://secure.solar:30000/graph

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-773

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-861

work with Vaibhav Chopra

del

Review last 4 weeks since 

LOG Meeting Minutes 2018-12-05

StatuscolourYellowtitleIn Progress

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
key

TSC

OOM-1504

@Sanjay - note the prom chart assumes a k8s environment - what about bare metal


Finish SO filebeat additions

Status
colourYellow
titleIn Progress

IN20181207

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keySO-1110

https://gerrit.onap.org/r/#/c/69947/


Finish LOG common charts

Status
colourGreen
titleOpen

OUT to El-alto2019012320181207

James MacNider - bring in Prianka's common eLK charts and use them in Clamp, LOG, SDC, POMBA

https://gerrit.onap.org/r/#/c/64767/

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyOOM-1276

rever to El-alto under

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-936



Team Members Thank you and review

Status
colourGreen
titleOpen

IN

del

Review last 4 weeks since 

LOG Meeting Minutes 2018-12-05


Status
colourYellow
titleIn Progress





TSC/PTL meet actions

Status
colourYellow
titleIn Progress





OOM transfer chart ownership to teams
LOG is part of poc

Status
colourYellow
titleIn Progress

IN20190107

Starting - will have a training session - will send out any meetings to onap-discuss

We may have the same symlink repo folder like we do for doc

Last discussed TSC 20180109


OOM Deployment priority
base platform includes LOG

Status
colourYellow
titleIn Progress

OUT

todo review with Mike Elliott

2019012320181207

Q2) priority of system level containers like the ELK stack - OOM has a common services JIRA - DMaaP, AAF - TODO get JIRA - make sure log is in this!

There is a cd.sh retrofit that sequences the pods in order for deployment stability - this will be phased out when tiered deployment comes in

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-898

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-326

https://gerrit.onap.org/r/#/c/75422/ via ONAP Development#WorkingwithJSONPath

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyDCAEGEN2-1067



k8s manifest or oom values.yaml
for docker tags - truth

Status
colourYellow
titleIn Progress


20190123

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyTSC-86

TODO: paste TSC review - manifest is truth

RTD doc link to run the script to get the yaml override


Nexus3 routing slowdown

Status
colourBlue
titleDone


20181222

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyTSC-79

20181217-22

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-898

LOG compliance diagram/exercise

Michael O'Brien

@Sanjay Agraharam

Status
colourYellow
titleIn Progress

20181205

Log Streaming Compliance and API

part of prometheus work now

Sanjay - diagram FB must be split between using AOP and AOP+spec compliant - only this one should be green

serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyLOG-898


LOG compliance diagram/exerciseOngoingCI/CD pipeline TSC poc

Michael O'Brien

@Sanjay Agraharam

Status
colourYellow
titleIn Progress

20180107

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyTSC-25

LOG is part of this poc

https://lists.onap.org/g/onap-discuss/topic/cd_task_force_tsc_25_meetings/29001640?p=,,,20,0,0,0::recentpostdate%2Fsticky,,,20,2,20,29001640

...

  •  

In Progress


20181205

Log Streaming Compliance and API

part of prometheus work now

Sanjay - diagram FB must be split between using AOP and AOP+spec compliant - only this one should be green










Ongoing






CI/CD pipeline TSC poc

Status
colourYellow
titleIn Progress


20180107

...


Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyTSC-

...

...

...


Notes