Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Current ELK versions: elasticsearch 2.4, kibana 4.6  (no logstash is being used) 
  • To better create the dashboards with enhanced features and look, upgrading to version 5.6 is desired. (note: Logging project is using 5.5) 
  • Upgrade from 2.x to 5.x needs "Full Cluster-restart Upgrade". 

Feature Enhancements

  •  Any Any change of the validation/violation data being pushed to elasticsearch? 
  • violationDetails (which tells what is really different) need to be parsed (using logstash) or sent/stored by search-service (see the sample event below)? Kibana cannot use the such nested info in the visualizations.
  • Any other meta-data useful? e.g., who invoked the validation (user, dept) invoked the validation 


  (Note) Below are the current sample validation and violation events currently stored in ES.


                      


2. Dashboard Ideas

...


Dashboard TypeDescription (What To Want to See)Required Information To Show (Visualizations)
1Overall Audit MonitorAs a general admin, I want to see the whole platform integrity - health status in terms of all validation rules configured
  • validation total count ( for the specified time period)
  • violation total count ( for the specified time period)
  • validation count over time (trend)
  • violation count over time (trend)
  • violation count by rule type
  • violation count by rule severity
  • audit KPI trend: daily violation percentage metric against total validation count (weighted metric measure considering the severity level)
  • validation list
  • violation list
2Individual Audit AnalysisGiven a validation job, the user wants to see and quickly recognize all related relevant violations found by POMBA
  • validation details and relevant violation details on the same page
  • (stretch) given the same type of validation job, can we retrieve some the historical violation results to give an idea if this is really unusual case or it used to happen?
3


4Violation Analysiswhat kind of violations mostly occur in which components
  • violation stats by validation type
  • violation stats by validation rule
5Violation Analysis for Network Discovery

...