| Dashboard Type | Description (What To Want to See) | Required Information To Show (Visualizations) |
|---|
| 1 | Overall Audit Monitor | - As a general admin, I want to see the whole platform integrity - health status in terms of all validation rules configured
| - validation total count for the specified time period
- violation total count for the specified time period
- validation count over time (trend)
- violation count over time (trend)
- violation count by component involved
- violation count by validation rule
- violation count by rule severity
- audit KPI trend: daily violation metric against total validation count (weighted measure considering the severity level)
- validation list
- violation list
|
| 2 | Overall Audit Analysis | - What kind of validations mostly executed against which models
- What kind of violations mostly occur in which components
| - validation stats (e.g., validationId or serviceInstanceId count) by modelInvariantId and modelVersionId
- which models made how many violations of which type
- violation stats by validation model, rule, etc.
- provide the views from the perspective of each component
|
| 3 | Individual Audit Analysis | - Given a validation job, the user wants to see and quickly recognize all relevant violations detected by POMBA
| - validation details and related violation details on the same page
- (stretch) given the same type of validation job, can we retrieve the historical violation results to give an idea if this is really unusual case or it used to happen?
|
| 4 | Violation Summary Report | - Provide a table of violation cases for any potential fixes
| - list of up-to-date violations with detail info helping to raise/fix any issues
|
| 5 | Audit History | - For the exactly same validation request, check the result change over time (invalidity could reduce be decreasing with fixes, or a valid case before could turn to be invalid?)
- For the same validation category (e.g., with the same rule and model id, component set?), the user wants to be ensured that the violation has been fixed and gone now, and wants to get an insight on how much the POMBA helps improve the overall system integrity
| - violation stats over time for the same validation job (e..g, 3 violations reduced to 2 and then 0 now)
- violation stats over time for the same validation category (e..g, 10 violations reduced to 2 now)
- KPIs showing the violation resolution trend (e.g., how many violations have been fixed on daily basis)
|
|
|
|
|
