Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Issues & Decisions

will *Might

considered different paths 

  theer then kieran mccarthy prefer option 3 despite data (200 * 10 entries) 

IssueNotes Decision
1Is it intended that CM Notification subscription request  cover (all) descendants of the given xpath too?!e.g.. if a child is removed and there is a subscription for the parent node, will a notification be send (grandchild, child leaf updates etc.) I hope NOT!
Consider:
  • Risk of client effectively subscribing to ALL data in a cm handle by specifying top level datanode(s)
  • Complexity (i.e. cost of) of merge operation. It might even required NCMP to check relevant dat model
  • Future use of wildcards, could be a viable alternative for including descendants

kieran mccarthy descendant not covered by 'basic' paths Wildcard will cover this kind of function in future 

2Could xpath point to an element that does not exist (yet)if not how, how can I client be informed about a create event? 

kieran mccarthy  yes, xpath can point to things that dont exist yet (not even in the curernt model when an upgraded is pending)

3Should NCMP support re-homing, moving of a CM Handle from one DMI to another?assume only trough delete & create 

kieran mccarthy out of scope 

4CM Handle Delete: Should DMI or Clients be sent a subscription update 

do NOT delete dmi-subscription entry until owning subscription is deleted
(just ignore upon future delete if cm handle is gone altogether)

Note. LCM is already broadcast (today) 


kieran mccarthy re-use existing LCM event → also send it on topic for he subscription (currently fixed)
(might need to upgarde to CLoudEevent then too)

Note. need to add subscription if (name+client id) to header

5Validation of xpathoptions order of implement and also performance cost!
  1. none
  2. xpath-parser
  3. model check
  4. instance check

kieran mccarthy not required right now 

6can DMI plugin 'reject' a subscription create (for a given cm-handle-xpath combination)As NCMP might not validate as per issue#5 the DMI=plugin or component further down might have to reject an invalid xpath...

Priyank Maheshwari 

yes currently DMI can use response to say which cm handles are not accepted i.e. rejected' (but not 'pending') 

kieran mccarthyconfirm DMI can reject whole subscrptionsubscription

7implementation question: should 'rejected' DMI-subscriptions be storednot needed as whole subscription should be rejected

kieran mccarthyconfirm

8Dimensioning of DB depends on #cm handles, #subscriptions and #xpaths per subscription, this could be too big for fast processing of updates! Need to agree maximum and possibly realistic average/total number of entries based on the characteristics  above
The team is blocked until this becomes clear as it wil affect the way the data needs to be modelled exactly

9Maximum (error) message sizetheoretically all cm handles and all xpaths combinations could be rejected or pending leading to a very large error message!no longer relevant given and max decided 
10can each CM-Handle have different set of xpath(s) per subscriptionthe  current 'basic' solution only supports a common set of datastore/xpaths (filter)
11can the same cm handle/xpath have different subscriptions with different datastores, does that affect the cm data notifications send (which datastore applies)

12Will migration from 'basic' be supportedPreferred to ask customers to create new subscriptions

kieran mccarthy no need to support (migration) of 'basic' solution. Development of 'basic' solution can be stopped!

13list v list instances filtering

/p/c1
/p/c1[@key=23]


Are these diiffrent paths or not (from ncmp point of view)
*List instances might not always be supported, depending DMI Plugin impl.

kieran mccarthy

yes, from NCMP point of view a list and a list entry are different xpaths

14confirm subscription id (currently name + client id)

kieran mccarthy to clarify ASAP 


15what subscription details should be send when there is a change (in the union)
  1. just delta
  2. just union
  3. union and delta (delta flagged) 

(after initial meeting) kieran mccarthy & Toine Siebelink  agreed that because of the possible size of

the union (200x200x10=400,000) it is only feasible to send the delta ie option 1.


Solution Proposals 

Current state handling for 'basic' (not merged) subscription create/delete (under development)

...

draw.io Diagram
bordertrue
diagramNameDMI v Client Subscriptions
simpleViewerfalse
linksauto
tbstyletop
lboxtrue
diagramWidth521
revision34
 

Create Combinations

Below examples demonstrate what should happen when two separate subscriptions operations are performed:

...

#Existing Subscription A-10Client Create Subscription B-52 RequestDMI Sub Create Request
(union if changed)
Data Model Before (2nd) CreateData Model After Create
1CH-1, [ /p/c1, /p/c2 ]CH-1, [ /p/c1 ]None


Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10 ]


CH-1/p/c2[ A-10 ]




Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10, B-52 ]
B52CH-1/p/c2[ A-10 ]



2CH-1, [ /p/c1, p/c2 ]CH-1, [ /p/c2, /p/c3 ]CH-1, [ /p/c2, /p/c3 ]


Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10 ]

CH-1/p/c2[ A-10 ]




Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10 ]
B52CH-1/p/c2[ A-10, B-52 ]

CH-1/p/c3[ B-52 ]



3CH-1, [ /p/c1]
CH-2, [ /p/c1]
CH-2, [ /p/c1]
CH-3, [ /p/c1]Union
CH-1, [ /p/c1]
CH-2, [ /p/c1]
Added
CH-3, [ /p/c1]


Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10 ]

CH-2/p/c1[ A-10 ]




Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10 ]
B52CH-2/p/c1[ A-10, B-52 ]

CH-3/p/c1[ B-52 ]



4CH-1, [ /p/c1]CH-1, [ /p/c1/gc1 ]

CH-1, [ /p/c1

/gc1 ] (see issue #1)

/gc1 ]

*as per decision 1 the xpath to a parent does NOT include any children...


Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10 ]




Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10 ]
B52CH-1/p/c1/gc1[ B-52 ]



...

#Existing Subscription A-10Existing Subscription  B-52Client Delete A-10 RequestDMI UpdateSub update/delete requestData Model Before BeforeData Model After Delete
1CH-1, [ /p/c1, p/c2 ]CH-1, [ /p/c1 ]
CH-1, [ p/c2 ]


Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10, B-52 ]
B52CH-1/p/c2[ A-10 ]




Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10 ]

CH-1/p/c2[ A-10 ]



2CH-1, [ /p/c1]
CH-2, [ /p/c1]
CH-2, [ /p/c1]
CH-3, [ /p/c1]Union

CH-2 [ /p/c1]
CH-3, [ /p/c1]Deleted
CH-1, [ /p/c1]



Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10 ]
B52CH-2/p/c1[ A-10, B-52]

CH-3/p/c1[ B-52 ]




Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
B52CH-2/p/c1[ B-52 ]

CH-3/p/c1[ B-52 ]



3CH-1, [ /p/c1]

CH-1, [ /p/c1]
CH-2, [ /p/c1]

None


Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
A10CH-1/p/c1[ A-10 ]
B52CH-1/p/c2[ A-10, B-52 ]




Expand
titleData Model...


Client  Subscription
DMI Subscription
nameclient-idcm-handlexpathsubscribers
B52CH-2/p/c1[ B-52 ]



...


Previous InteractionCurrent InteractionExpectationNotes
1any operation on rejected for non-existing cm-handleoperation for same non-existing cm-handlelisted in 'rejected' immediatelybehavior as normal
2create operation rejected by DMIcreate for same cm-handle/xpathtry again ?!
3create pendingcreate for same cm-handle/xpathTBD send again or just remain pending?!
4create pendingdelete for same cm-handle/xpath

5delete pendingdelete for same cm-handle/xpathalso being considered for 'basic' delete

6delete pendingcreate for same cm-handle/xpathalso being considered for 'basic' delete

7



Performance considerations

...