Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

It is proposed to create an end-to-end streaming solution, from Persistence layer to Controller. A Proof of Concept will be constructed to document challenges and investigate performance characteristics.

An important observation as to why this solution will achieve O(1) constant space complexity is that the streams will not be terminated until they leave the Rest controller.

This will require adding Stream versions of CPS Core read operations, e.g.

...

draw.io Diagram
bordertrue
diagramNameCPS NCMP Proposed Dataflow
simpleViewerfalse
width
linksauto
tbstyletop
lboxtrue
diagramWidth522432
revision12

Here is a proposed end-to-end flow - a simplified example to show how greatly this can reduce memory usage:

...