Architecture

POC Scope

DataLake Feeder and DLAdmin delivery as service services under DCAE (dcaegen2/services repository)

dcaegen2/services

└── components

    ├── dl-handler

/

    │   ├── dl-admin
    │   └── dl-feeder

)

DLFeeder will support pluggable sources and datastore support
- DMAAP/Kafka as primary source (option to poll kafka broker for new topic?)
- Druid/Couchbase/Elasticsearch/Hadoop datastore support
ConfigBingingService integration to fetch deployment/run-time configuration

Integrate DLAdmin delivery as service under DCAE (dcaegen2/services/dl-handler/dl-admin). Will integrate the DL Admin UI into DCAE dashboard, which is built on portal SDK and serves as UAM for DCAE users/operation.
Integrate DLAdmin into DCAE-Dashboard

...

Other extension cases (stretch goal)

...

IBM