Summary: Edge Scoping
Distributed Cloud Infrastructure Object Hierarchy, Cloud-agnostic Placement Policy & Homing Policies
Value:
- 5G VNF Placement
- Improve ONAP Deployability through Cloud-Agnostic Intent for Intra-DC Placement
References: ONAP R3+ Cloud Infrastructure Modeling; Cloud Infrastructure Aggregate Representation Classes
ONAP Component | Life Cycle Phase | Enhancements |
---|---|---|
Policy | Design | Define Distributed Cloud Infrastructure Placement Policies (Note 3)
|
Multi-Cloud | Deploy | Support Distributed Cloud Infrastructure Capability Discovery (Note 1, Note 2) SO ↔ MC IaaS intent-based workload instantiation API to support cloud agnostic intent for Compute/Network/Storage; MC to translate cloud-agnostic intent from SO into cloud-specific placement attributes (Note 7) |
A&AI | Deploy | Support Standardized Distributed Cloud Infrastructure Object Hierarchy & Capability Database
|
OOF | Deploy | Execute Distributed Cloud Infrastructure Placement Policies for Optimized Service/VNF Placement across Cloud Regions (Note 4) |
SO | Deploy | Extend SO ↔ OOF API to support cloud agnostic intent (Note 5) |
TBD (Multi-Cloud or OOF) | Deploy | Placement Service per Cloud Region
|
Assumption for Policy, SO, OOF:
- This uses the current Generic VNF workflow in SO
Note 1:
- Configured Capacity and Utilized (or Currently Used) Capacity are managed by the specific cloud.
Note 2:
- Cloud SW Capability example
- Cloud region "x" with SR-IOV, GPU, Min-guarantee support
- Cloud region "y" with SR-IOV support
- Cloud HW Capability example
- Resource cluster "xa" in Cloud region "x" with SR-IOV and GPU support
- Resource cluster "xb" in Cloud region "x" with GPU support
- Resource cluster "ya" in Cloud region "y" with SR-IOV support
Note 3:
- 5G Service/VNF placement example
- Constraints used by Optimization Framework (OOF)
5G CU-UP VNF location to be fixed to a specific physical DC based on 5G DU, bounded by a max distance from 5G DU
- Optimization Policy used by OOF
Choose optimized cloud region (or instance) for the placement of 5G CU UP for subscriber group based on the above constraints
- Constraints used by Optimization Framework (OOF)
Note 4:
- For the 5G Service/VNF placement example in Note 3
- 5G CU-UP VNF preferably maps to a specific Cloud region & Physical DC End Point
Note 5:
- For the 5G Service/VNF placement example in Note 3
- OOF will pass the Physical DC End Point to SO as a cloud agnostic intent
Note 6:
- For the 5G Service/VNF placement example in Note 3
- SO passes the Physical DC End Point to Multi-Cloud as a cloud agnostic intent, besides the Cloud Region
Note 7:
- Cloud agnostic placement attributes are targeted to abstract the following cloud specific placement attributes
- HPA attributes (e.g. Smart NIC Family, GPU Family) based on Cloud specific HW/SW support
- Normalized CPU capacity for VMs/Containers based on Cloud specific HW support
- Reference for CPU Normalization: https://d1.awsstatic.com/whitepapers/Demystifying_vCPUs.df200b766578b75009ad8d15c72e493d6408c68a.pdf
- Fine-grained Placement attributes based on Cloud specific SW support
- e.g., Rack-level Anti-affinity-> Azure: Fault-Domain, AWS: Placement-Group
- e.g., Exclusivity -> Azure: Isolated VM, AWS: Dedicated Host
- e.g., Fine grained QoS -> VMware Minimum guarantee, Kubernetes Burstable Class
- Cloud Agnostic Intent-based API – Example 1
- Intent: Rack-level Anti-affinity for VMs within a VNF
- Different Realization for different clouds
- OpenStack-based (open source, Wind River, VMware VIO)
- Heat Template – policy-group, anti-affinity policy
- Azure
- Fault-domain
- AWS
- Placement group
- OpenStack-based (open source, Wind River, VMware VIO)
- Cloud Agnostic Intent-based API with networking – Example 2
- Intent: Rack-level Anti-affinity for VMs within a VNF with High Performance intra-DC data plane networking
- Different Placement realization for different clouds
- OpenStack-based (open source, Wind River, VMware VIO)
- Heat Template – policy-group, anti-affinity policy
- Azure
- Fault-domain
- AWS
- Placement group
- OpenStack-based (open source, Wind River, VMware VIO)
- Networking
- Several Realization Options for Networking – not all options may be available in all clouds – the final realization choice could be based on least current resource usage or other criteria
- Overlay in DPDK-based switch/router
- Gateway in DPDK-based switch/router
- Overlay in SmartNIC - implies SR-IOV is enabled in VMs
- Gateway in SmartNIC
- Overlay in ToR - implies SR-IOV is enabled in VMs
- Gateway in ToR
- Gateway in a HW appliance
- The final choice is translated to cloud specific attributes
- Several Realization Options for Networking – not all options may be available in all clouds – the final realization choice could be based on least current resource usage or other criteria
- For the 5G Service/VNF placement example in Note 3
- Multi-Cloud interprets cloud agnostic intent as Physical DC Endpoint and translates to cloud-specific placement attribute such as Availability Zone
- For this example, each distributed physical DC is in a separate Availability Zone for a OpenStack-based Cloud
- Multi-Cloud interprets cloud agnostic intent as Physical DC Endpoint and translates to cloud-specific placement attribute such as Availability Zone
Intra-DC networking with Intent-based Cloud Agnostic API (SO → MC → Cloud Region)
References: https://wiki.onap.org/download/attachments/28379482/ONAP-mc-sdn-v2.pptx?api=v2; https://wiki.onap.org/download/attachments/11928197/ONAP-mc-sdn.pdf?version=1&modificationDate=1506518708000&api=v2
Value:
5G High Performance Networking
- Improve ONAP Deployability through Cloud-Agnostic Intent for Intra-DC network interconnect
ONAP Component | Life Cycle Phase | Enhancements |
---|---|---|
Policy | Design | Define Distributed Cloud Infrastructure Network Intent Per Cloud Region (Note 1)
|
Multi-Cloud (MC) | Deploy | MC <-> Private/Public SDN-DC – per cloud region interaction
|
SO | Deploy | (SO -> MC -> Private/Public SDN-DC) -- desired
|
Note 1:
- Cloud Agnostic Intent-based API example 1
- Intent: High Performance intra-DC data plane networking with no Host CPU usage
- Several Realization Options – the final realization choice could be based on least current resource usage or other criteria
- Overlay in SmartNIC
- Gateway in SmartNIC
- Overlay in ToR
- Gateway in a ToR
- Gateway in a HW appliance
- Realizations which are fixed
- Underlay maps to ToR/Network Fabric
- No CPU usage for data plane networking maps to VMs/Containers with SR-IOV support
- Cloud Agnostic Intent-based API example 2
- Intent: High Performance intra-DC data plane networking
- Several Realization Options – the final realization choice could be based on least current resource usage or other criteria
- Overlay in DPDK-based switch/router
- Gateway in DPDK-based switch/router
- Overlay in ToR
- Gateway in ToR
- Gateway in a HW appliance
- Realizations which are fixed
- Underlay maps to ToR/Network Fabric
- HW-assisted data plane maps to VMs/Containers with SR-IOV support
Cloud Resource Partitioning for Differentiated QoS
Value:
All use cases
5G deployment on constrained Edge DCs
Edge Automation Requirement:
Support three types of slices in the Cloud Infrastructure (Definition Reference: https://kubernetes.io/docs/tasks/configure-pod-container/quality-service-pod/)
- Guaranteed Resource Slice (hard isolation) for various infra Resources (CPU/Memory/Network)
- Max (limit), Min (request) are the same; resource guarantee is "Max"
- Maps to 5G Applications such as Connected Car which fall in the category of ultra-reliable machine-type communications (ref. 1)
- Burstable Resource Slice (soft isolation) for various infra Resources
- Min (request) <= Max (limit); resource guarantee is "Min"
- Maps to Burstable Network Slice such > 1Gbps broadband which fall in the category of extreme mobile broadband (ref. 1)
- Best Effort Resource Slice (no isolation) for various infra Resources
- No Min (request) ; resource guarantee is "None"
- Maps to 5G Applications such as IoT which fall in the category of massive machine-type communications (ref. 1)
Implementation:
- Leverage current HPA framework with appropriate extensions
References:
- https://metis-ii.5g-ppp.eu/wp-content/uploads/white_papers/5G-RAN-Architecture-and-Functional-Design.pdf
Driving Superior Isolation for Tiered Services using Resource Reservation -- Optimization Policies for Residential vCPE
-https://jira.onap.org/browse/OPTFRA-240
Note:
- Any VMs/Containers which are part of a resource slice will adhere to the specs of the resource slice
ONAP Component | Life Cycle Phase | Enhancements |
---|---|---|
Policy | Design | Configuration Policies for Guaranteed, Burstable & Best Effort Cloud Infrastructure Resource Slices (this will apply to VMs/Containers also) Placement Policies for Resource Slices
|
Multi-Cloud | Deploy | Resource Slice Capability Discovery |
A&AI | Deploy | Resource Slice Capability per Cloud Region
Resource Slice Type
|
OOF | Deploy | Execute Resource Slice Placement Policies for Optimized Service/VNF Placement across Cloud Regions |
Aggregated Infrastructure Telemetry Streams
ONAP, as in R2, collects the statistics/alarms/events from workloads (VMs) and take any close loop control actions such as Heal a process, scale-out, restart etc.. In R3, infrastructure related statistics/alarms/events will be collected, generate actionable insights and take life cycle actions on the workloads. Infrastructure statistics normally include performance counters, NIC counters, IPMI information on per physical server node basis. To reduce the load on the ONAP, it is necessary that aggregated (summarized) information is sent to the ONAP from edge-clouds.
As part of this activity, intention is to create aggregation micro-service that collects the data from physical nodes (over collected and other mechanisms), aggregate the information (time based aggregation, threshold based aggregation, silencing etc.,..) based on the configurable rules and export the aggregate data to DCAE. This micro service can be instantiated by ONAP itself - one or more instances for edge-clouds at the ONAP-central itself using OOM, it could be instantiated at the edge-cloud using their own deployment tools or it could be deployed edge service providers at the regional site level.
Impacted projects (development activities)
ONAP Component | Enhancements |
---|---|
Overall |
|
Multi-Cloud |
|
AAI & ESR |
|
PORTAL | ESR portal related changes to take information about the edge-cloud (CA Cert and UN/PWD information) |
DCAE & DMAPP | None expected?? |
Life Cycle stages related functions
ONAP Component | Life cycle phase | Activities |
---|---|---|
AAI and ESR | Deploy & Run time |
|
AAI and ESR | Run time |
|
Multi-Cloud | Run time |
|