You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 18 Next »

Summary: Edge Scoping 

Cloud Infrastructure for Distributed Clouds (5G etc.) – ONAP R3+ Cloud Infrastructure ModelingCloud Infrastructure Aggregate Representation Classes 


ONAP ComponentLife Cycle PhaseEnhancements
PolicyDesign

Define Distributed Cloud Infrastructure Placement Policies (Note 3)

  • Leverage Standardized Distributed Cloud Infrastructure Object Hierarchy & Capabilities from A&AI
Multi-CloudDeploy

Support Distributed Cloud Infrastructure Capability Discovery (Note 1, Note 2)

For workload instantiation, translate cloud-agnostic intent from SO into cloud-specific placement attributes (Note 7)

A&AIDeploy

Support Standardized Distributed Cloud Infrastructure Object Hierarchy & Capability Database

  • Loose coupling between HW objects (private cloud) and SW objects (private and public clouds)
  • Includes Standardized Capabilities across clouds & Capabilities unique to certain clouds
  • Note:
    • Multi-Cloud Distributed Cloud Infrastructure Capability Discovery process will populate the aforementioned database
OOFDeployExecute Distributed Cloud Infrastructure Placement Policies for Optimized Service/VNF Placement across Cloud Regions (Note 4)
SODeployExtend SO↔OOF API to support cloud agnostic intent (Note 5)

Assumption for Policy, SO, OOF:

  • This uses the current Generic VNF workflow in SO

Note 1: 

  • Configured Capacity and Utilized (or Currently Used) Capacity are managed by the specific cloud.

Note 2:

  • Cloud SW Capability example 
    • Cloud region "x" with SR-IOV, GPU, Min-guarantee support
    • Cloud region "y" with SR-IOV support
  • Cloud HW Capability example 
    • Resource cluster "xa" in Cloud region "x" with SR-IOV and GPU support 
    • Resource cluster "xb" in Cloud region "x" with GPU support
    • Resource cluster "ya" in Cloud region "y" with SR-IOV support

Note 3:

  • 5G Service/VNF placement example
    • Constraints used by Optimization Framework (OOF)
      • 5G CU-UP VNF location is fixed to a specific physical DC based based on subscriber group

      • 5G CU-CP VNF to 5G CU-UP VNF Data Center connectivity latency cannot exceed certain value

    • Optimization Policy used by OOF
      • Choose optimized cloud region (or instance) for the placement of 5G CU UP/CP for subscriber group based on the above constraints

Note 4:

  • For the 5G Service/VNF placement example in Note 3
    • 5G CU-UP VNF maps to a specific Cloud region & Physical DC End Point
    • 5G CU-UP VNF maps to one or more Cloud region(s) 

Note 5:

  • For the 5G Service/VNF placement example in Note 3
    • OOF will pass the Physical DC End Point to SO as a cloud agnostic intent

Note 6:

  • For the 5G Service/VNF placement example in Note 3
    • SO passes the Physical DC End Point to Multi-Cloud as a cloud agnostic intent, besides the Cloud Region

Note 7:

  • Cloud agnostic placement attributes are targeted to abstract the following cloud specific placement attributes
    • HPA attributes (e.g. Smart NIC Family, GPU Family) based on Cloud specific HW/SW support
    • Normalized CPU capacity for VMs/Containers based on Cloud specific HW support
    • Fine-grained Placement attributes based on Cloud specific SW support
      • e.g., Rack-level Anti-affinity-> Azure: Fault-Domain, AWS: Placement-Group 
      • e.g., Exclusivity ->                   Azure: Isolated VM, AWS: Dedicated Host 
      • e.g., Fine grained QoS ->       VMware Minimum guarantee, Kubernetes Burstable Class
  • For the 5G Service/VNF placement example in Note 3
    • Multi-Cloud interprets cloud agnostic intent as Physical DC Endpoint and translates to cloud-specific placement attribute such as Availability Zone
      • For this example, each distributed physical DC is in a separate Availability Zone for a OpenStack-based Cloud

Cloud Infrastructure for Distributed Clouds (5G etc.) – Networking Focused (only the unique aspects from the previous section are brought out)

ONAP ComponentLife Cycle PhaseEnhancements
PolicyDesign

Define Distributed Cloud Infrastructure Network Realization Policies Per Cloud Region (Note 1)

  • Leverage Standardized Distributed Cloud Infrastructure Object Hierarchy & Capabilities from A&AI
Multi-Cloud (MC)Deploy

MC <-> SDN-DC (Private Cloud) or MC <-> Public Cloud interaction

  • Translate Cloud Agnostic intent to Cloud specific intent or imperative APIs
  • Return network endpoint (used for VNF placement)


SODeploy

Option 1: (SO -> MC -> Private/Public SDN-DC) -- desired

  • SO <-> MC IaaS Intent-based API (BesidesOne or more of Compute/Network/Storage/Analytics)

Option 2: (SO -> SDN-C -> MC → Private/Public SDN-DC)

  • SO <-> SDN-C interaction
    • SO uses the Generic Resource API (SDN-C NB) to SDN-C to determine the right Directed Graph to invoke
    • The Generic Resource API can be used to pass the cloud region and other cloud agnostic intent
  • SDN-C <-> MC IaaS Intent-based API
    • By looking up the directed graph, SDN-C calls MC with a programmable intent-based API which includes cloud region and other cloud agnostic intent

Note 1:

  • Intent-based API example 1
    • Intent: High Performance intra-DC data plane networking with no Host CPU usage

•Realization Possibilities
•Overlay in SmartNIC
•Gateway in SmartNIC
•Overlay in ToR
•Gateway in a ToR
•Gateway in a HW appliance
•Realizations which are fixed
•Underlay maps to ToR/Network Fabric
•No CPU usage for data plane networking maps to VMs/Containers with SR-IOV support

Cloud Infrastructure Impact – Definition, Creation & Management of Network Slice for 5G

Edge Automation Requirement:

Support three types of slices in the Cloud Infrastructure (Definition Reference: https://kubernetes.io/docs/tasks/configure-pod-container/quality-service-pod/)

  • Guaranteed Resource Slice (hard isolation) for various infra Resources (CPU/Memory/Network)
    • Max (limit), Min (request) are the same; resource guarantee is "Max"
    • Maps to 5G Applications such as Connected Car which fall in the category of ultra-reliable machine-type communications (ref. 1)
  • Burstable Resource Slice (soft isolation) for various infra Resources
    • Min (request) <= Max (limit); resource guarantee is "Min"
    • Maps to Burstable Network Slice such > 1Gbps broadband which fall in the category of extreme mobile broadband (ref. 1)
  • Best Effort Resource Slice (no isolation) for various infra Resources
    • No Min (request) ; resource guarantee is "None"
    • Maps to 5G Applications such as IoT which fall in the category of massive machine-type communications (ref. 1)

References:

Note:

  • Any VMs/Containers which are part of a resource slice will adhere to the specs of the resource slice

Assumption:

  • This uses the new Network Slicing workflow in SO (todo confirm)
ONAP ComponentLife Cycle PhaseEnhancements
PolicyDesign

Configuration Policies for Guaranteed, Burstable & Best Effort Cloud Infrastructure Resource Slices (this will apply to VMs/Containers also)

Placement Policies for Resource Slices

  • Higher (programmable) weight to Cloud Region which supports all three types of resource slices vs only two types of resource slices (Guaranteed/Best Effort)

Network Slice Allocation across several Clouds

  • Allocate a contiguous network slice for extreme mobile broadband (ref. 1) with a max. latency of 10ms
    • Maps to Burstable Resource Slice in the infrastructure with min./max. of CPU, Memory etc.
Multi-CloudDeployResource Slice Capability Discovery
A&AIDeploy

Resource Slice Capability per Cloud Region

  • Guaranteed/Burstable/Best Effort

Resource Slice Type

  • Guaranteed/Burstable/Best Effort
OOFDeploy

Execute Resource Slice Placement Policies for Optimized Service/VNF Placement across Cloud Regions


Aggregation Service

ONAP, as in R2, collects the statistics/alarms/events from workloads (VMs) and take any close loop control actions such as Heal a process, scale-out, restart etc.. In R3, infrastructure related statistics/alarms/events will be collected, generate actionable insights and take life cycle actions on the workloads.  Infrastructure statistics normally include performance counters, NIC counters, IPMI information on per physical server node basis.  To reduce the load on the ONAP, it is necessary that aggregated (summarized) information is sent to the ONAP from edge-clouds. 

As part of this activity, intention is to create aggregation micro-service that collects the data from physical nodes (over collected and other mechanisms), aggregate the information (time based aggregation, threshold based aggregation, silencing etc.,..) based on the configurable rules and export the aggregate data to DCAE.  This micro service can be instantiated by ONAP itself - one or more instances for edge-clouds at the ONAP-central itself using OOM, it could be instantiated at the edge-cloud using their own deployment tools or it could be deployed edge service providers at the regional site level.  

Impacted projects (development activities)

ONAP ComponentEnhancements
Overall
  • Define models to represent summation information (Alerts/statistics/Events) for various groups
  • Defining various groups such as CPU usage, Memory usage, file descriptor usage, NIC utilization, various HPA features etc...
Multi-Cloud
  • Development activities:
    • Prometheus based monitoring & summation
    • Support for collected for statistics collection from NFVI nodes.
    • Support for VES agent to send the aggregate data to DCAE (Used when the aggregate service is instantiated outside of ONAP control)
    • Support for DMAAP agent to send the aggregate data to DCAE (Normally used if the aggregate service is instantiated at the ONAP-Central.
    • Provide ability to add new plugins (to collect statistics as well as to export aggregation information)
    • Provide ability to upload the recording and alert rules (on per edge-cloud basis or set of edge-clouds basis)
    • Ability to auto-cleanup of time series DB (based on size allocated for this micro-service)
  • Edge-Cloud registration time (as part of ESR)
    • Check whether registration data indicates whether the aggregation service to be brought up). If so, inform the aggregation micro service to authentication and listen for statistics from that edge-cloud.
  • Run time
    • Collects the information (support for both pull/push).
    • Apply rules
    • Generate alarms
    • Export them via VES or DMAPP or any other plugins in future.
AAI & ESR
  • Development activities
    • Enhancements to ESR to indicate whether aggregation service is required for this edge-cloud at the ONAP.
    • Enhancements to ESR to indicate Multi-Cloud for Multi-Cloud to listen for connections and statistics requests from the edge-clouds. Information such as CA cert to use to authenticate the remote party or any other UN/PWD method.
PORTALESR portal related changes to take information about the edge-cloud (CA Cert and UN/PWD information)
DCAE & DMAPPNone expected??

Life Cycle stages related functions

ONAP ComponentLife cycle phaseActivities
AAI and ESRDeploy & Run time
  • Add/Modify/Delete recording and alerting rules
AAI and ESRRun time
  • Add/Modify/Delete Edge-cloud information
Multi-CloudRun time
  • Get Edge information from A&AI whenever Edge-Cloud is added or removed.
  • Prepare to wait for information from that Edge-cloud
  • Receive information from edge-cloud and put it in the time series DB.
  • Summation based on recording & alerting rules
  • Export information to DCAE via DMAPP or VES
  • No labels