The CLAMP Kubernetes Participant performs the helm Helm chart installation and LCM for k8s Kubernetes (K8S) microservices that take part in Control looploops. It implements Participantthe participant-Intermediary API to receive events from DMaap and interact the CLAMP runtime and then interacts with Helm CLI. It acts as a wrapper around the Helm Cli CLI to manage helm Helm charts and K8s pods deployed in the cluster.
Helm 3 overview:
In Helm3, helm cli the Helm CLI acts as a interface to connect with an interface towards a Kubernetes cluster, and allows the user to deploy and manage helm charts. It also supports configuring configuration of multiple chart repositories to for the helm client and enables access to charts from those charts repos for installation of K8S microservices. The repositories can be a local chart server servers running on the same machine as well a or third party chart server servers running elsewhere. The URL of the a chart server is can be configured to on the helm Helm repo list to permit access the hosted charts. User can add a repository and push helm charts under the repository to be accessed during installationto Helm charts hosted in those repos. Users can add repositories and push Helm charts to the repositories via Helm CLI commands.
Example: configured Configured chart repos and the available charts are listed via helm cli:the Helm CLI
CLAMP Kubernetes Participant Architecture in Istanbul:
Prerequisites for kubernetes Kubernetes participant:
- Kubernetes cluster running.
- Helm cli running.
- Currently, the operator is expected to provide the repository information where the helm chart is available, via TOSCA /REST end point or ensure that the charts are available on the local storage directory of kubernetes-participant. (This directory is a preconfigured path specified on the participant config that acts as a local chart repository). Charts can be onboarded to local chart repository via REST endpoints.
Note: When using the Kubernetes participant in docker container, the config file of the Note: Incase of containerization of kubernetes participant in upcoming release, the kubeconfig file of required kubernetes cluster should be copied to the k8s-participant's docker container's home directory under /.kube folder in order to make helm cli the participant work with the external cluster outside.In Istanbul release, Kubernetes participant in control loop supports installation of helm charts in below ways:
- Installing a helm chart that is present in the local file system where the kubernetes participant is hosted.
- Installing any charts from the repositories that are configured on the helm client.
| draw.io Diagram | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
The K8s participant exposes rest end points through which below operations can be performed.
- Onboard a helm chart to the local directory. (A helm chart can be passed to the rest end point of k8s participant, it then stores the chart under the path /<pre-configured directory>/<chart name>/<version>/
- Delete a helm chart from the local storage.
- Install a helm chart in to the k8s cluster.
- Uninstall a helm chart in to the k8s cluster.
- Get all the charts available in the local chart storage directory.
It also implements participant-Intermediary APIs to interact with DMaap topic for control loop. When the Control loop element update event is received from DMaap, it invokes the helm client to install the corresponding chart based on the name and version of the chart.
|
In the Istanbul release, the CLAMP Kubernetes participant supports the following methods for installation of helm charts via CLAMP:
- Installation of a Helm chart that is present in the same local file system as where the kubernetes participant is hosted
- Installation of Helm charts from any remote helm repositories. (The remote repository details needs to be passed on via TOSCA or REST API to the kubernetes participant)
The CLAMP Kubernetes participant acts as a mediator between the CLAMP runtime and the Helm Client.
While commissioning a control loop, the Helm chart parameters are passed via TOSCA template to the control loop runtime database. And when the control loop is instantiated, the Kubernetes participant receives control loop element update event from the CLAMP runtime. It then invokes the Helm client running on the host machine to install the corresponding Helm charts associated with the affected control loop elements. The Kubernetes participant When the k8s-participant receives event update from DMaap , it gets the parameters (chart name, version, release name , and namespace) of the chart from the control loop runtime. If the repository is not passed of the chart had not been specified in the TOSCA, it does performs a lookup of the specified chart in "chart lookup" on all the configured repositories in the helm Helm client as well as on the local chart directory where the helm Helm charts are onboarded visa RESTmay be manually onboarded by the operator. It fetches the appropriate repository info and installs the chart via helm cli.the helm CLI.
The Kubernetes participant takes care of creating a namespace on the cluster if required, fetching the Helm chart from the available repositories, installing and uninstalling the chart in to the cluster. In upcoming releases, additional options will be supported in CLAMP for onboarding Helm charts to the repositories via TOSCA (both configured Helm repos and local chart directory) before instantiation. (Under discussion)
| draw.io Diagram | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
The code block below shows a Sample TOSCA service template passed during commissioning of control loops. Charts can be commissioned via TOSCA in the following mentioned ways:
- Chart parameters: chartId(name, version), releaseName and namespace are mandatory in TOSCA.
- Repository can be specified with either remote helm repository or any local directory where the helm charts are available.
. (Note: Repository name is an optional parameter in control loop TOSCA template. If not specified, the Kubernetes participant will do a look up on the local chart storage and configured helm repos)
| Code Block | ||||
|---|---|---|---|---|
| ||||
org.onap.domain.database.HelloWorld_K8SMicroserviceControlLoopElement: # Chart from anylocal file chartsystem repository(pre configuredonboarded onvia helmREST clientAPI). version: 1.2.3 type: org.onap.policy.clamp.controlloop.K8SMicroserviceControlLoopElement type_version: 1.0.0 description: Control loop element for the K8S microservice for Hello World properties: provider: ONAP participant_id: name: org.onap.k8s.controlloop.K8SControlLoopParticipant version: 2.3.4 chart: release_namereleaseName: helloworld chart_chartId: name: hello version: 0.1.0 repository: chartMuseum namespace: onap org.onap.domain.database.PMSH_K8SMicroserviceControlLoopElement: # Chart from localany fileremote system repository version: 1.2.3 type: org.onap.policy.clamp.controlloop.K8SMicroserviceControlLoopElement type_version: 1.0.0 description: Control loop element for the K8S microservice for PMSH properties: provider: ONAP participant_id: name: org.onap.k8s.controlloop.K8SControlLoopParticipant version: 2.3.4 chart: release_name: pmshmicroservice chart_chartId: name: dcae_pmsh version: 8.0.1.0 repository: /home/oom/helm-charts/PMSH repository: repoName: chartMuseum address: 172.125.12.1 port: 8082 protocol: http username: username password: password namespace: onap org.onap.domain.database.Local_K8SMicroserviceControlLoopElement: # Chart installation without passing repository name (chart lookup happens on local chart storage and preconfigured helm repos) version: 1.2.3 type: org.onap.policy.clamp.controlloop.K8SMicroserviceControlLoopElement type_version: 1.0.0 description: Control loop element for the K8S microservice for localany chart properties: provider: ONAP participant_id: name: org.onap.k8s.controlloop.K8SControlLoopParticipant version: 2.3.4 chart: release_name: nginxms chart_name: nginx-ingress version: 0.9.1 namespace: onap |
The Kubernetes participant receives messages through the participant-intermediary common code, and handles them by invoking the Kubernetes Open API via the Helm client. For example, When a ControlLoopUpdate message is received by Kubernetes participant, the control loop element state changed from UNINITIALISED to PASSIVE, Kubernetes-participant triggers Kubernetes Open API and installs the HELM charts on the cluster.
Run CLAMP Kubernetes Participant command line using Maven
mvn spring-boot:run -Dspring-boot.run.arguments="--topicServer=localhost"
Run CLAMP Kubernetes Participant command line using Jar
java -jar -DtopicServer=localhost target/policy-clamp-participant-impl-kubernetes-6.1.2-SNAPSHOT.jar
REST APIs on Kubernetes participant:
Kubernetes participant can also be installed as a standalone application which exposes REST endpoints for onboarding, installing, uninstalling helm charts from local chart directories.
K8s-participant User guide (PMSH usecase)
| View file | ||||
|---|---|---|---|---|
|