Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The OOM (ONAP Operation Manager) project has pushed Kubernetes based deployment code to the oom repository.  This page details getting ONAP running (specifically the vFirewall demo) on Kubernetes for various virtual and native environments.

Undercloud Installation

...

There are several options - currently Rancher is a focus as a thin wrapper on Kubernetes.

OSVIMDescriptionStatusNodesLinks

Ubuntu 16.04.2

!Redhat

Bare Metal

VMWare

RacherRancher

Recommended approach

Issue with kubernetes support only in 1.12 (obsolete docker-machine) on OSX

1-4http://rancher.com/docs/rancher/v1.6/en/quick-start-guide/
LinuxBare MetalKubernetes Directly on RHEL 7.3 (VMs in this case)In progress1

https://kubernetes.io/docs/setup/independent/install-kubeadm/

https://lukemarsden.github.io/docs/getting-started-guides/kubeadm/

https://kubernetes.io/docs/getting-started-guides/scratch/

OSX

Linux

CoreOSOn Vagrant (Thanks Yves)

Issue: the coreos VM 19G size is insufficient

1

https://coreos.com/kubernetes/docs/latest/kubernetes-on-vagrant-single.html

Implement OSX fix for Vagrant 1.9.6 https://github.com/mitchellh/vagrant/issues/7747

Avoid the kubectl lock https://github.com/coreos/coreos-kubernetes/issues/886


OSXMInikube on VMWare Fusionminikube VM not restartable1https://github.com/kubernetes/minikube

RHEL 7.3Redhat Kubernetes

services deploy, fix kubectl exec

1https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux_atomic_host/7/html-single/getting_started_with_kubernetes/

...

ONAP deployment in kubernetes is modelled in the oom project as a 1:1 set of service:pod sets (1 pod per docker container).  The fastest way to get ONAP Kubernetes up is via Rancher.

Platform Primary platform is Ubuntu 16.04 VMs on VMWare Workstation 12.5 on a up to two 64Gb/6-core 5820K Windows 10 systems (but a bare metal set of Ubuntu servers will work the same)

Currently editing this (adding rancher details) over the morning of 20170706 so bear with me...

.

Secondary platform is 3 NUCs (i7/i5 with 16G each) 

Install only the 1.12.x (currently 1.12.6) version of Docker (the only version that works with Kubernetes in Rancher 1.6)
curl https://releases.rancher.com/install-docker/1.12.sh | sh

Install rancher (use 8880 instead of 8080)
sudo docker run -d --restart=unless-stopped -p 8880:8080 rancher/server

In Rancher UI (http://127.0.0.1:8880) , Set IP name of master node in config, create a new onap environment as Kubernetes (will setup kube containers), stop default environment

register your host(s) - run following on each host (get from "add host" menu)

register your host(s)

# sudo docker run --rm --privileged -v /var/run/docker.sock:/var/run/docker.sock -v /var/lib/rancher:/var/lib/rancher rancher/agent:v1.2.2 http://192.168.163.131:8880/v1/scripts/BBD465D9B24E94F5FBFD:1483142400000:IDaNFrug38QsjZcu6rXh8TwqA4
install kubectl
# curl -LO https://storage.googleapis.com/kubernetes-release/release/$(curl -s https://storage.googleapis.com/kubernetes-release/release/stable.txt)/bin/linux/amd64/kubectl
# chmod +x ./kubectl
# sudo mv ./kubectl /usr/local/bin/kubectl

paste kubectl config from rancher

# mkdir ~/.kube

# vi ~/.kube/config

clone oom (scp your onap_rsa private key first)

~/onap# git clone ssh:/

/michaelobrien@gerrit.onap.org:29418/oomfix nexus3 security

/michaelobrien@gerrit.onap.org:29418/oom

fix nexus3 security temporarily for

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyOOM-3

Wait until all the hosts show green in rancher, then run the script that wrapps all the kubectl commands

~/onap/oom/kubernetes/oneclick# vi createAll.bash 
~/onap/oom/kubernetes

/oneclick# ./createAll.bash -n onap

/oneclick# ./createAll.bash -n onap

Wait until the containers are all up - you should see...

Three host Kubernetes cluster in Rancher

In this case 3 Intel NUCs running Ubuntu 16.04.2 natively

Image Added

Target Deployment State

root@obriensystemsucont0:~/onap/oom/kubernetes/oneclick# kubectl get pods --all-namespaces -o wide

...

NAMESPACE

master:20170705

NAMEREADY STATUS

RESTARTS

(in 14h)

Notes
onap-aai aai-service-346921785-624ss1/1Running0
onap-aai hbase-139474849-7fg0s1/1Running0
onap-aai model-loader-service-1795708961-wg19w0/1Init:1/2 82
onap-appcappc-2044062043-bx6tc1/1Running0
onap-appcappc-dbhost-2039492951-jslts1/1Running0
onap-appcappc-dgbuilder-2934720673-mcp7c1/1Running0
onap-dcaenot yet pushed


Note: currently there are no DCAE containers running yet (we are missing 6 yaml files (1 for the controller and 5 for the collector,staging,3-cdap pods)) - therefore DMaaP, VES collectors and APPC actions as the result of policy actions (closed loop) - will not function yet.
onap-dcae-cdapnot yet pushed



onap-dcae-stgnot yet pushed



onap-dcae-collnot yet pushed



onap-message-routerdmaap-3842712241-gtdkp0/1CrashLoopBackOff164
onap-message-routerglobal-kafka-89365896-5fnq91/1Running0
onap-message-routerzookeeper-1406540368-jdscq1/1Running0
onap-msomariadb-2638235337-758zr0/1Running0
onap-msomso-3192832250-fq6pn1/1CrashLoopBackOff167
onap-policy brmsgw-568914601-d5z710/1Init:0/1 82
onap-policy drools-1450928085-099m2 0/1Init:0/1 82
onap-policy mariadb-2932363958-0l05g1/1Running 0
onap-policy nexus-871440171-tqq4z0/1Running 0
onap-policy pap-2218784661-xlj0n1/1Running 0
onap-policy pdp-1677094700-75wpj0/1Init:0/182
onap-policy pypdp-3209460526-bwm6b0/1Init:0/182
onap-portal portalapps-1708810953-trz470/1Init:CrashLoopBackOff163Initial dockerhub mariadb download issue - fixed
onap-portal portaldb-3652211058-vsg8r1/1Running0
onap-portal vnc-portal-948446550-76kj70/1Init:0/582
onap-robot robot-964706867-czr051/1Running 0
onap-sdcsdc-be-2426613560-jv8sk 0/1Init:0/282
onap-sdcsdc-cs-2080334320-95dq80/1CrashLoopBackOff163
onap-sdcsdc-es-3272676451-skf7z1/1Running0
onap-sdcsdc-fe-931927019-nt94t 0/1Init:0/182
onap-sdcsdc-kb-3337231379-8m8wx0/1Init:0/182
onap-sdncsdnc-1788655913-vvxlj 1/1Running0
onap-sdncsdnc-dbhost-240465348-kv8vf1/1Running0
onap-sdncsdnc-dgbuilder-4164493163-cp6rx1/1Running0
onap-sdncsdnc-portal-2324831407-50811 0/1Running25
onap-vid vid-mariadb-4268497828-81hm00/1CrashLoopBackOff 169
onap-vid vid-server-2331936551-6gxsp0/1  Init:0/182

I get the same container issues on 3 different deployments (virtual Ubuntu on 2 separate VMWare based machines, and a 3 node NUC cluster).  For example the APPC 3-pod service is running fine.

Image Added

But the 2-pod VID service has failed startup.

Image Added

Cloning details

Install the latest version of the OOM (ONAP Operations Manager) project repo - specifically the ONAP on Kubernetes work just uploaded June 2017

...