This page is currently a WIP for the next 2 weeks starting 20180214. Deliverables will deployment scripts, arm/cli templates for various deployment scenarios (single, multiple, federated servers)

ONAP on Azure VMs

Pre-requisite

The supported versions are as follows:

ONAP Release	Rancher	Kubernetes	Helm	Kubectl	Docker
Amsterdam	1.6.10	1.7.7	2.3.0	1.7.7	1.12.x
Beijing	1.6.14	1.8.6	2.6+	1.8.6	17.03-ce

20180214 Work Session

OOM-524 - Getting issue details... STATUS

Requirements

Azure subscription

Installation

AZ cli

https://docs.microsoft.com/en-us/cli/azure/install-azure-cli?view=azure-cli-latest

Will install Python 3.6

brew update && brew install azure-cli

https://docs.microsoft.com/en-us/cli/azure/get-started-with-azure-cli?view=azure-cli-latest

obrienbiometrics:obrienlabs michaelobrien$ az login
To sign in, use a web browser to open the page https://aka.ms/devicelogin and enter the code EG9KBECSD to authenticate.
[ {
    "cloudName": "AzureCloud",
    "id": "f4...b",
    "isDefault": true,
    "name": "Pay-As-You-Go",
    "state": "Enabled",
    "tenantId": "bcb.....f",
    "user": {
      "name": "michael@....org",
      "type": "user"
    }}]

Reference Server

http://azure.onap.info:8880/r/projects/1a7/kubernetes-dashboard:9090/#!/pod?namespace=_all

Cluster Configuration

Single Server

Azure Artifacts

Static IP

Secondary Drive

VM

ARM Template

ONAP on Azure Container Service

AKS Installation

Follow https://docs.microsoft.com/en-us/azure/aks/tutorial-kubernetes-deploy-cluster

Register for AKS preview via az cli

obrienbiometrics:obrienlabs michaelobrien$ az provider register -n Microsoft.ContainerService
Registering is still on-going. You can monitor using 'az provider show -n Microsoft.ContainerService'

Create an AKS resource group

Raise your AKS vCPU quota - optional

https://docs.microsoft.com/en-us/azure/azure-subscription-service-limits#container-service-aks-limits

http://aka.ms/corequotaincrease

https://portal.azure.com/#blade/Microsoft_Azure_Support/HelpAndSupportBlade/newsupportrequest

Deployment failed. Correlation ID: 4b4707a7-2244-4557-855e-11bcced556de. Provisioning of resource(s) for container service onapAKSCluster in resource group onapAKS failed. Message: Operation results in exceeding quota limits of Core. Maximum allowed: 10, Current in use: 10, Additional requested: 1. Please read more about quota increase at http://aka.ms/corequotaincrease.. Details:

Create AKS cluster

obrienbiometrics:obrienlabs michaelobrien$ az aks create --resource-group onapAKS --name onapAKSCluster --node-count 1 --generate-ssh-keys
 - Running ..
 "fqdn": "onapaksclu-onapaks-f4....3.hcp.eastus.azmk8s.io",

AKS cluster VM granularity

The cluster will start with a 3.5G VM before scaling

Resources for your AKS cluster

To Be Retrofitted

Proof Of Concept

Verified the 2 scripts to bootstrap the server and install OOM on a clean Ubuntu 16 VM on Microsoft Azure.

Get the usual 8-64 vCores, 64G+ ram, 100+ HD

Associate an IP with a DNS address for developer ease

Bootstrap the server

obrienbiometrics:_artifacts michaelobrien$ scp * ubuntu@40.71.5.147:~/
obrienbiometrics:_artifacts michaelobrien$ ssh ubuntu@40.71.5.147
Warning: Permanently added '40.71.5.147' (ECDSA) to the list of known hosts.
Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.11.0-1016-azure x86_64)
 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage
  Get cloud support with Ubuntu Advantage Cloud Guest:
    http://www.ubuntu.com/business/services/cloud
0 packages can be updated.
0 updates are security updates.
*** System restart required ***
Last login: Wed Dec 13 07:58:18 2017 from 24.114.58.216
To run a command as administrator (user "root"), use "sudo <command>".
See "man sudo_root" for details.
ubuntu@onap-k8s:~$ sudo su -

root@onap-k8s:~# cp /home/ubuntu/* .

root@onap-k8s:~# ls

aai-cloud-region-put.json  cd.sh  down.sh  git_recurse.sh  onap-parameters.yaml  oom_rancher_setup_1.sh  up.sh

root@onap-k8s:~# ./oom_rancher_setup_1.sh 

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current

                                 Dload  Upload   Total   Spent    Left  Speed

100 16609  100 16609    0     0  47547      0 --:--:-- --:--:-- --:--:-- 47590

apparmor is enabled in the kernel and apparmor utils were already installed

+ sh -c sleep 3; apt-get update

Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]

Hit:2 http://azure.archive.ubuntu.com/ubuntu xenial InRelease

Get:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]     

Get:4 http://security.ubuntu.com/ubuntu xenial-security/multiverse Sources [1,520 B]

Get:5 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB]

Get:6 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [3,208 B]

Get:7 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main Sources [286 kB]

Get:8 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe Sources [185 kB]

Get:9 http://azure.archive.ubuntu.com/ubuntu xenial-updates/multiverse Sources [7,968 B]

Get:10 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [678 kB]

Get:11 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [565 kB]

Get:12 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [229 kB]

Get:13 http://azure.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 Packages [16.2 kB]

Fetched 2,278 kB in 1s (1,694 kB/s)                           

Reading package lists... Done

+ sh -c sleep 3; apt-get install -y -q dirmngr

Reading package lists...

Building dependency tree...

Reading state information...

The following additional packages will be installed:

  libassuan0 libksba8 libnpth0

The following NEW packages will be installed:

  dirmngr libassuan0 libksba8 libnpth0

0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded.

Need to get 368 kB of archives.

After this operation, 1,041 kB of additional disk space will be used.

Get:1 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libassuan0 amd64 2.4.2-2 [34.6 kB]

Get:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libksba8 amd64 1.3.3-1ubuntu0.16.04.1 [90.2 kB]

Get:3 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libnpth0 amd64 1.2-3 [7,998 B]

Get:4 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 dirmngr amd64 2.1.11-6ubuntu2 [235 kB]

Fetched 368 kB in 0s (634 kB/s)

Selecting previously unselected package libassuan0:amd64.

(Reading database ... 54174 files and directories currently installed.)

Preparing to unpack .../libassuan0_2.4.2-2_amd64.deb ...

Unpacking libassuan0:amd64 (2.4.2-2) ...

Selecting previously unselected package libksba8:amd64.

Preparing to unpack .../libksba8_1.3.3-1ubuntu0.16.04.1_amd64.deb ...

Unpacking libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ...

Selecting previously unselected package libnpth0:amd64.

Preparing to unpack .../libnpth0_1.2-3_amd64.deb ...

Unpacking libnpth0:amd64 (1.2-3) ...

Selecting previously unselected package dirmngr.

Preparing to unpack .../dirmngr_2.1.11-6ubuntu2_amd64.deb ...

Unpacking dirmngr (2.1.11-6ubuntu2) ...

Processing triggers for libc-bin (2.23-0ubuntu9) ...

Processing triggers for man-db (2.7.5-1) ...

Setting up libassuan0:amd64 (2.4.2-2) ...

Setting up libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ...

Setting up libnpth0:amd64 (1.2-3) ...

Setting up dirmngr (2.1.11-6ubuntu2) ...

Processing triggers for libc-bin (2.23-0ubuntu9) ...

+ sh -c apt-key adv --keyserver hkp://ha.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D

Executing: /tmp/tmp.cy3a3zC5I5/gpg.1.sh --keyserver

hkp://ha.pool.sks-keyservers.net:80

--recv-keys

58118E89F3A912897C070ADBF76221572C52609D

gpg: requesting key 2C52609D from hkp server ha.pool.sks-keyservers.net

gpg: key 2C52609D: public key "Docker Release Tool (releasedocker) <docker@docker.com>" imported

gpg: Total number processed: 1

gpg:               imported: 1  (RSA: 1)

+ break

+ sh -c apt-key adv -k 58118E89F3A912897C070ADBF76221572C52609D >/dev/null

+ sh -c mkdir -p /etc/apt/sources.list.d

+ dpkg --print-architecture

+ sh -c echo deb \[arch=amd64\] https://apt.dockerproject.org/repo ubuntu-xenial main > /etc/apt/sources.list.d/docker.list

+ sh -c sleep 3; apt-get update

Hit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease

Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease       

Hit:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease   

Get:4 https://apt.dockerproject.org/repo ubuntu-xenial InRelease [48.7 kB]

Hit:5 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease        

Get:6 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 Packages [4,177 B]

Fetched 52.9 kB in 0s (127 kB/s)                              

Reading package lists... Done

+ + grep 1.12.6

apt-cache+  madison docker-engine

+ cut -d   -f 3

head -n 1

+ sh -c apt-get install -y -q docker-engine=1.12.6-0~ubuntu-xenial

Reading package lists...

Building dependency tree...

Reading state information...

The following additional packages will be installed:

  aufs-tools cgroupfs-mount libltdl7

Suggested packages:

  mountall

The following NEW packages will be installed:

  aufs-tools cgroupfs-mount docker-engine libltdl7

0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded.

Need to get 19.4 MB/19.5 MB of archives.

After this operation, 102 MB of additional disk space will be used.

Get:1 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libltdl7 amd64 2.4.6-0.1 [38.3 kB]

Get:2 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 docker-engine amd64 1.12.6-0~ubuntu-xenial [19.4 MB]

Fetched 19.4 MB in 0s (38.2 MB/s)

Selecting previously unselected package aufs-tools.

(Reading database ... 54209 files and directories currently installed.)

Preparing to unpack .../aufs-tools_1%3a3.2+20130722-1.1ubuntu1_amd64.deb ...

Unpacking aufs-tools (1:3.2+20130722-1.1ubuntu1) ...

Selecting previously unselected package cgroupfs-mount.

Preparing to unpack .../cgroupfs-mount_1.2_all.deb ...

Unpacking cgroupfs-mount (1.2) ...

Selecting previously unselected package libltdl7:amd64.

Preparing to unpack .../libltdl7_2.4.6-0.1_amd64.deb ...

Unpacking libltdl7:amd64 (2.4.6-0.1) ...

Selecting previously unselected package docker-engine.

Preparing to unpack .../docker-engine_1.12.6-0~ubuntu-xenial_amd64.deb ...

Unpacking docker-engine (1.12.6-0~ubuntu-xenial) ...

Processing triggers for libc-bin (2.23-0ubuntu9) ...

Processing triggers for man-db (2.7.5-1) ...

Processing triggers for ureadahead (0.100.0-19) ...

Processing triggers for systemd (229-4ubuntu21) ...

Setting up aufs-tools (1:3.2+20130722-1.1ubuntu1) ...

Setting up cgroupfs-mount (1.2) ...

Setting up libltdl7:amd64 (2.4.6-0.1) ...

Setting up docker-engine (1.12.6-0~ubuntu-xenial) ...

sent invalidate(passwd) request, exiting

sent invalidate(group) request, exiting

sent invalidate(group) request, exiting

Processing triggers for libc-bin (2.23-0ubuntu9) ...

Processing triggers for systemd (229-4ubuntu21) ...

Processing triggers for ureadahead (0.100.0-19) ...

+ sh -c docker version

Client:

 Version:      1.12.6

 API version:  1.24

 Go version:   go1.6.4

 Git commit:   78d1802

 Built:        Tue Jan 10 20:38:45 2017

 OS/Arch:      linux/amd64




Server:

 Version:      1.12.6

 API version:  1.24

 Go version:   go1.6.4

 Git commit:   78d1802

 Built:        Tue Jan 10 20:38:45 2017

 OS/Arch:      linux/amd64




If you would like to use Docker as a non-root user, you should now consider

adding your user to the "docker" group with something like:




  sudo usermod -aG docker your-user




Remember that you will have to log out and back in for this to take effect!




Unable to find image 'rancher/server:v1.6.10' locally

v1.6.10: Pulling from rancher/server

6599cadaf950: Pull complete 

23eda618d451: Pull complete 

f0be3084efe9: Pull complete 

52de432f084b: Pull complete 

a3ed95caeb02: Pull complete 

e75cd91a1dc5: Pull complete 

997f1b48f59f: Pull complete 

313c28fb4e37: Pull complete 

2a0730d1275c: Pull complete 

8848fbebd2c8: Pull complete 

906504ea9ea6: Pull complete 

9329940f8e65: Pull complete 

e849debd7945: Pull complete 

4883bd135dd2: Pull complete 

605c6a0fe940: Pull complete 

274bc004c933: Pull complete 

a6cb25e8d1a2: Pull complete 

3ded9d4c8c2b: Pull complete 

a571d2f40012: Pull complete 

Digest: sha256:096026aa3eed411077690c904cd5dd3cce66eb39312c78a84209eab23387c36d

Status: Downloaded newer image for rancher/server:v1.6.10

0437d4e2e2afa6123d416c9ec0ef8bdf0c9b4504f7c021ec8acd917ee11a3302

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current

                                 Dload  Upload   Total   Spent    Left  Speed

100 49.9M  100 49.9M    0     0   161M      0 --:--:-- --:--:-- --:--:--  161M

--2017-12-13 08:05:57--  http://storage.googleapis.com/kubernetes-helm/helm-v2.3.0-linux-amd64.tar.gz

Resolving storage.googleapis.com (storage.googleapis.com)... 172.217.13.240, 2607:f8b0:4004:809::2010

Connecting to storage.googleapis.com (storage.googleapis.com)|172.217.13.240|:80... connected.

HTTP request sent, awaiting response... 200 OK

Length: 12568314 (12M) [application/x-tar]

Saving to: ‘helm-v2.3.0-linux-amd64.tar.gz’




helm-v2.3.0-linux-amd64.tar.gz      100%[==================================================================>]  11.99M  --.-KB/s    in 0.1s    




2017-12-13 08:05:57 (117 MB/s) - ‘helm-v2.3.0-linux-amd64.tar.gz’ saved [12568314/12568314]




linux-amd64/

linux-amd64/helm

linux-amd64/LICENSE

linux-amd64/README.md
root@onap-k8s:~# helm version

Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}

Error: cannot connect to Tiller

root@onap-k8s:~# docker ps -a

CONTAINER ID        IMAGE                    COMMAND                  CREATED             STATUS              PORTS                              NAMES

0437d4e2e2af        rancher/server:v1.6.10   "/usr/bin/entry /usr/"   7 minutes ago       Up 7 minutes        3306/tcp, 0.0.0.0:8880->8080/tcp   admiring_ramanujan

Do the remaining manual step and assocate a host with the server (itself)

root@onap-k8s:~# sudo docker run --rm --privileged -v /var/run/docker.sock:/var/run/docker.sock -v /var/lib/rancher:/var/lib/rancher rancher/agent:v1.2.6 http://azure.onap.info:8880/v1/scripts/C2917AB10F321D556B7E:1483142400000:GtHnTWyEHpTi024KpLk99G5B7Is

Unable to find image 'rancher/agent:v1.2.6' locally

v1.2.6: Pulling from rancher/agent

b3e1c725a85f: Pull complete 

6a710864a9fc: Pull complete 

d0ac3b234321: Pull complete 

87f567b5cf58: Pull complete 

063e24b217c4: Pull complete 

d0a3f58caef0: Pull complete 

16914729cfd3: Pull complete 

2ce3828c0b9d: Pull complete 

7df47a98fc4b: Pull complete 

Digest: sha256:a68afd351c7417e6d66a77e97144113ceb7a9c3cdd46fb6e1fd5f5a5a33111cd

Status: Downloaded newer image for rancher/agent:v1.2.6




INFO: Running Agent Registration Process, CATTLE_URL=http://azure.onap.info:8880/v1

INFO: Attempting to connect to: http://azure.onap.info:8880/v1

INFO: http://azure.onap.info:8880/v1 is accessible

INFO: Inspecting host capabilities

INFO: Boot2Docker: false

INFO: Host writable: true

INFO: Token: xxxxxxxx

INFO: Running registration

INFO: Printing Environment

INFO: ENV: CATTLE_ACCESS_KEY=46E75573E88F0C10A9DD

INFO: ENV: CATTLE_HOME=/var/lib/cattle

INFO: ENV: CATTLE_REGISTRATION_ACCESS_KEY=registrationToken

INFO: ENV: CATTLE_REGISTRATION_SECRET_KEY=xxxxxxx

INFO: ENV: CATTLE_SECRET_KEY=xxxxxxx

INFO: ENV: CATTLE_URL=http://azure.onap.info:8880/v1

INFO: ENV: DETECTED_CATTLE_AGENT_IP=40.71.5.147

INFO: ENV: RANCHER_AGENT_IMAGE=rancher/agent:v1.2.6

INFO: Launched Rancher Agent: 4892011a4525067d028f28ce19ec59064d8535d6855d7b052e72b5c26adbe858

root@onap-k8s:~# 

root@onap-k8s:~# helm version

Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}

Error: cannot connect to Tiller

root@onap-k8s:~# vi ~/.kube/config

root@onap-k8s:~# helm version

Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}

Server: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}

configuration of a host - takes a bit longer on Azure - wait for it

Bring up AAI only for now

Links

https://azure.microsoft.com/en-us/services/container-service/

https://docs.microsoft.com/en-us/azure/container-service/kubernetes/container-service-kubernetes-helm

Space shortcuts

Page tree

ONAP on Azure VMs

Pre-requisite

20180214 Work Session

Requirements

Installation

AZ cli

Reference Server

Cluster Configuration

Single Server

Azure Artifacts

ARM Template

ONAP on Azure Container Service

AKS Installation

Register for AKS preview via az cli

Create an AKS resource group

Raise your AKS vCPU quota - optional

Create AKS cluster

AKS cluster VM granularity

To Be Retrofitted

Proof Of Concept

Bring up AAI only for now

Links

Space shortcuts

Page tree

ONAP on Kubernetes on Microsoft Azure

ONAP on Azure VMs

Pre-requisite

20180214 Work Session

Requirements

Installation

AZ cli

Reference Server

Cluster Configuration

Single Server

Azure Artifacts

ARM Template

ONAP on Azure Container Service

AKS Installation

Register for AKS preview via az cli

Create an AKS resource group

Raise your AKS vCPU quota - optional

Create AKS cluster

AKS cluster VM granularity

To Be Retrofitted

Proof Of Concept

Bring up AAI only for now

Links