This page is currently a WIP for the next 2 weeks starting 20180214. Deliverables will deployment scripts, arm/cli templates for various deployment scenarios (single, multiple, federated servers)
20180214 Work Session
- OOM-524Getting issue details... STATUS
Reference Server
http://azure.onap.info:8880/r/projects/1a7/kubernetes-dashboard:9090/#!/pod?namespace=_all
Software
Amsterdam config set: Rancher 1.6.10, Helm 2.3.0, Docker 1.12, Kubernetes 1.7.7
Cluster Configuration
Single Server
Azure Artifacts
Static IP
Secondary Drive
VM
ARM Template
To Be Retrofitted
Proof Of Concept
see also ONAP on Microsoft AKS CaaS - Azure Container Service
Verified the 2 scripts to bootstrap the server and install OOM on a clean Ubuntu 16 VM on Microsoft Azure.
Get the usual 8-64 vCores, 64G+ ram, 100+ HD
Associate an IP with a DNS address for developer ease
Bootstrap the server
obrienbiometrics:_artifacts michaelobrien$ scp * ubuntu@40.71.5.147:~/ obrienbiometrics:_artifacts michaelobrien$ ssh ubuntu@40.71.5.147 Warning: Permanently added '40.71.5.147' (ECDSA) to the list of known hosts. Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.11.0-1016-azure x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/advantage Get cloud support with Ubuntu Advantage Cloud Guest: http://www.ubuntu.com/business/services/cloud 0 packages can be updated. 0 updates are security updates. *** System restart required *** Last login: Wed Dec 13 07:58:18 2017 from 24.114.58.216 To run a command as administrator (user "root"), use "sudo <command>". See "man sudo_root" for details. ubuntu@onap-k8s:~$ sudo su - root@onap-k8s:~# cp /home/ubuntu/* . root@onap-k8s:~# ls aai-cloud-region-put.json cd.sh down.sh git_recurse.sh onap-parameters.yaml oom_rancher_setup_1.sh up.sh root@onap-k8s:~# ./oom_rancher_setup_1.sh % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 16609 100 16609 0 0 47547 0 --:--:-- --:--:-- --:--:-- 47590 apparmor is enabled in the kernel and apparmor utils were already installed + sh -c sleep 3; apt-get update Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] Hit:2 http://azure.archive.ubuntu.com/ubuntu xenial InRelease Get:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] Get:4 http://security.ubuntu.com/ubuntu xenial-security/multiverse Sources [1,520 B] Get:5 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] Get:6 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [3,208 B] Get:7 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main Sources [286 kB] Get:8 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe Sources [185 kB] Get:9 http://azure.archive.ubuntu.com/ubuntu xenial-updates/multiverse Sources [7,968 B] Get:10 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [678 kB] Get:11 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [565 kB] Get:12 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [229 kB] Get:13 http://azure.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 Packages [16.2 kB] Fetched 2,278 kB in 1s (1,694 kB/s) Reading package lists... Done + sh -c sleep 3; apt-get install -y -q dirmngr Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: libassuan0 libksba8 libnpth0 The following NEW packages will be installed: dirmngr libassuan0 libksba8 libnpth0 0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded. Need to get 368 kB of archives. After this operation, 1,041 kB of additional disk space will be used. Get:1 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libassuan0 amd64 2.4.2-2 [34.6 kB] Get:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libksba8 amd64 1.3.3-1ubuntu0.16.04.1 [90.2 kB] Get:3 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libnpth0 amd64 1.2-3 [7,998 B] Get:4 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 dirmngr amd64 2.1.11-6ubuntu2 [235 kB] Fetched 368 kB in 0s (634 kB/s) Selecting previously unselected package libassuan0:amd64. (Reading database ... 54174 files and directories currently installed.) Preparing to unpack .../libassuan0_2.4.2-2_amd64.deb ... Unpacking libassuan0:amd64 (2.4.2-2) ... Selecting previously unselected package libksba8:amd64. Preparing to unpack .../libksba8_1.3.3-1ubuntu0.16.04.1_amd64.deb ... Unpacking libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ... Selecting previously unselected package libnpth0:amd64. Preparing to unpack .../libnpth0_1.2-3_amd64.deb ... Unpacking libnpth0:amd64 (1.2-3) ... Selecting previously unselected package dirmngr. Preparing to unpack .../dirmngr_2.1.11-6ubuntu2_amd64.deb ... Unpacking dirmngr (2.1.11-6ubuntu2) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Processing triggers for man-db (2.7.5-1) ... Setting up libassuan0:amd64 (2.4.2-2) ... Setting up libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ... Setting up libnpth0:amd64 (1.2-3) ... Setting up dirmngr (2.1.11-6ubuntu2) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... + sh -c apt-key adv --keyserver hkp://ha.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D Executing: /tmp/tmp.cy3a3zC5I5/gpg.1.sh --keyserver hkp://ha.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D gpg: requesting key 2C52609D from hkp server ha.pool.sks-keyservers.net gpg: key 2C52609D: public key "Docker Release Tool (releasedocker) <docker@docker.com>" imported gpg: Total number processed: 1 gpg: imported: 1 (RSA: 1) + break + sh -c apt-key adv -k 58118E89F3A912897C070ADBF76221572C52609D >/dev/null + sh -c mkdir -p /etc/apt/sources.list.d + dpkg --print-architecture + sh -c echo deb \[arch=amd64\] https://apt.dockerproject.org/repo ubuntu-xenial main > /etc/apt/sources.list.d/docker.list + sh -c sleep 3; apt-get update Hit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease Get:4 https://apt.dockerproject.org/repo ubuntu-xenial InRelease [48.7 kB] Hit:5 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease Get:6 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 Packages [4,177 B] Fetched 52.9 kB in 0s (127 kB/s) Reading package lists... Done + + grep 1.12.6 apt-cache+ madison docker-engine + cut -d -f 3 head -n 1 + sh -c apt-get install -y -q docker-engine=1.12.6-0~ubuntu-xenial Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: aufs-tools cgroupfs-mount libltdl7 Suggested packages: mountall The following NEW packages will be installed: aufs-tools cgroupfs-mount docker-engine libltdl7 0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded. Need to get 19.4 MB/19.5 MB of archives. After this operation, 102 MB of additional disk space will be used. Get:1 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libltdl7 amd64 2.4.6-0.1 [38.3 kB] Get:2 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 docker-engine amd64 1.12.6-0~ubuntu-xenial [19.4 MB] Fetched 19.4 MB in 0s (38.2 MB/s) Selecting previously unselected package aufs-tools. (Reading database ... 54209 files and directories currently installed.) Preparing to unpack .../aufs-tools_1%3a3.2+20130722-1.1ubuntu1_amd64.deb ... Unpacking aufs-tools (1:3.2+20130722-1.1ubuntu1) ... Selecting previously unselected package cgroupfs-mount. Preparing to unpack .../cgroupfs-mount_1.2_all.deb ... Unpacking cgroupfs-mount (1.2) ... Selecting previously unselected package libltdl7:amd64. Preparing to unpack .../libltdl7_2.4.6-0.1_amd64.deb ... Unpacking libltdl7:amd64 (2.4.6-0.1) ... Selecting previously unselected package docker-engine. Preparing to unpack .../docker-engine_1.12.6-0~ubuntu-xenial_amd64.deb ... Unpacking docker-engine (1.12.6-0~ubuntu-xenial) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Processing triggers for man-db (2.7.5-1) ... Processing triggers for ureadahead (0.100.0-19) ... Processing triggers for systemd (229-4ubuntu21) ... Setting up aufs-tools (1:3.2+20130722-1.1ubuntu1) ... Setting up cgroupfs-mount (1.2) ... Setting up libltdl7:amd64 (2.4.6-0.1) ... Setting up docker-engine (1.12.6-0~ubuntu-xenial) ... sent invalidate(passwd) request, exiting sent invalidate(group) request, exiting sent invalidate(group) request, exiting Processing triggers for libc-bin (2.23-0ubuntu9) ... Processing triggers for systemd (229-4ubuntu21) ... Processing triggers for ureadahead (0.100.0-19) ... + sh -c docker version Client: Version: 1.12.6 API version: 1.24 Go version: go1.6.4 Git commit: 78d1802 Built: Tue Jan 10 20:38:45 2017 OS/Arch: linux/amd64 Server: Version: 1.12.6 API version: 1.24 Go version: go1.6.4 Git commit: 78d1802 Built: Tue Jan 10 20:38:45 2017 OS/Arch: linux/amd64 If you would like to use Docker as a non-root user, you should now consider adding your user to the "docker" group with something like: sudo usermod -aG docker your-user Remember that you will have to log out and back in for this to take effect! Unable to find image 'rancher/server:v1.6.10' locally v1.6.10: Pulling from rancher/server 6599cadaf950: Pull complete 23eda618d451: Pull complete f0be3084efe9: Pull complete 52de432f084b: Pull complete a3ed95caeb02: Pull complete e75cd91a1dc5: Pull complete 997f1b48f59f: Pull complete 313c28fb4e37: Pull complete 2a0730d1275c: Pull complete 8848fbebd2c8: Pull complete 906504ea9ea6: Pull complete 9329940f8e65: Pull complete e849debd7945: Pull complete 4883bd135dd2: Pull complete 605c6a0fe940: Pull complete 274bc004c933: Pull complete a6cb25e8d1a2: Pull complete 3ded9d4c8c2b: Pull complete a571d2f40012: Pull complete Digest: sha256:096026aa3eed411077690c904cd5dd3cce66eb39312c78a84209eab23387c36d Status: Downloaded newer image for rancher/server:v1.6.10 0437d4e2e2afa6123d416c9ec0ef8bdf0c9b4504f7c021ec8acd917ee11a3302 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 49.9M 100 49.9M 0 0 161M 0 --:--:-- --:--:-- --:--:-- 161M --2017-12-13 08:05:57-- http://storage.googleapis.com/kubernetes-helm/helm-v2.3.0-linux-amd64.tar.gz Resolving storage.googleapis.com (storage.googleapis.com)... 172.217.13.240, 2607:f8b0:4004:809::2010 Connecting to storage.googleapis.com (storage.googleapis.com)|172.217.13.240|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 12568314 (12M) [application/x-tar] Saving to: ‘helm-v2.3.0-linux-amd64.tar.gz’ helm-v2.3.0-linux-amd64.tar.gz 100%[==================================================================>] 11.99M --.-KB/s in 0.1s 2017-12-13 08:05:57 (117 MB/s) - ‘helm-v2.3.0-linux-amd64.tar.gz’ saved [12568314/12568314] linux-amd64/ linux-amd64/helm linux-amd64/LICENSE linux-amd64/README.md root@onap-k8s:~# helm version Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"} Error: cannot connect to Tiller root@onap-k8s:~# docker ps -a CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 0437d4e2e2af rancher/server:v1.6.10 "/usr/bin/entry /usr/" 7 minutes ago Up 7 minutes 3306/tcp, 0.0.0.0:8880->8080/tcp admiring_ramanujan
Do the remaining manual step and assocate a host with the server (itself)
root@onap-k8s:~# sudo docker run --rm --privileged -v /var/run/docker.sock:/var/run/docker.sock -v /var/lib/rancher:/var/lib/rancher rancher/agent:v1.2.6 http://azure.onap.info:8880/v1/scripts/C2917AB10F321D556B7E:1483142400000:GtHnTWyEHpTi024KpLk99G5B7Is Unable to find image 'rancher/agent:v1.2.6' locally v1.2.6: Pulling from rancher/agent b3e1c725a85f: Pull complete 6a710864a9fc: Pull complete d0ac3b234321: Pull complete 87f567b5cf58: Pull complete 063e24b217c4: Pull complete d0a3f58caef0: Pull complete 16914729cfd3: Pull complete 2ce3828c0b9d: Pull complete 7df47a98fc4b: Pull complete Digest: sha256:a68afd351c7417e6d66a77e97144113ceb7a9c3cdd46fb6e1fd5f5a5a33111cd Status: Downloaded newer image for rancher/agent:v1.2.6 INFO: Running Agent Registration Process, CATTLE_URL=http://azure.onap.info:8880/v1 INFO: Attempting to connect to: http://azure.onap.info:8880/v1 INFO: http://azure.onap.info:8880/v1 is accessible INFO: Inspecting host capabilities INFO: Boot2Docker: false INFO: Host writable: true INFO: Token: xxxxxxxx INFO: Running registration INFO: Printing Environment INFO: ENV: CATTLE_ACCESS_KEY=46E75573E88F0C10A9DD INFO: ENV: CATTLE_HOME=/var/lib/cattle INFO: ENV: CATTLE_REGISTRATION_ACCESS_KEY=registrationToken INFO: ENV: CATTLE_REGISTRATION_SECRET_KEY=xxxxxxx INFO: ENV: CATTLE_SECRET_KEY=xxxxxxx INFO: ENV: CATTLE_URL=http://azure.onap.info:8880/v1 INFO: ENV: DETECTED_CATTLE_AGENT_IP=40.71.5.147 INFO: ENV: RANCHER_AGENT_IMAGE=rancher/agent:v1.2.6 INFO: Launched Rancher Agent: 4892011a4525067d028f28ce19ec59064d8535d6855d7b052e72b5c26adbe858 root@onap-k8s:~# root@onap-k8s:~# helm version Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"} Error: cannot connect to Tiller root@onap-k8s:~# vi ~/.kube/config root@onap-k8s:~# helm version Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"} Server: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}
configuration of a host - takes a bit longer on Azure - wait for it