This page is currently a WIP for the next 2 weeks starting 20180214. Deliverables will deployment scripts, arm/cli templates for various deployment scenarios (single, multiple, federated servers)
Pre-requisite
The supported versions are as follows:
| ONAP Release | Rancher | Kubernetes | Helm | Kubectl | Docker |
|---|---|---|---|---|---|
| Amsterdam | 1.6.10 | 1.7.7 | 2.3.0 | 1.7.7 | 1.12.x |
| Beijing | 1.6.14 | 1.8.6 | 2.6+ | 1.8.6 | 17.03-ce |
20180214 Work Session
OOM-524 - Getting issue details... STATUS
Requirements
Azure subscription
Installation
AZ cli
https://docs.microsoft.com/en-us/cli/azure/install-azure-cli?view=azure-cli-latest
Will install Python 3.6
brew update && brew install azure-cli
https://docs.microsoft.com/en-us/cli/azure/get-started-with-azure-cli?view=azure-cli-latest
obrienbiometrics:obrienlabs michaelobrien$ az login
To sign in, use a web browser to open the page https://aka.ms/devicelogin and enter the code EG9KBECSD to authenticate.
[ {
"cloudName": "AzureCloud",
"id": "f4...b",
"isDefault": true,
"name": "Pay-As-You-Go",
"state": "Enabled",
"tenantId": "bcb.....f",
"user": {
"name": "michael@....org",
"type": "user"
}}]
Reference Server
http://azure.onap.info:8880/r/projects/1a7/kubernetes-dashboard:9090/#!/pod?namespace=_all
Software
Amsterdam config set: Rancher 1.6.10, Helm 2.3.0, Docker 1.12, Kubernetes 1.7.7
Cluster Configuration
Single Server
Azure Artifacts
Static IP
Secondary Drive
VM
ARM Template
To Be Retrofitted
Proof Of Concept
see also ONAP on Microsoft AKS CaaS - Azure Container Service
Verified the 2 scripts to bootstrap the server and install OOM on a clean Ubuntu 16 VM on Microsoft Azure.
Get the usual 8-64 vCores, 64G+ ram, 100+ HD
Associate an IP with a DNS address for developer ease
Bootstrap the server
obrienbiometrics:_artifacts michaelobrien$ scp * ubuntu@40.71.5.147:~/
obrienbiometrics:_artifacts michaelobrien$ ssh ubuntu@40.71.5.147
Warning: Permanently added '40.71.5.147' (ECDSA) to the list of known hosts.
Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.11.0-1016-azure x86_64)
* Documentation: https://help.ubuntu.com
* Management: https://landscape.canonical.com
* Support: https://ubuntu.com/advantage
Get cloud support with Ubuntu Advantage Cloud Guest:
http://www.ubuntu.com/business/services/cloud
0 packages can be updated.
0 updates are security updates.
*** System restart required ***
Last login: Wed Dec 13 07:58:18 2017 from 24.114.58.216
To run a command as administrator (user "root"), use "sudo <command>".
See "man sudo_root" for details.
ubuntu@onap-k8s:~$ sudo su -
root@onap-k8s:~# cp /home/ubuntu/* .
root@onap-k8s:~# ls
aai-cloud-region-put.json cd.sh down.sh git_recurse.sh onap-parameters.yaml oom_rancher_setup_1.sh up.sh
root@onap-k8s:~# ./oom_rancher_setup_1.sh
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 16609 100 16609 0 0 47547 0 --:--:-- --:--:-- --:--:-- 47590
apparmor is enabled in the kernel and apparmor utils were already installed
+ sh -c sleep 3; apt-get update
Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Hit:2 http://azure.archive.ubuntu.com/ubuntu xenial InRelease
Get:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]
Get:4 http://security.ubuntu.com/ubuntu xenial-security/multiverse Sources [1,520 B]
Get:5 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB]
Get:6 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [3,208 B]
Get:7 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main Sources [286 kB]
Get:8 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe Sources [185 kB]
Get:9 http://azure.archive.ubuntu.com/ubuntu xenial-updates/multiverse Sources [7,968 B]
Get:10 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [678 kB]
Get:11 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [565 kB]
Get:12 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [229 kB]
Get:13 http://azure.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 Packages [16.2 kB]
Fetched 2,278 kB in 1s (1,694 kB/s)
Reading package lists... Done
+ sh -c sleep 3; apt-get install -y -q dirmngr
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
libassuan0 libksba8 libnpth0
The following NEW packages will be installed:
dirmngr libassuan0 libksba8 libnpth0
0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded.
Need to get 368 kB of archives.
After this operation, 1,041 kB of additional disk space will be used.
Get:1 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libassuan0 amd64 2.4.2-2 [34.6 kB]
Get:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libksba8 amd64 1.3.3-1ubuntu0.16.04.1 [90.2 kB]
Get:3 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libnpth0 amd64 1.2-3 [7,998 B]
Get:4 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 dirmngr amd64 2.1.11-6ubuntu2 [235 kB]
Fetched 368 kB in 0s (634 kB/s)
Selecting previously unselected package libassuan0:amd64.
(Reading database ... 54174 files and directories currently installed.)
Preparing to unpack .../libassuan0_2.4.2-2_amd64.deb ...
Unpacking libassuan0:amd64 (2.4.2-2) ...
Selecting previously unselected package libksba8:amd64.
Preparing to unpack .../libksba8_1.3.3-1ubuntu0.16.04.1_amd64.deb ...
Unpacking libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ...
Selecting previously unselected package libnpth0:amd64.
Preparing to unpack .../libnpth0_1.2-3_amd64.deb ...
Unpacking libnpth0:amd64 (1.2-3) ...
Selecting previously unselected package dirmngr.
Preparing to unpack .../dirmngr_2.1.11-6ubuntu2_amd64.deb ...
Unpacking dirmngr (2.1.11-6ubuntu2) ...
Processing triggers for libc-bin (2.23-0ubuntu9) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up libassuan0:amd64 (2.4.2-2) ...
Setting up libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ...
Setting up libnpth0:amd64 (1.2-3) ...
Setting up dirmngr (2.1.11-6ubuntu2) ...
Processing triggers for libc-bin (2.23-0ubuntu9) ...
+ sh -c apt-key adv --keyserver hkp://ha.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D
Executing: /tmp/tmp.cy3a3zC5I5/gpg.1.sh --keyserver
hkp://ha.pool.sks-keyservers.net:80
--recv-keys
58118E89F3A912897C070ADBF76221572C52609D
gpg: requesting key 2C52609D from hkp server ha.pool.sks-keyservers.net
gpg: key 2C52609D: public key "Docker Release Tool (releasedocker) <docker@docker.com>" imported
gpg: Total number processed: 1
gpg: imported: 1 (RSA: 1)
+ break
+ sh -c apt-key adv -k 58118E89F3A912897C070ADBF76221572C52609D >/dev/null
+ sh -c mkdir -p /etc/apt/sources.list.d
+ dpkg --print-architecture
+ sh -c echo deb \[arch=amd64\] https://apt.dockerproject.org/repo ubuntu-xenial main > /etc/apt/sources.list.d/docker.list
+ sh -c sleep 3; apt-get update
Hit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease
Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease
Hit:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease
Get:4 https://apt.dockerproject.org/repo ubuntu-xenial InRelease [48.7 kB]
Hit:5 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease
Get:6 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 Packages [4,177 B]
Fetched 52.9 kB in 0s (127 kB/s)
Reading package lists... Done
+ + grep 1.12.6
apt-cache+ madison docker-engine
+ cut -d -f 3
head -n 1
+ sh -c apt-get install -y -q docker-engine=1.12.6-0~ubuntu-xenial
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
aufs-tools cgroupfs-mount libltdl7
Suggested packages:
mountall
The following NEW packages will be installed:
aufs-tools cgroupfs-mount docker-engine libltdl7
0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded.
Need to get 19.4 MB/19.5 MB of archives.
After this operation, 102 MB of additional disk space will be used.
Get:1 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libltdl7 amd64 2.4.6-0.1 [38.3 kB]
Get:2 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 docker-engine amd64 1.12.6-0~ubuntu-xenial [19.4 MB]
Fetched 19.4 MB in 0s (38.2 MB/s)
Selecting previously unselected package aufs-tools.
(Reading database ... 54209 files and directories currently installed.)
Preparing to unpack .../aufs-tools_1%3a3.2+20130722-1.1ubuntu1_amd64.deb ...
Unpacking aufs-tools (1:3.2+20130722-1.1ubuntu1) ...
Selecting previously unselected package cgroupfs-mount.
Preparing to unpack .../cgroupfs-mount_1.2_all.deb ...
Unpacking cgroupfs-mount (1.2) ...
Selecting previously unselected package libltdl7:amd64.
Preparing to unpack .../libltdl7_2.4.6-0.1_amd64.deb ...
Unpacking libltdl7:amd64 (2.4.6-0.1) ...
Selecting previously unselected package docker-engine.
Preparing to unpack .../docker-engine_1.12.6-0~ubuntu-xenial_amd64.deb ...
Unpacking docker-engine (1.12.6-0~ubuntu-xenial) ...
Processing triggers for libc-bin (2.23-0ubuntu9) ...
Processing triggers for man-db (2.7.5-1) ...
Processing triggers for ureadahead (0.100.0-19) ...
Processing triggers for systemd (229-4ubuntu21) ...
Setting up aufs-tools (1:3.2+20130722-1.1ubuntu1) ...
Setting up cgroupfs-mount (1.2) ...
Setting up libltdl7:amd64 (2.4.6-0.1) ...
Setting up docker-engine (1.12.6-0~ubuntu-xenial) ...
sent invalidate(passwd) request, exiting
sent invalidate(group) request, exiting
sent invalidate(group) request, exiting
Processing triggers for libc-bin (2.23-0ubuntu9) ...
Processing triggers for systemd (229-4ubuntu21) ...
Processing triggers for ureadahead (0.100.0-19) ...
+ sh -c docker version
Client:
Version: 1.12.6
API version: 1.24
Go version: go1.6.4
Git commit: 78d1802
Built: Tue Jan 10 20:38:45 2017
OS/Arch: linux/amd64
Server:
Version: 1.12.6
API version: 1.24
Go version: go1.6.4
Git commit: 78d1802
Built: Tue Jan 10 20:38:45 2017
OS/Arch: linux/amd64
If you would like to use Docker as a non-root user, you should now consider
adding your user to the "docker" group with something like:
sudo usermod -aG docker your-user
Remember that you will have to log out and back in for this to take effect!
Unable to find image 'rancher/server:v1.6.10' locally
v1.6.10: Pulling from rancher/server
6599cadaf950: Pull complete
23eda618d451: Pull complete
f0be3084efe9: Pull complete
52de432f084b: Pull complete
a3ed95caeb02: Pull complete
e75cd91a1dc5: Pull complete
997f1b48f59f: Pull complete
313c28fb4e37: Pull complete
2a0730d1275c: Pull complete
8848fbebd2c8: Pull complete
906504ea9ea6: Pull complete
9329940f8e65: Pull complete
e849debd7945: Pull complete
4883bd135dd2: Pull complete
605c6a0fe940: Pull complete
274bc004c933: Pull complete
a6cb25e8d1a2: Pull complete
3ded9d4c8c2b: Pull complete
a571d2f40012: Pull complete
Digest: sha256:096026aa3eed411077690c904cd5dd3cce66eb39312c78a84209eab23387c36d
Status: Downloaded newer image for rancher/server:v1.6.10
0437d4e2e2afa6123d416c9ec0ef8bdf0c9b4504f7c021ec8acd917ee11a3302
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 49.9M 100 49.9M 0 0 161M 0 --:--:-- --:--:-- --:--:-- 161M
--2017-12-13 08:05:57-- http://storage.googleapis.com/kubernetes-helm/helm-v2.3.0-linux-amd64.tar.gz
Resolving storage.googleapis.com (storage.googleapis.com)... 172.217.13.240, 2607:f8b0:4004:809::2010
Connecting to storage.googleapis.com (storage.googleapis.com)|172.217.13.240|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 12568314 (12M) [application/x-tar]
Saving to: ‘helm-v2.3.0-linux-amd64.tar.gz’
helm-v2.3.0-linux-amd64.tar.gz 100%[==================================================================>] 11.99M --.-KB/s in 0.1s
2017-12-13 08:05:57 (117 MB/s) - ‘helm-v2.3.0-linux-amd64.tar.gz’ saved [12568314/12568314]
linux-amd64/
linux-amd64/helm
linux-amd64/LICENSE
linux-amd64/README.md
root@onap-k8s:~# helm version
Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}
Error: cannot connect to Tiller
root@onap-k8s:~# docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
0437d4e2e2af rancher/server:v1.6.10 "/usr/bin/entry /usr/" 7 minutes ago Up 7 minutes 3306/tcp, 0.0.0.0:8880->8080/tcp admiring_ramanujan
Do the remaining manual step and assocate a host with the server (itself)
root@onap-k8s:~# sudo docker run --rm --privileged -v /var/run/docker.sock:/var/run/docker.sock -v /var/lib/rancher:/var/lib/rancher rancher/agent:v1.2.6 http://azure.onap.info:8880/v1/scripts/C2917AB10F321D556B7E:1483142400000:GtHnTWyEHpTi024KpLk99G5B7Is
Unable to find image 'rancher/agent:v1.2.6' locally
v1.2.6: Pulling from rancher/agent
b3e1c725a85f: Pull complete
6a710864a9fc: Pull complete
d0ac3b234321: Pull complete
87f567b5cf58: Pull complete
063e24b217c4: Pull complete
d0a3f58caef0: Pull complete
16914729cfd3: Pull complete
2ce3828c0b9d: Pull complete
7df47a98fc4b: Pull complete
Digest: sha256:a68afd351c7417e6d66a77e97144113ceb7a9c3cdd46fb6e1fd5f5a5a33111cd
Status: Downloaded newer image for rancher/agent:v1.2.6
INFO: Running Agent Registration Process, CATTLE_URL=http://azure.onap.info:8880/v1
INFO: Attempting to connect to: http://azure.onap.info:8880/v1
INFO: http://azure.onap.info:8880/v1 is accessible
INFO: Inspecting host capabilities
INFO: Boot2Docker: false
INFO: Host writable: true
INFO: Token: xxxxxxxx
INFO: Running registration
INFO: Printing Environment
INFO: ENV: CATTLE_ACCESS_KEY=46E75573E88F0C10A9DD
INFO: ENV: CATTLE_HOME=/var/lib/cattle
INFO: ENV: CATTLE_REGISTRATION_ACCESS_KEY=registrationToken
INFO: ENV: CATTLE_REGISTRATION_SECRET_KEY=xxxxxxx
INFO: ENV: CATTLE_SECRET_KEY=xxxxxxx
INFO: ENV: CATTLE_URL=http://azure.onap.info:8880/v1
INFO: ENV: DETECTED_CATTLE_AGENT_IP=40.71.5.147
INFO: ENV: RANCHER_AGENT_IMAGE=rancher/agent:v1.2.6
INFO: Launched Rancher Agent: 4892011a4525067d028f28ce19ec59064d8535d6855d7b052e72b5c26adbe858
root@onap-k8s:~#
root@onap-k8s:~# helm version
Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}
Error: cannot connect to Tiller
root@onap-k8s:~# vi ~/.kube/config
root@onap-k8s:~# helm version
Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}
configuration of a host - takes a bit longer on Azure - wait for it
Bring up AAI only for now
