Table of Contents |
---|
This page is currently a WIP for the next 2 weeks starting 20180214. Deliverables will deployment scripts, arm/cli templates for various deployment scenarios (single, multiple, federated servers)
ONAP on Azure VMs
Pre-requisite
The supported versions are as follows:
...
being migrated (version 93 - ONAP on Kubernetes on Microsoft Azure) to read the docs along with all the other pages in this section.
http://onap.readthedocs.io/en/latest/submodules/oom.git/docs/oom_cloud_setup_guide.html
Kubernetes based onap continuous deployment WIP content continues - here - Cloud Native Deployment#MicrosoftAzure
20180214 Work Session
Jira | ||||||
---|---|---|---|---|---|---|
|
Requirements
Azure subscription
Installation
AZ cli
https://docs.microsoft.com/en-us/cli/azure/install-azure-cli?view=azure-cli-latest
Will install Python 3.6
Code Block |
---|
brew update && brew install azure-cli |
https://docs.microsoft.com/en-us/cli/azure/get-started-with-azure-cli?view=azure-cli-latest
Code Block |
---|
obrienbiometrics:obrienlabs michaelobrien$ az login
To sign in, use a web browser to open the page https://aka.ms/devicelogin and enter the code EG9KBECSD to authenticate.
[ {
"cloudName": "AzureCloud",
"id": "f4...b",
"isDefault": true,
"name": "Pay-As-You-Go",
"state": "Enabled",
"tenantId": "bcb.....f",
"user": {
"name": "michael@....org",
"type": "user"
}}] |
Reference Server
http://azure.onap.info:8880/r/projects/1a7/kubernetes-dashboard:9090/#!/pod?namespace=_all
Cluster Configuration
Single Server
Azure Artifacts
Static IP
Secondary Drive
VM
ARM Template
ONAP on Azure Container Service
Follow https://docs.microsoft.com/en-us/azure/aks/tutorial-kubernetes-deploy-cluster
Register for AKS preview via az clii
Code Block |
---|
obrienbiometrics:obrienlabs michaelobrien$ az provider register -n Microsoft.ContainerService
Registering is still on-going. You can monitor using 'az provider show -n Microsoft.ContainerService' |
To Be Retrofitted
Proof Of Concept
see also ONAP on Microsoft AKS CaaS - Azure Container Service
Verified the 2 scripts to bootstrap the server and install OOM on a clean Ubuntu 16 VM on Microsoft Azure.
Get the usual 8-64 vCores, 64G+ ram, 100+ HD
Associate an IP with a DNS address for developer ease
Bootstrap the server
Code Block |
---|
obrienbiometrics:_artifacts michaelobrien$ scp * ubuntu@40.71.5.147:~/
obrienbiometrics:_artifacts michaelobrien$ ssh ubuntu@40.71.5.147
Warning: Permanently added '40.71.5.147' (ECDSA) to the list of known hosts.
Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.11.0-1016-azure x86_64)
* Documentation: https://help.ubuntu.com
* Management: https://landscape.canonical.com
* Support: https://ubuntu.com/advantage
Get cloud support with Ubuntu Advantage Cloud Guest:
http://www.ubuntu.com/business/services/cloud
0 packages can be updated.
0 updates are security updates.
*** System restart required ***
Last login: Wed Dec 13 07:58:18 2017 from 24.114.58.216
To run a command as administrator (user "root"), use "sudo <command>".
See "man sudo_root" for details.
ubuntu@onap-k8s:~$ sudo su -
root@onap-k8s:~# cp /home/ubuntu/* .
root@onap-k8s:~# ls
aai-cloud-region-put.json cd.sh down.sh git_recurse.sh onap-parameters.yaml oom_rancher_setup_1.sh up.sh
root@onap-k8s:~# ./oom_rancher_setup_1.sh
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 16609 100 16609 0 0 47547 0 --:--:-- --:--:-- --:--:-- 47590
apparmor is enabled in the kernel and apparmor utils were already installed
+ sh -c sleep 3; apt-get update
Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Hit:2 http://azure.archive.ubuntu.com/ubuntu xenial InRelease
Get:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]
Get:4 http://security.ubuntu.com/ubuntu xenial-security/multiverse Sources [1,520 B]
Get:5 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB]
Get:6 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [3,208 B]
Get:7 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main Sources [286 kB]
Get:8 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe Sources [185 kB]
Get:9 http://azure.archive.ubuntu.com/ubuntu xenial-updates/multiverse Sources [7,968 B]
Get:10 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [678 kB]
Get:11 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [565 kB]
Get:12 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [229 kB]
Get:13 http://azure.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 Packages [16.2 kB]
Fetched 2,278 kB in 1s (1,694 kB/s)
Reading package lists... Done
+ sh -c sleep 3; apt-get install -y -q dirmngr
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
libassuan0 libksba8 libnpth0
The following NEW packages will be installed:
dirmngr libassuan0 libksba8 libnpth0
0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded.
Need to get 368 kB of archives.
After this operation, 1,041 kB of additional disk space will be used.
Get:1 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libassuan0 amd64 2.4.2-2 [34.6 kB]
Get:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libksba8 amd64 1.3.3-1ubuntu0.16.04.1 [90.2 kB]
Get:3 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libnpth0 amd64 1.2-3 [7,998 B]
Get:4 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 dirmngr amd64 2.1.11-6ubuntu2 [235 kB]
Fetched 368 kB in 0s (634 kB/s)
Selecting previously unselected package libassuan0:amd64.
(Reading database ... 54174 files and directories currently installed.)
Preparing to unpack .../libassuan0_2.4.2-2_amd64.deb ...
Unpacking libassuan0:amd64 (2.4.2-2) ...
Selecting previously unselected package libksba8:amd64.
Preparing to unpack .../libksba8_1.3.3-1ubuntu0.16.04.1_amd64.deb ...
Unpacking libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ...
Selecting previously unselected package libnpth0:amd64.
Preparing to unpack .../libnpth0_1.2-3_amd64.deb ...
Unpacking libnpth0:amd64 (1.2-3) ...
Selecting previously unselected package dirmngr.
Preparing to unpack .../dirmngr_2.1.11-6ubuntu2_amd64.deb ...
Unpacking dirmngr (2.1.11-6ubuntu2) ...
Processing triggers for libc-bin (2.23-0ubuntu9) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up libassuan0:amd64 (2.4.2-2) ...
Setting up libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ...
Setting up libnpth0:amd64 (1.2-3) ...
Setting up dirmngr (2.1.11-6ubuntu2) ...
Processing triggers for libc-bin (2.23-0ubuntu9) ...
+ sh -c apt-key adv --keyserver hkp://ha.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D
Executing: /tmp/tmp.cy3a3zC5I5/gpg.1.sh --keyserver
hkp://ha.pool.sks-keyservers.net:80
--recv-keys
58118E89F3A912897C070ADBF76221572C52609D
gpg: requesting key 2C52609D from hkp server ha.pool.sks-keyservers.net
gpg: key 2C52609D: public key "Docker Release Tool (releasedocker) <docker@docker.com>" imported
gpg: Total number processed: 1
gpg: imported: 1 (RSA: 1)
+ break
+ sh -c apt-key adv -k 58118E89F3A912897C070ADBF76221572C52609D >/dev/null
+ sh -c mkdir -p /etc/apt/sources.list.d
+ dpkg --print-architecture
+ sh -c echo deb \[arch=amd64\] https://apt.dockerproject.org/repo ubuntu-xenial main > /etc/apt/sources.list.d/docker.list
+ sh -c sleep 3; apt-get update
Hit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease
Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease
Hit:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease
Get:4 https://apt.dockerproject.org/repo ubuntu-xenial InRelease [48.7 kB]
Hit:5 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease
Get:6 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 Packages [4,177 B]
Fetched 52.9 kB in 0s (127 kB/s)
Reading package lists... Done
+ + grep 1.12.6
apt-cache+ madison docker-engine
+ cut -d -f 3
head -n 1
+ sh -c apt-get install -y -q docker-engine=1.12.6-0~ubuntu-xenial
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
aufs-tools cgroupfs-mount libltdl7
Suggested packages:
mountall
The following NEW packages will be installed:
aufs-tools cgroupfs-mount docker-engine libltdl7
0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded.
Need to get 19.4 MB/19.5 MB of archives.
After this operation, 102 MB of additional disk space will be used.
Get:1 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libltdl7 amd64 2.4.6-0.1 [38.3 kB]
Get:2 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 docker-engine amd64 1.12.6-0~ubuntu-xenial [19.4 MB]
Fetched 19.4 MB in 0s (38.2 MB/s)
Selecting previously unselected package aufs-tools.
(Reading database ... 54209 files and directories currently installed.)
Preparing to unpack .../aufs-tools_1%3a3.2+20130722-1.1ubuntu1_amd64.deb ...
Unpacking aufs-tools (1:3.2+20130722-1.1ubuntu1) ...
Selecting previously unselected package cgroupfs-mount.
Preparing to unpack .../cgroupfs-mount_1.2_all.deb ...
Unpacking cgroupfs-mount (1.2) ...
Selecting previously unselected package libltdl7:amd64.
Preparing to unpack .../libltdl7_2.4.6-0.1_amd64.deb ...
Unpacking libltdl7:amd64 (2.4.6-0.1) ...
Selecting previously unselected package docker-engine.
Preparing to unpack .../docker-engine_1.12.6-0~ubuntu-xenial_amd64.deb ...
Unpacking docker-engine (1.12.6-0~ubuntu-xenial) ...
Processing triggers for libc-bin (2.23-0ubuntu9) ...
Processing triggers for man-db (2.7.5-1) ...
Processing triggers for ureadahead (0.100.0-19) ...
Processing triggers for systemd (229-4ubuntu21) ...
Setting up aufs-tools (1:3.2+20130722-1.1ubuntu1) ...
Setting up cgroupfs-mount (1.2) ...
Setting up libltdl7:amd64 (2.4.6-0.1) ...
Setting up docker-engine (1.12.6-0~ubuntu-xenial) ...
sent invalidate(passwd) request, exiting
sent invalidate(group) request, exiting
sent invalidate(group) request, exiting
Processing triggers for libc-bin (2.23-0ubuntu9) ...
Processing triggers for systemd (229-4ubuntu21) ...
Processing triggers for ureadahead (0.100.0-19) ...
+ sh -c docker version
Client:
Version: 1.12.6
API version: 1.24
Go version: go1.6.4
Git commit: 78d1802
Built: Tue Jan 10 20:38:45 2017
OS/Arch: linux/amd64
Server:
Version: 1.12.6
API version: 1.24
Go version: go1.6.4
Git commit: 78d1802
Built: Tue Jan 10 20:38:45 2017
OS/Arch: linux/amd64
If you would like to use Docker as a non-root user, you should now consider
adding your user to the "docker" group with something like:
sudo usermod -aG docker your-user
Remember that you will have to log out and back in for this to take effect!
Unable to find image 'rancher/server:v1.6.10' locally
v1.6.10: Pulling from rancher/server
6599cadaf950: Pull complete
23eda618d451: Pull complete
f0be3084efe9: Pull complete
52de432f084b: Pull complete
a3ed95caeb02: Pull complete
e75cd91a1dc5: Pull complete
997f1b48f59f: Pull complete
313c28fb4e37: Pull complete
2a0730d1275c: Pull complete
8848fbebd2c8: Pull complete
906504ea9ea6: Pull complete
9329940f8e65: Pull complete
e849debd7945: Pull complete
4883bd135dd2: Pull complete
605c6a0fe940: Pull complete
274bc004c933: Pull complete
a6cb25e8d1a2: Pull complete
3ded9d4c8c2b: Pull complete
a571d2f40012: Pull complete
Digest: sha256:096026aa3eed411077690c904cd5dd3cce66eb39312c78a84209eab23387c36d
Status: Downloaded newer image for rancher/server:v1.6.10
0437d4e2e2afa6123d416c9ec0ef8bdf0c9b4504f7c021ec8acd917ee11a3302
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 49.9M 100 49.9M 0 0 161M 0 --:--:-- --:--:-- --:--:-- 161M
--2017-12-13 08:05:57-- http://storage.googleapis.com/kubernetes-helm/helm-v2.3.0-linux-amd64.tar.gz
Resolving storage.googleapis.com (storage.googleapis.com)... 172.217.13.240, 2607:f8b0:4004:809::2010
Connecting to storage.googleapis.com (storage.googleapis.com)|172.217.13.240|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 12568314 (12M) [application/x-tar]
Saving to: ‘helm-v2.3.0-linux-amd64.tar.gz’
helm-v2.3.0-linux-amd64.tar.gz 100%[==================================================================>] 11.99M --.-KB/s in 0.1s
2017-12-13 08:05:57 (117 MB/s) - ‘helm-v2.3.0-linux-amd64.tar.gz’ saved [12568314/12568314]
linux-amd64/
linux-amd64/helm
linux-amd64/LICENSE
linux-amd64/README.md
root@onap-k8s:~# helm version
Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}
Error: cannot connect to Tiller
root@onap-k8s:~# docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
0437d4e2e2af rancher/server:v1.6.10 "/usr/bin/entry /usr/" 7 minutes ago Up 7 minutes 3306/tcp, 0.0.0.0:8880->8080/tcp admiring_ramanujan
|
Do the remaining manual step and assocate a host with the server (itself)
Code Block |
---|
root@onap-k8s:~# sudo docker run --rm --privileged -v /var/run/docker.sock:/var/run/docker.sock -v /var/lib/rancher:/var/lib/rancher rancher/agent:v1.2.6 http://azure.onap.info:8880/v1/scripts/C2917AB10F321D556B7E:1483142400000:GtHnTWyEHpTi024KpLk99G5B7Is
Unable to find image 'rancher/agent:v1.2.6' locally
v1.2.6: Pulling from rancher/agent
b3e1c725a85f: Pull complete
6a710864a9fc: Pull complete
d0ac3b234321: Pull complete
87f567b5cf58: Pull complete
063e24b217c4: Pull complete
d0a3f58caef0: Pull complete
16914729cfd3: Pull complete
2ce3828c0b9d: Pull complete
7df47a98fc4b: Pull complete
Digest: sha256:a68afd351c7417e6d66a77e97144113ceb7a9c3cdd46fb6e1fd5f5a5a33111cd
Status: Downloaded newer image for rancher/agent:v1.2.6
INFO: Running Agent Registration Process, CATTLE_URL=http://azure.onap.info:8880/v1
INFO: Attempting to connect to: http://azure.onap.info:8880/v1
INFO: http://azure.onap.info:8880/v1 is accessible
INFO: Inspecting host capabilities
INFO: Boot2Docker: false
INFO: Host writable: true
INFO: Token: xxxxxxxx
INFO: Running registration
INFO: Printing Environment
INFO: ENV: CATTLE_ACCESS_KEY=46E75573E88F0C10A9DD
INFO: ENV: CATTLE_HOME=/var/lib/cattle
INFO: ENV: CATTLE_REGISTRATION_ACCESS_KEY=registrationToken
INFO: ENV: CATTLE_REGISTRATION_SECRET_KEY=xxxxxxx
INFO: ENV: CATTLE_SECRET_KEY=xxxxxxx
INFO: ENV: CATTLE_URL=http://azure.onap.info:8880/v1
INFO: ENV: DETECTED_CATTLE_AGENT_IP=40.71.5.147
INFO: ENV: RANCHER_AGENT_IMAGE=rancher/agent:v1.2.6
INFO: Launched Rancher Agent: 4892011a4525067d028f28ce19ec59064d8535d6855d7b052e72b5c26adbe858
root@onap-k8s:~#
root@onap-k8s:~# helm version
Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}
Error: cannot connect to Tiller
root@onap-k8s:~# vi ~/.kube/config
root@onap-k8s:~# helm version
Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"} |
configuration of a host - takes a bit longer on Azure - wait for it