...
Secondary Drive
VM
ARM Template
ONAP on Azure Container Service
AKS Installation
Follow https://docs.microsoft.com/en-us/azure/aks/tutorial-kubernetes-deploy-cluster
Register for AKS preview via az cli
Code Block |
---|
obrienbiometrics:obrienlabs michaelobrien$ az provider register -n Microsoft.ContainerService
Registering is still on-going. You can monitor using 'az provider show -n Microsoft.ContainerService' |
Create an AKS resource group
Raise your AKS vCPU quota - optional
http://aka.ms/corequotaincrease
https://portal.azure.com/#blade/Microsoft_Azure_Support/HelpAndSupportBlade/newsupportrequest
Code Block |
---|
Deployment failed. Correlation ID: 4b4707a7-2244-4557-855e-11bcced556de. Provisioning of resource(s) for container service onapAKSCluster in resource group onapAKS failed. Message: Operation results in exceeding quota limits of Core. Maximum allowed: 10, Current in use: 10, Additional requested: 1. Please read more about quota increase at http://aka.ms/corequotaincrease.. Details: |
Create AKS cluster
Code Block |
---|
obrienbiometrics:obrienlabs michaelobrien$ az aks create --resource-group onapAKS --name onapAKSCluster --node-count 1 --generate-ssh-keys
- Running ..
"fqdn": "onapaksclu-onapaks-f4....3.hcp.eastus.azmk8s.io", |
AKS cluster VM granularity
The cluster will start with a 3.5G VM before scaling
Resources for your AKS cluster
To Be Retrofitted
Proof Of Concept
see also ONAP on Microsoft AKS CaaS - Azure Container Service
Verified the 2 scripts to bootstrap the server and install OOM on a clean Ubuntu 16 VM on Microsoft Azure.
Get the usual 8-64 vCores, 64G+ ram, 100+ HD
Associate an IP with a DNS address for developer ease
Bootstrap the server
azure-resource-manager/resource-manager-create-first-template
Create a Storage Account
Code Block |
---|
$ az login
To sign in, use a web browser to open the page https://aka.ms/devicelogin and enter the code E...Z to authenticate.
$ az group create --name examplegroup --location "South Central US"
{
"id": "/subscriptions/f4b...e8b/resourceGroups/examplegroup",
"location": "southcentralus",
"managedBy": null,
"name": "examplegroup",
"properties": {
"provisioningState": "Succeeded"
},
"tags": null
}
obrien:obrienlabs amdocs$ vi azuredeploy_storageaccount.json
obrien:obrienlabs amdocs$ az group deployment create --resource-group examplegroup --template-file azuredeploy_storageaccount.json
{
"id": "/subscriptions/f4...e8b/resourceGroups/examplegroup/providers/Microsoft.Resources/deployments/azuredeploy_storageaccount",
"name": "azuredeploy_storageaccount",
"properties": {
"additionalProperties": {
"duration": "PT32.9822642S",
"outputResources": [
{
"id": "/subscriptions/f4..e8b/resourceGroups/examplegroup/providers/Microsoft.Storage/storageAccounts/storagekj6....kk2w",
"resourceGroup": "examplegroup"
}],
"templateHash": "11440483235727994285"},
"correlationId": "41a0f79..90c291",
"debugSetting": null,
"dependencies": [],
"mode": "Incremental",
"outputs": {},
"parameters": {},
"parametersLink": null,
"providers": [
{
"id": null,
"namespace": "Microsoft.Storage",
"registrationState": null,
"resourceTypes": [
{
"aliases": null,
"apiVersions": null,
|
Code Block |
obrienbiometrics:_artifacts michaelobrien$ scp * ubuntu@40.71.5.147:~/ obrienbiometrics:_artifacts michaelobrien$ ssh ubuntu@40.71.5.147 Warning: Permanently added '40.71.5.147' (ECDSA) to the list of known hosts. Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.11.0-1016-azure x86_64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/advantage Get cloud support with Ubuntu Advantage Cloud Guest: http://www.ubuntu.com/business/services/cloud 0 packages can be updated. 0 updates are security updates. *** System restart required *** Last login: Wed Dec 13 07:58:18 2017 from 24.114.58.216 To run a command as administrator (user "root"), use "sudo <command>". See "man sudo_root" for details. ubuntu@onap-k8s:~$ sudo su - root@onap-k8s:~# cp /home/ubuntu/* . root@onap-k8s:~# ls aai-cloud-region-put.json cd.sh down.sh git_recurse.sh onap-parameters.yaml oom_rancher_setup_1.sh up.sh root@onap-k8s:~# ./oom_rancher_setup_1.sh % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 16609 100 16609 0 0 47547 0 --:--:-- --:--:-- --:--:-- 47590 apparmor is enabled in the kernel and apparmor utils were already installed + sh -c sleep 3; apt-get update Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] Hit:2 http://azure.archive.ubuntu.com/ubuntu xenial InRelease Get:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] Get:4 http://security.ubuntu.com/ubuntu xenial-security/multiverse Sources [1,520 B] Get:5 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] Get:6 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [3,208 B] Get:7 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main Sources [286 kB] Get:8 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe Sources [185 kB] Get:9 http://azure.archive.ubuntu.com/ubuntu xenial-updates/multiverse Sources [7,968 B] Get:10 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [678 kB] Get:11 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [565 kB] Get:12 http://azure.archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [229 kB] Get:13 http://azure.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 Packages [16.2 kB] Fetched 2,278 kB in 1s (1,694 kB/s) Reading package lists... Done + sh -c sleep 3; apt-get install -y -q dirmngr Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: libassuan0 libksba8 libnpth0 The following NEW packages will be installed: dirmngr libassuan0 libksba8 libnpth0 0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded. Need to get 368 kB of archives. After this operation, 1,041 kB of additional disk space will be used. Get:1 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libassuan0 amd64 2.4.2-2 [34.6 kB] Get:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libksba8 amd64 1.3.3-1ubuntu0.16.04.1 [90.2 kB] Get:3 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libnpth0 amd64 1.2-3 [7,998 B] Get:4 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 dirmngr amd64 2.1.11-6ubuntu2 [235 kB] Fetched 368 kB in 0s (634 kB/s) Selecting previously unselected package libassuan0:amd64. (Reading database ... 54174 files and directories currently installed.) Preparing to unpack .../libassuan0_2.4.2-2_amd64.deb ... Unpacking libassuan0:amd64 (2.4.2-2) ... Selecting previously unselected package libksba8:amd64. Preparing to unpack .../libksba8_1.3.3-1ubuntu0.16.04.1_amd64.deb ... Unpacking libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ... Selecting previously unselected package libnpth0:amd64. Preparing to unpack .../libnpth0_1.2-3_amd64.deb ... Unpacking libnpth0:amd64 (1.2-3) ... Selecting previously unselected package dirmngr. Preparing to unpack .../dirmngr_2.1.11-6ubuntu2_amd64.deb ... Unpacking dirmngr (2.1.11-6ubuntu2) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Processing triggers for man-db (2.7.5-1) ... Setting up libassuan0:amd64 (2.4.2-2) ... Setting up libksba8:amd64 (1.3.3-1ubuntu0.16.04.1) ... Setting up libnpth0:amd64 (1.2-3) ... Setting up dirmngr (2.1.11-6ubuntu2) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... + sh -c apt-key adv --keyserver hkp://ha.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D Executing: /tmp/tmp.cy3a3zC5I5/gpg.1.sh --keyserver hkp://ha.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D gpg: requesting key 2C52609D from hkp server ha.pool.sks-keyservers.net gpg: key 2C52609D: public key "Docker Release Tool (releasedocker) <docker@docker.com>" imported gpg: Total number processed: 1 gpg: imported: 1 (RSA: 1) + break + sh -c apt-key adv -k 58118E89F3A912897C070ADBF76221572C52609D >/dev/null + sh -c mkdir -p /etc/apt/sources.list.d + dpkg --print-architecture + sh -c echo deb \[arch=amd64\] https://apt.dockerproject.org/repo ubuntu-xenial main > /etc/apt/sources.list.d/docker.list + sh -c sleep 3; apt-get update Hit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease Hit:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease Get:4 https://apt.dockerproject.org/repo ubuntu-xenial InRelease [48.7 kB] Hit:5 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease Get:6 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 Packages [4,177 B] Fetched 52.9 kB in 0s (127 kB/s) Reading package lists... Done + + grep 1.12.6 apt-cache+ madison docker-engine + cut -d -f 3 head -n 1 + sh -c apt-get install -y -q docker-engine=1.12.6-0~ubuntu-xenial Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: aufs-tools cgroupfs-mount libltdl7 Suggested packages: mountall The following NEW packages will be installed: aufs-tools cgroupfs-mount docker-engine libltdl7 0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded. Need to get 19.4 MB/19.5 MB of archives. After this operation, 102 MB of additional disk space will be used. Get:1 http://azure.archive.ubuntu.com/ubuntu xenial/main amd64 libltdl7 amd64 2.4.6-0.1 [38.3 kB] Get:2 https://apt.dockerproject.org/repo ubuntu-xenial/main amd64 docker-engine amd64 1.12.6-0~ubuntu-xenial [19.4 MB] Fetched 19.4 MB in 0s (38.2 MB/s) Selecting previously unselected package aufs-tools. (Reading database ... 54209 files and directories currently installed.) Preparing to unpack .../aufs-tools_1%3a3.2+20130722-1.1ubuntu1_amd64.deb ... Unpacking aufs-tools (1:3.2+20130722-1.1ubuntu1) ... Selecting previously unselected package cgroupfs-mount. Preparing to unpack .../cgroupfs-mount_1.2_all.deb ... Unpacking cgroupfs-mount (1.2) ... Selecting previously unselected package libltdl7:amd64. Preparing to unpack .../libltdl7_2.4.6-0.1_amd64.deb ... Unpacking libltdl7:amd64 (2.4.6-0.1) ... Selecting previously unselected package docker-engine. Preparing to unpack .../docker-engine_1.12.6-0~ubuntu-xenial_amd64.deb ... Unpacking docker-engine (1.12.6-0~ubuntu-xenial) ... Processing triggers for libc-bin (2.23-0ubuntu9) ... Processing triggers for man-db (2.7.5-1) ... Processing triggers for ureadahead (0.100.0-19) ... Processing triggers for systemd (229-4ubuntu21) ... Setting up aufs-tools (1:3.2+20130722-1.1ubuntu1) ... Setting up cgroupfs-mount (1.2) ... Setting up libltdl7:amd64 (2.4.6-0.1) ... Setting up docker-engine (1.12.6-0~ubuntu-xenial) ... sent invalidate(passwd) request, exiting sent invalidate(group) request, exiting sent invalidate(group) request, exiting Processing triggers for libc-bin (2.23-0ubuntu9) ... Processing triggers for systemd (229-4ubuntu21) ... Processing triggers for ureadahead (0.100.0-19) ... + sh -c docker version Client: Version: 1.12.6 API version: 1.24 Go version: go1.6.4 Git commit: 78d1802 Built: Tue Jan 10 20:38:45 2017 OS/Arch: linux/amd64 Server: Version: 1.12.6 API version: 1.24 Go version: go1.6.4 Git commit: 78d1802 Built: Tue Jan 10 20:38:45 2017 OS/Arch: linux/amd64 If you would like to use Docker as a non-root user, you should now consider adding your user to the "docker" group with something like: sudo usermod -aG docker your-user Remember that you will have to log out and back in for this to take effect! Unable to find image 'rancher/server:v1.6.10' locally v1.6.10: Pulling from rancher/server 6599cadaf950: Pull complete 23eda618d451: Pull complete f0be3084efe9: Pull complete 52de432f084b: Pull complete a3ed95caeb02: Pull complete e75cd91a1dc5: Pull complete 997f1b48f59f: Pull complete 313c28fb4e37: Pull complete 2a0730d1275c: Pull complete 8848fbebd2c8: Pull complete 906504ea9ea6: Pull complete 9329940f8e65: Pull complete e849debd7945: Pull complete 4883bd135dd2: Pull complete 605c6a0fe940: Pull complete 274bc004c933: Pull complete a6cb25e8d1a2: Pull complete 3ded9d4c8c2b: Pull complete a571d2f40012: Pull complete Digest: sha256:096026aa3eed411077690c904cd5dd3cce66eb39312c78a84209eab23387c36d Status: Downloaded newer image for rancher/server:v1.6.10 0437d4e2e2afa6123d416c9ec0ef8bdf0c9b4504f7c021ec8acd917ee11a3302 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 49.9M 100 49.9M 0 0 161M 0 --:--:-- --:--:-- --:--:-- 161M --2017-12-13 08:05:57-- http://storage.googleapis.com/kubernetes-helm/helm-v2.3.0-linux-amd64.tar.gz Resolving storage.googleapis.com (storage.googleapis.com)... 172.217.13.240, 2607:f8b0:4004:809::2010 Connecting to storage.googleapis.com (storage.googleapis.com)|172.217.13.240|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 12568314 (12M) [application/x-tar] Saving to: ‘helm-v2.3.0-linux-amd64.tar.gz’ helm-v2.3.0-linux-amd64.tar.gz 100%[==================================================================>] 11.99M --.-KB/s in 0.1s 2017-12-13 08:05:57 (117 MB/s) - ‘helm-v2.3.0-linux-amd64.tar.gz’ saved [12568314/12568314] linux-amd64/ linux-amd64/helm linux-amd64/LICENSE linux-amd64/README.md root@onap-k8s:~# helm version Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"} Error: cannot connect to Tiller root@onap-k8s:~# docker ps -a CONTAINER ID IMAGE "locations": [ COMMAND "southcentralus" ], CREATED "properties": null, STATUS "resourceType": "storageAccounts" PORTS }]}], "provisioningState": "Succeeded", "template": null, "templateLink": null, "timestamp": "2018-02-17T16:15:11.562170+00:00" NAMES}, 0437d4e2e2af rancher/server:v1.6.10 "/usr/bin/entry /usr/" 7 minutes ago Up 7 minutes 3306/tcp, 0.0.0.0:8880->8080/tcp admiring_ramanujan |
Do the remaining manual step and assocate a host with the server (itself)
Code Block |
---|
root@onap-k8s:~# sudo docker run --rm --privileged -v /var/run/docker.sock:/var/run/docker.sock -v /var/lib/rancher:/var/lib/rancher rancher/agent:v1.2.6 http://azure.onap.info:8880/v1/scripts/C2917AB10F321D556B7E:1483142400000:GtHnTWyEHpTi024KpLk99G5B7Is
Unable to find image 'rancher/agent:v1.2.6' locally
v1.2.6: Pulling from rancher/agent
b3e1c725a85f: Pull complete
6a710864a9fc: Pull complete
d0ac3b234321: Pull complete
87f567b5cf58: Pull complete
063e24b217c4: Pull complete
d0a3f58caef0: Pull complete
16914729cfd3: Pull complete
2ce3828c0b9d: Pull complete
7df47a98fc4b: Pull complete
Digest: sha256:a68afd351c7417e6d66a77e97144113ceb7a9c3cdd46fb6e1fd5f5a5a33111cd
Status: Downloaded newer image for rancher/agent:v1.2.6
INFO: Running Agent Registration Process, CATTLE_URL=http://azure.onap.info:8880/v1
INFO: Attempting to connect to: http://azure.onap.info:8880/v1
INFO: http://azure.onap.info:8880/v1 is accessible
INFO: Inspecting host capabilities
INFO: Boot2Docker: false
INFO: Host writable: true
INFO: Token: xxxxxxxx
INFO: Running registration
INFO: Printing Environment
INFO: ENV: CATTLE_ACCESS_KEY=46E75573E88F0C10A9DD
INFO: ENV: CATTLE_HOME=/var/lib/cattle
INFO: ENV: CATTLE_REGISTRATION_ACCESS_KEY=registrationToken
INFO: ENV: CATTLE_REGISTRATION_SECRET_KEY=xxxxxxx
INFO: ENV: CATTLE_SECRET_KEY=xxxxxxx
INFO: ENV: CATTLE_URL=http://azure.onap.info:8880/v1
INFO: ENV: DETECTED_CATTLE_AGENT_IP=40.71.5.147
INFO: ENV: RANCHER_AGENT_IMAGE=rancher/agent:v1.2.6
INFO: Launched Rancher Agent: 4892011a4525067d028f28ce19ec59064d8535d6855d7b052e72b5c26adbe858
root@onap-k8s:~#
root@onap-k8s:~# helm version
Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}
Error: cannot connect to Tiller
root@onap-k8s:~# vi ~/.kube/config
root@onap-k8s:~# helm version
Client: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.3.0", GitCommit:"d83c245fc324117885ed83afc90ac74afed271b4", GitTreeState:"clean"} |
"resourceGroup": "examplegroup"} |
Create a VM
https://github.com/Azure/azure-quickstart-templates/tree/master/101-acs-kubernetes
https://docs.microsoft.com/en-us/azure/azure-resource-manager/resource-group-template-deploy
Code Block |
---|
az group create --name onapKubernetes --location eastus
"id": "/subscriptions/f.8b/resourceGroups/onapKubernetes"
# use example
# https://github.com/Azure/azure-quickstart-templates/tree/master/101-vm-simple-linux
# validate first
obrien:obrienlabs amdocs$ az group deployment validate --resource-group onapKubernetes --template-file oom_azure_arm_deploy.json --parameters @oom_azure_arm_deploy_parameters.json
obrien:obrienlabs amdocs$ az group deployment create --resource-group onapKubernetes --template-file oom_azure_arm_deploy.json --parameters @oom_azure_arm_deploy_parameters.json |
ONAP on Azure Container Service
AKS Installation
Follow https://docs.microsoft.com/en-us/azure/aks/tutorial-kubernetes-deploy-cluster
Register for AKS preview via az cli
Code Block |
---|
obrienbiometrics:obrienlabs michaelobrien$ az provider register -n Microsoft.ContainerService
Registering is still on-going. You can monitor using 'az provider show -n Microsoft.ContainerService' |
Create an AKS resource group
Raise your AKS vCPU quota - optional
http://aka.ms/corequotaincrease
https://portal.azure.com/#blade/Microsoft_Azure_Support/HelpAndSupportBlade/newsupportrequest
Code Block |
---|
Deployment failed. Correlation ID: 4b4707a7-2244-4557-855e-11bcced556de. Provisioning of resource(s) for container service onapAKSCluster in resource group onapAKS failed. Message: Operation results in exceeding quota limits of Core. Maximum allowed: 10, Current in use: 10, Additional requested: 1. Please read more about quota increase at http://aka.ms/corequotaincrease.. Details: |
Create AKS cluster
Code Block |
---|
obrienbiometrics:obrienlabs michaelobrien$ az aks create --resource-group onapAKS --name onapAKSCluster --node-count 1 --generate-ssh-keys
- Running ..
"fqdn": "onapaksclu-onapaks-f4....3.hcp.eastus.azmk8s.io", |
AKS cluster VM granularity
The cluster will start with a 3.5G VM before scaling
Resources for your AKS cluster
configuration of a host - takes a bit longer on Azure - wait for it
Bring up AAI only for now
...