Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Amazon AWS is currently hosting our RI for ONAP Continuous Deployment on my private account for now - I have requested a grant specific to the jenkins, kibana and cd instances.ONAP on Amazon EC2

see Cloud Native Deployment#AmazonAWS

see

TSC 2019-01-03

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyTSC-25

https://lists.onap.org/g/onap-discuss/topic/cd_task_force_tsc_25_meetings/29001640?p=,,,20,0,0,0::recentpostdate%2Fsticky,,,20,2,0,29001640

ONAP Live AWS CD Servers

ServerURLNotes

Live Amsterdam Cassablanca/master server


http://amsterdammaster.onap.info:8880

Login to Rancher/Kubernetes only in the last 45 min of the hour

Use the system only in the last 10 min of the hour

Currently off until the account resets to the next bill on 2nd Jan

Jenkins serverhttp://jenkins.onap.info/job/oom-cd/

view deployment status, deployment (pod up status)

Paused until 2 Jan 2018

Kibana server

http://kibana.onap.info:5601query "message" logs or view the dashboard

CD Architecture

Image Added


CD Demo Videos



20171210 showing a full

CD job on the jenkins server

View file
name20171210_f2f3_cd_jenkins_kibana_amsterdam.mp4
height250



...

Shane Daniel has created a dashboard on our AWS POC that can be used to diagnose the health of the current hourly build based on logs generated by the health check running in robot off an hourly deploy of ONAP OOM (CI triggers are pending)

Image Modified

For example there was a hard coded token in kube2msb that was causing some healthcheck failures - notice the drop in failures 3 hours ago within an hour after the submit to the OOM framework (Immediate because the config is not currently part of the daily-only docker builds) 

https://gerrit.onap.org/r/#/c/27943/ for

https://jira.onap.org/browse/OOM-570

Image Added

Automated POC ONAP CD Infrastructure

...

DI 5: 20171112: Strategy for Manual Config of Rancher 1.6 for Auto Create/Delete of CD VM

ONAP on Kubernetes on Amazon EC2EC2#AWSCLIEC2CreationandDeployment

Code Block
#20171029 POC working on EC2 Spot using AMI preconfigured with Rancher 1.6 server/client
aws ec2 request-spot-instances --spot-price "0.25" --instance-count 1 --type "one-time" --launch-specification file://aws_ec2_spot_cli.json
aws ec2 associate-address --instance-id i-048637ed92da66bf6 --allocation-id eipalloc-375c1d02
# DNS record set type A changes take 20 sec to propagate the internet - for a dig command to see them
aws ec2 reboot-instances --instance-ids i-048637ed92da66bf6

root@ip-172-31-68-153:~# kubectl cluster-info
Kubernetes master is running at https://url.onap.info:8880/r/projects/1a7/kubernetes:6

...

Cannot get creation access to https://jenkins.onap.org/sandbox/ via Jenkins -> Configuring Jenkins Jobs

current ssh config

/var/jenkins_home/workspace/shared_aws_201801.pem

...

/var/jenkins_home/workspace/shared_aws_201801.pem obr..._aws_20141115.pem

Automated ONAP CD Infrastructure

We need sufficient resources to run two (amsterdam and beijing/master) deployments either hourly or on commit-trigger demand. 

We also need devops infrastructure to provision the servers (an ARM DMZ jumbox), run the jenkins container and ELK containers (a single Kubernetes cluster)

Resources

ONAP Deployment Specification for Finance and Operations#AmazonAWS

nameproviderserverIP/DNSportresource grouptypevpc/vnsgaclcert/passsubnethostingtemplatepurpose
ons-dmzAzureons-dmzons-dmz.onap.cloud
ons-dmzvm
bastion


Microsoftdmz-jenkinsbastion/jumpbox
jenkinsAzureons-dmz-jenkinsjenkins.onap.cloud80ons-dmz-jenkinsdc




Microsoftdmz-jenkinsjenkins
kibanaAzureons-dmz-kibanakibana.onap.cloud5601
dc




Microsoftdmz-jenkinskibana
amsterdam-hourlyAzureonap-amsterdamamsterdam.onap.cloud

k8s
k8s


Microsofts
beijing-hourlyAzureonap-beijingbeijing.onap.cloud

k8s
k8s


Microsoft

chaos monkey b*Azure
chaos.onap.cloud

k8s




Microsoft
hammer the system up/down

AWSons-dmz




bastion




bastion/jumpbox
jenkinsAWSons-dmz-jenkinsjenkins.onap.info80ons-dmzdc


admin
m*n*

private

kibanaAWSons-dmz-kibanakibana.onap.info5601ons-dmzdc




private

amsterdam

amsterdam.onap.info

k8s
k8s


Amazon

beijing
ons-brookhavenbeijing.onap.info

k8s
k8s


Amazon

Performance

Static Server 4 hour Deploy Frequency

Image Added

Resource Deployment Scripts

Azure

Code Block
# for recreation
ubuntu@ons-dmz:~$ sudo ./oom_deployment.sh -b amsterdam -s amsterdam.onap.cloud -e onap -r a_ONAP_CD_amsterdam_nodelete -t _arm_deploy_onap_cd.json -p _arm_deploy_onap_cd_a_parameters.json 



Links

OOM Deployment Status

...