...
Beijing requires the following to run: Note there is a 110 pod limit per VM - we currently deploy 175+ pods - hence 2+ VMs for full deployment
- Full production/staging
- Minimum 2 VMs, 12vCores total, 96G total ram, 100G HD per VM
- Recommended 3-9 VMs, 24-64 vCores, 128+ total ram, 160G HD per VM + 1 8G/100G kubernetes master VM
- Developer:
- Minimum 1 VM at 4+ vCores, 16-64G ram, 100G HD - collocated kubernetes master, host and jumpbox (deploys a subset of ONAP)
- Recommended 3 VMs 1x8G kubernetes master and 2 x 64G hosts
Amazon AWS
Minimum Deployment costs
20190305: Dublin state
Cost is ~$10/day or $300/month per 128G deployment – (I happen to have 128G worth of VMs running on the 75% off spot market – including cost effective R4 instances, EBS store and EFS NFS) – 2 deployments and dev cost will run under $1k US. Based on the level of funding we will go with pure IaaS VMs up to the EKS PaaS for K8s – but that runs over $20/day. Ideally we should be running 160G+ clusters but 128G is ok for specific VNFs like the vFW - https://wiki.onap.org/display/DW/Cloud+Native+Deployment#CloudNativeDeployment-AmazonAWS
For details on ONAP deployment via OOM on Kubernetes see Cloud Native Deployment#AmazonAWS
Color coded costs are Required, Maximum, Medium, Minimum
Total US $/month
(0*)
EBS
cost (3*)
Total US $/month (0*) | EBS cost (3*) |
---|
spot vm/hr |
---|
75% off | # |
---|
vCore | Ram | HD (min) | Flavor | Use | Description | ||||
---|---|---|---|---|---|---|---|---|---|
$66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | DevOps | Jump box - cloudformation |
$66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | DevOps | Jenkins server |
$66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | DevOps | Kibana (ELK) server |
$89 x 4 = $354 | $0.06 | $0.063 | 4 | 4 | 31 | 100g | R4.xlarge | DevOps | Minimum CD cluster 1* |
$66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | DevOps | Minimum CD master |
$238 x 4 = $950 | $0.06 | $0.27 | 4 | 16 | 122 | 100g | R4.4xlarge | DevOps | production CD cluster 1* |
$66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | DevOps | production kubernetes master |
$138 x 4 = $552 | $0.06 | $0.13 | 4 | 8 | 61 |
100g | R4.2xlarge | DevOps | staging cluster 2* | ||||||
$66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | staging kubernetes master | |
$89 x 4 = |
$354 | $0. |
12 | $0.063 | 4 | 4 | 31 | 320g | R4.xlarge | DevOps | long duration cluster |
$110 | $0. |
12 | $0.032 | 1 | 2 | 15 | 320g | R4.large | long duration cluster k8s master | ||
$138 x 2 = $276 | $0.06 | $0.13 | 2 | 8 | 61 | 100g | R4.2xlarge | Dev | developer cluster |
$66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | developer cluster kubernetes master | |
$138 | $0.06 | $0.13 | 1 | 8 | 61 | 100g | R4.2xlarge | Dev | developer onap subset collocated VM |
$0 | $0 | $0 | Route53 DNS/EIP $2/month per unused EIP | ||||||
$0 | $0 | $0 | VPC, NG |
, SG, IAM, (network costs) | |||||||||
Total cost / month - SPOT (max CD prod cluster - max dev cluster x 1) | $66 + $66 + $66 + $950 + $66 + $354 + $110 + $276 + $66 = $2020/month = $24.2k/year US (4*) | ||||||||
Total cost / month - SPOT ( |
medium CD prod cluster - |
min dev cluster x 1) | $66 + $66 + $66 + |
$552 + $66 + |
$354 + |
$110 + |
$138 = |
$1418/month = |
$17k/year US (4*) | ||||||||
Total cost / month - SPOT ( |
minimum CD cluster - min dev cluster |
- collocated host) | $66 + $66 + $66 + |
$354 + $66 + |
$276 = |
(4*)
$894/month = |
$11K US |
Total cost / month - reserved |
Notes:
0 - assumes us-east-1 region (us-east-2 region is cleaper (ohio) but the spot market there is more unstable) - if you use ohio - cut costs by about 40% for spot - ie: r4.2xlarg is 0.13 but 0.07 in ohio)
...
Code Block |
---|
SPOT only { "IamFleetRole": "arn:aws:iam::4532790942004.....:role/aws-ec2-spot-fleet-tagging-role", "AllocationStrategy": "lowestPrice", "TargetCapacity": 1, "SpotPrice": "0.532", "ValidFrom": "2018-01-31T20:31:16Z", "ValidUntil": "2019-01-31T20:31:16Z", "TerminateInstancesWithExpiration": true, "LaunchSpecifications": [ { "ImageId": "ami-aa2ea6d0", "InstanceType": "r4.2xlarge", "KeyName": "obrien_systems_aws_20141115obr...15", "SpotPrice": "0.532", "BlockDeviceMappings": [ { "DeviceName": "/dev/sda1", "Ebs": { "DeleteOnTermination": true, "VolumeType": "gp2", "VolumeSize": 120, "SnapshotId": "snap-0dcc947e7c10bed94" } } ], "SecurityGroups": [ { "GroupId": "sg-de2185a9" } ] } ], "Type": "request" } |
...