...
# | Environment/Workload | Description |
|---|---|---|
| 1 | Tested on | laptop : |
| 2 | Docker-compose | Docker-compose file: https://gerrit.onap.org/r/gitweb?p=cps.git;a=blob_plain;f=docker-compose/docker-compose.yml;hb=aa29f24b0da9b9d2c86a0c528357a17ff3d7a871 |
| 3 | cURL | De-Register CM Handles cURL |
| 4 | Number of CPS Instance | 1 |
| 5 | Number Modules per Cm Handle | 10 |
| 6 | Commit ID (before improvement) | |
| 7 | Commit ID (after improvement 1) | 7421c69 Use native query to delete data nodes |
| 8 | Commit ID (improvement 2) | a0aa860 CmHandle batch deletion |
# | Component | Configuration Parameters | Value |
|---|---|---|---|
| 1 | CPS | notifactions:enabled | true |
| 2 | CPS | config.additional.notification.data-updated.filters.dataspaces.enabled-dataspaces | "NON-EXISTING-DATASPACE" |
| 3 | NCMP | modules-sync-watchdog:async-executor:parallelism-level | 10 |
Test Results before any improvement (Commit Id: 9c56b30)
Total CM Handles | Total Time | CM handles/sec | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
# | Before deletion | After deletion | Deleted | ||||||||
| 1 | 500 | 0 | 500 | 2m 9s | 3.86 | ||||||
| 2 | 1,000 | 0 | 1,000 | 8m 3s | 2.07 | ||||||
| 3 | 2,000 | 0 | 2,000 | 32m 8s | 1.04 | ||||||
| 4 | 2,300 | 0 | 2,300 | 37m 58s | 1.01 | 5 | 1,000 | 500 | 500 | 5m 58s | 1.40 |
| 65 | 1,500 | 1,000 | 500 | 9m 46s | 0.85 | ||||||
| 76 | 2,000 | 1,500 | 500 | 12m 5s | 0.69 | ||||||
| 87 | 2,000 | 1,000 | 1,000 | 23m 33s | 0.71 | ||||||
Test Results after improvement (Commit Id :
...
7421c69
...
Use native query to delete data nodes
...
)
Total CM Handles | Total Time | CM handles/sec | Speedup over 9c56b30 | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
# | Before deletion | After deletion | Deleted | |||||||
| 1 | 500 | 0 | 500 | 11.5 s | 43.33 | 11 x | ||||
| 2 | 1,000 | 0 | 1,000 | 33.7 s29.69 | 30 | 14 x | ||||
| 3 | 2,000 | 0 | 2,000 | 1m 45s | 19.08 | 18 x | ||||
| 4 | 3,000 | 0 | 3,000 | 3m 41s | 14 | - | ||||
| 5 | 4,0002,300 | 0 | 2,300 | 2m 22s | 16.23 | 16 x | 4,000 | 8m 53s | 8 | - |
| 6 | 5,000 | 0 | 5,000 | 11m 23s | 7 | - | ||||
| 75 | 1,000 | 500 | 500 | 19.6 s25.48 | 26 | 18 x | ||||
| 68 | 1,500 | 1,000 | 500 | 27.2 s | 18.41 | 22 x | ||||
| 79 | 2,000 | 1,500 | 500 | 37.8 s | 13.22 | 19 x | 19 | |||
| 10 | 2,500 | 2,000 | 500 | 42.3 s | 12 | - | ||||
| 118 | 2,000 | 1,000 | 1,000 | 1m 10s | 14.2220 x | 20 | ||||
Test Results after improvement (Commit Id : a0aa860 CmHandle batch deletion)
Total CM Handles | Total Time | CM handles/sec | Speedup over 7421c69 | |||
|---|---|---|---|---|---|---|
# | Before deletion | After deletion | Deleted | |||
| 1 | 500 | 0 | 500 | 5.74 s | 87 | 2.0 |
| 2 | 1,000 | 0 | 1,000 | 11.7 s | 85 | 2.9 |
| 3 | 2,000 | 0 | 2,000 | 32.2 s | 62 | 3.3 |
| 4 | 3,000 | 0 | 3,000 | 1m 4s | 47 | 3.5 |
| 5 | 4,000 | 0 | 4,000 | 1m 33s | 43 | 5.7 |
| 6 | 5,000 | 0 | 5,000 | 2m 19s | 36 | 4.9 |
| 7 | 1,000 | 500 | 500 | 6.4 s | 78 | 3.1 |
| 8 | 1,500 | 1,000 | 500 | 7.8 s | 65 | 3.5 |
| 9 | 2,000 | 1,500 | 500 | 9.6 s | 52 | 3.9 |
| 10 | 2,500 | 2,000 | 500 | 9.7 s | 51 | 4.4 |
| 11 | 2,000 | 1,000 | 1,000 | 17.0 s | 59 | 3.7 |
Performance of CM Handle Deregistration 2023-02-02.xlsx
Delete performance scenario on Nordix : (Commit id : 7421c69)
| # | Test Scenario | Nordix Build 1 (ms) | Nordix Build 2 (ms) | Nordix Build 3 (ms) | Groovy test deleteDurationInMillis (ms) |
|---|---|---|---|---|---|
| 1 | Delete root node with many descendants | 165 | 168 | 166 | 200 |
| 2 | Delete data nodes for an anchor | 172 | 210 | 169 | 250 |
| 3 | Delete 50 grandchildren (that have no descendants): | 304 | 232 | 263 | 350 |
| 4 | Delete 5 whole lists with many elements | 796 | 852 | 758 | 1,000 |
| 5 | Delete 5 children with grandchildren | 222 | 232 | 225 | 300 |
| 6 | Delete 10 list elements with keys | 1,019 | 1,097 | 990 | 1,200 |
| 7 | Delete 1 large data node with many descendants: | 2,008 | 1,938 | 2,136 | 2,500 |
Delete performance scenario on Nordix : (Commit id : 230b111)
| # | Test Scenario | Nordix Build 1 (ms) | Nordix Build 2 (ms) | Nordix Build 3 (ms) | Nordix Build 4 (ms) | Average (ms) | Groovy test deleteDurationInMillis (ms) |
|---|---|---|---|---|---|---|---|
| 1 | Delete 5 children | 249 | 259 | 251 | 263 | 256 | 350 |
| 2 | Batch delete 100 children | 216 | 227 | 230 | 231 | 226 | 350 |
| 3 | Delete 50 grandchildren | 234 | 361 | 304 | 254 | 283 | 350 |
| 4 | Batch delete 500 grandchildren | 226 | 234 | 227 | 219 | 227 | 350 |
| 5 | Delete 5 whole lists | 1,120 | 1,156 | 1,047 | 1,124 | 1112 | 1,500 |
| 6 | Batch delete 100 whole lists | 310 | 311 | 340 | 329 | 323 | 350 |
| 7 | Delete 10 lists elements | 501 | 499 | 476 | 492 | 492 | 750 |
| 8 | Batch delete 500 |
...
| lists elements | 230 | 238 | 227 | 223 | 230 | 350 | |
| 9 | Delete one large node | 214 | 233 | 251 | 226 | 231 | 300 |
| 10 | Batch delete one large node | 156 | 182 | 156 | 176 | 168 | 300 |
| 11 | Delete root node | 168 | 173 | 166 | 166 | 168 | 300 |
| 12 | Delete data nodes for anchor | 170 | 172 | 164 | 168 | 168 | 300 |
Instrumentation sample
- Register, read and de-register 1,000 CM Handles
- Docker environment on Laptop
- Commit: https://gerrit.onap.org/r/c/cps/+/132960
...