Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Full test application flow is shown on diagram below

draw.io Diagram
bordertrue
diagramNamecps-load-test-flow-diagram
simpleViewerfalse
width
linksauto
tbstyletop
lboxtrue
diagramWidth831
revision1

Test Data

Yang model (schema set) based on:

...

Full data JSON is (taken as is from from RFC-8944 Appendix-B):

Update data:

...

Remote services were deployed as docker containers. Docker was running on same machine.

draw.io Diagram
bordertrue
diagramNamecps-load-test-deployment-diagram
simpleViewerfalse
width
linksauto
tbstyletop
lboxtrue
diagramWidth761
revision1


Hardware details

Laptop DELL Latitude 5500

  • Processors: 8 × Intel® Core™ i7-8665U CPU @ 1.90GHz
  • Memory: 15,5 GiB of RAM
  • lshw > lshwlshw > lshw.txt

Software details

OS

  • Operating System: Kubuntu 20.04
  • KDE Plasma Version: 5.18.5
  • KDE Frameworks Version: 5.68.0
  • Qt Version: 5.12.8
  • Kernel Version: 5.4.0-70-generic
  • OS Type: 64-bit

...

  • OpenJDK version 13.0.4, 2020-07-14
  • OpenJDK Runtime Environment (build 13.0.4+8-Ubuntu-120.04)
  • OpenJDK 64-Bit Server VM (build 13.0.4+8-Ubuntu-120.04, mixed mode)
  • java -XX:+PrintFlagsFinal -version > javajava-print-flags-final.txt


Test Results

CPS revision

Tested CPS from a master branch at state on  
representing the Honolulu 1.0.1 + DELETE ANCHOR functionality targeted for Istanbul release

Operation execution time

The operation per seconds was calculated as 1000/(exec time in millis).

...

Threads: 2
Circles: 500
Threads: 10
Circles: 100

Image Added

Image Added


Threads: 20
Circles: 50
Threads: 50
Circles: 20

Image Added

Image Added

Following (calculated by default) heap settings were used:

...

Full dump of JVM flags is listed in attachment javaattachment java-print-flags-final.txt


Test Application

Source

The source of test application is attached: cps-load-test-application.zip

Setting up

Unzip into cps folder.

Update root pom.xml file to include cps-load-test-application

Code Block
languagexml
titlecps/pom.xml
collapsetrue
...
    <modules>
        <module>cps-dependencies</module>
        <module>cps-bom</module>
        <module>cps-parent</module>
        <module>cps-service</module>
        <module>cps-rest</module>
        <module>cps-ncmp-service</module>
        <module>cps-ncmp-rest</module>
        <module>cps-ri</module>
        <module>checkstyle</module>
        <module>spotbugs</module>
        <module>cps-application</module>
        <!-- add following-line -->
        <module>cps-load-test-application</module>
    </modules>
...

Refresh the maven project. New module will appear as on screenshot below

Image Added

Create run configuration using same environment variables as for core CPS Application

Image Added

Tests related configuration is allocated within cps-load-test-application/src/main/resources/application.yml in load-test section 
like below

Code Block
languageyml
titleapplication.yml
collapsetrue
load-test:
    preset:
        dataspace: test-dataspace
        schema-set: test-schema-set
        anchor-prefix: test-anchor-
    embedded:
        enabled: true
    remote:
        enabled: true
        # resources zip file is corrupted on build, so referencing original from resources
        resources-zip: src/main/resources/yang/network-topology.zip
        base-url: http://localhost:8883/cps/api/
        auth:
            username: ***
            password: ***
    # number of threads
    threads: 50
    # number of times the flow repeated within a thread
    circles: 20
    # thread termination timeout
    termination-timeout-seconds: 1200

spring:
...