Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Info

This is not published to gerrit yetStarting with the Frankfurt release, this method is deprecated and this page will no longer be maintained. Visit this page for instructions on executing the testsuite.


About

This page contains instructions for executing the VNF Lifecycle Validation automation flow for heat-based VNFs. The result will be a .tar.gz file that can be used to submit to the OVP Portal to obtain a certification badge for a VNF. The execution is very similar to running the other ONAP demo VNFs, however there are some additional steps detailed below. 

...

The script to execute the testsuite is located in the OOM project. Clone the OOM repository and cd to the robot folder.


Code Block
$ git clone httpsssh://github<username>@gerrit.com/onap.org:29418/oom.git --recurse-submodules
$ cd oom/kubernetes/robot
$ ./instantiate-k8s.sh --help
./instantiate-k8s.sh [options]
 
required:
-n, --namespace <namespace>       namespace that robot pod is running under.
-f, --folder <folder>             path to folder containing heat templates, preloads, and vnf-details.json.
 
additional options:
-p, --poll                        some cloud environments (like azure) have a short time out value when executing
                                  kubectl. If your shell exits before the testsuite finishes, using this option
                                  will poll the testsuite logs every 30 seconds until the test finishes.
-t, --tag <tag>                   robot testcase tag to execute (default is instantiate_vnf).
 
This script executes the VNF instantiation robot testsuite.
- It copies the VNF folder to the robot container that is part of the ONAP deployment.
- It models, distributes, and instantiates a heat-based VNF.
- It copies the logs to an output directory, and creates a tarball for upload to the OVP portal.


...

Once the testsuite is finished, it will create a directory and tarball in /tmp (the name of the directory and file is shown at the end of the stdout of the script). There will be a results.json in that directory that has the ultimate outcome of the test, in the structure shown below.

results.json

Log files

The output file will have 4 log files in it.

  • results.json: This is high-level results file of all of the test steps, and is consumed by the OVP portal.
  • report.json: This is the output of the vvp validation scripts.
  • stack_report.json: This is the output from querying openstack to validate the heat modules.
  • log.html: This is the robot log, and contains each execution step of the testcase.

results.json


Code Block
{
Code Block
{
    "vnf_checksum": "afc57604a3b3b7401d5b8648328807b594d7711355a2315095ac57db4c334a50", 
    "build_tag": "vnf-validation-53270", 
    "version": "2019.09", 
    "test_date": "2019-09-04 17:50:10.575", 
    "durationvnf_checksum": 437.002"afc57604a3b3b7401d5b8648328807b594d7711355a2315095ac57db4c334a50", 
    "vnfbuild_typetag": "heatvnf-validation-53270", 
    "testcases_listversion": ["2019.09", 
    "test_date":    {"2019-09-04 17:50:10.575", 
    "duration": 437.002, 
    "vnf_type": "heat", 
    "testcases_list": [
        {
            "mandatory": "true", 
            "name": "onap-vvp.validate.heat", 
            "result": "PASS", 
            "objective": "onap heat template validation", 
            "sub_testcase": [], 
            "portal_key_file": "report.json"
        }, 
        {
            "mandatory": "true", 
            "name": "onap-vvp.lifecycle_validate.heat", 
            "result": "PASS", 
            "objective": "onap vnf lifecycle validation", 
            "sub_testcase": [
                {
                    "name": "model-and-distribute", 
                    "result": "PASS"
                }, 
                {
                    "name": "instantiation", 
                    "result": "PASS"
                }
            ], 
            "portal_key_file": "log.html"
        }, 
        {
            "mandatory": "true", 
            "name": "stack_validation", 
            "result": "PASS", 
            "objective": "onap vnf openstack validation", 
            "sub_testcase": [], 
            "portal_key_file": "stack_report.json"
        }
    ]
}

...

If the result is "PASS", that means the testsuite was successful and the tarball is ready for submission to the OVP portal.

Examples

Attached to this page are simple examples that you can use to try out the testcase, along with the output tarballs that are generated. To run one of the examples, download one of the zip files named input-* and unzip it to your computer, then follow the instructions from the section Running the testsuite above.

View file
nameinput-VNF-API-fail-single_module.zip
height250
View file
nameinput-VNF-API-pass-single_module.zip
height250
View file
namevnf_heat_results-fail-vnfapi-singlemodule.tar.gz
height250
View file
namevnf_heat_results-pass-vnfapi-singlemodule.tar.gz
height250