We will use vFW use case as the baseline to test this:

Pre-requirement: Instantiate a vFW with closed loop running.


VNF Onboarding and Distribution:

Pod DeletedStart TimeDurationResultLogsNotes

dev-aai-aai-77d8c648b4-qzsqp

22:14:21

05:06

SUCCESS

1


dev-aai-aai-babel-6c4f8878bd-2qcn7

22:19:29

06:03

SUCCESS

2


dev-aai-aai-champ-5777c455dd-n24fn

22:25:32

08:15

SUCCESS

3


dev-aai-aai-data-router-d4cc5584d-5rfzl

22:33:48

06:40

SUCCESS

4


dev-aai-aai-elasticsearch-75bcf895c5-jhlxv

22:40:29

07:10

SUCCESS

5


dev-aai-aai-gizmo-78f58874d7-g7qqj

22:47:40

04:52

SUCCESS

6


dev-aai-aai-graphadmin-85b977c7df-4rwg5

22:52:33

04:49

SUCCESS

7


dev-aai-aai-modelloader-7cf5648d8f-kkcpz

22:57:23

07:14

SUCCESS

8


dev-aai-aai-resources-6964945c8f-7fr69

23:04:38

06:02

SUCCESS

9


dev-aai-aai-schema-service-6c644cdcf6-wrn8z

23:10:40

05:00

SUCCESS

10


dev-aai-aai-search-data-66b7d59877-4t4sl

23:15:41

05:04

SUCCESS

11


dev-aai-aai-sparky-be-56df767478-5r6sl

23:20:46

04:55

SUCCESS

12


dev-aai-aai-spike-f958fdf6-k5qg8

23:25:42

06:43

SUCCESS

13


dev-aai-aai-traversal-cd7c55df8-hqkgq

23:32:26

04:18

SUCCESS

14


dev-cassandra-cassandra-0

23:36:45

08:24

SUCCESS

15


dev-sdc-sdc-be-56d8f658-t8hlt

23:45:10

08:31

SUCCESS

16


dev-sdc-sdc-dcae-be-6dd4df6cf6-bg2kv

23:53:42

07:45

SUCCESS

17


dev-sdc-sdc-dcae-dt-6f669b4d4c-l4h8l

00:01:27

07:13

SUCCESS

18


dev-sdc-sdc-dcae-fe-684f4495b7-9d5qv

00:08:41

04:49

SUCCESS

19


dev-sdc-sdc-dcae-tosca-lab-74cf68f5ff-drrh6

00:13:31

04:07

SUCCESS

20


dev-sdc-sdc-es-76c4b9f57b-ltdtm

00:17:39

05:52

SUCCESS

21


dev-sdc-sdc-fe-6577f8fb4f-rc8hl

00:23:32

07:09

SUCCESS

22


dev-sdc-sdc-kb-559976fd47-v7m5l

00:30:42

07:05

SUCCESS

23


dev-sdc-sdc-onboarding-be-84cc8bb944-9jv6m

00:37:47

08:59

SUCCESS

24


dev-sdc-sdc-wfd-be-56c7747ffc-7j5wl

00:46:47

04:35

SUCCESS

25


dev-sdc-sdc-wfd-fe-c487c8b75-gjrbj

00:51:23

05:21

SUCCESS

26


dev-sdnc-cds-blueprints-processor-7b4bfdb55f-745nh

00:56:44

05:57

SUCCESS

27


dev-sdnc-cds-command-executor-fbb9857b-vmbww

01:02:42

07:06

SUCCESS

28


dev-sdnc-cds-controller-blueprints-6649d85898-sb8wr

01:09:48

08:46

SUCCESS

29


dev-sdnc-cds-db-0

01:18:35

06:56

SUCCESS

30


dev-sdnc-cds-sdc-listener-695c8fdc75-6kt4f

01:25:31

05:00

SUCCESS

31


dev-sdnc-cds-ui-794bbf9fb5-s7jpb

01:30:32

07:12

SUCCESS

32


dev-sdnc-nengdb-0

01:37:45

04:51

SUCCESS

33


dev-sdnc-network-name-gen-5bd65b8f99-85vwm

01:42:37

07:11

SUCCESS

34


dev-sdnc-sdnc-0

01:49:48

05:53

SUCCESS

35


dev-sdnc-sdnc-ansible-server-57bdc47678-nztcz

01:55:42

08:45

SUCCESS

36


dev-sdnc-sdnc-dgbuilder-86bd576dc9-j7b2s

02:04:28

05:00

SUCCESS

37


dev-sdnc-sdnc-dmaap-listener-858d6568d4-grd25

02:09:28

04:11

SUCCESS

38


dev-sdnc-sdnc-ueb-listener-6756b97f98-hmpmx

02:13:40

06:53

SUCCESS

39


dev-so-so-bpmn-infra-5bfc99c6d8-qkkkp

02:20:34

04:59

SUCCESS

40


dev-so-so-catalog-db-adapter-767dd889f5-647pc

02:25:33

07:12

SUCCESS

41


dev-so-so-df69f5bb7-sfw54

02:32:46

04:49

SUCCESS

42


dev-so-so-monitoring-848c945fb6-qm9cj

02:37:36

04:57

SUCCESS

43


dev-so-so-openstack-adapter-5cfb9d7cc9-fkjcq

02:42:33

06:10

SUCCESS

44


dev-so-so-request-db-adapter-579dccb955-79msn

02:48:45

04:47

SUCCESS

45


dev-so-so-sdc-controller-58f5cbbb9f-4llzm

02:53:33

08:07

SUCCESS

46


dev-so-so-sdnc-adapter-75545c8b6b-mxkwq

03:01:41

07:47

SUCCESS

47


dev-so-so-vfc-adapter-6b7d95f564-xncbj

03:09:29

07:12

SUCCESS

48


dev-so-so-vnfm-adapter-796b97b6b7-pgzwt

03:16:42

07:49

SUCCESS

49



VNF Instantiation: 

Pod DeletedStart TimeDurationResultLogsNotes

dev-aai-aai-77d8c648b4-rg924

20:10:51

03:31

FAILURE

5

Chromium/Selenium failure on VID

dev-aai-aai-babel-6c4f8878bd-rjc2x

20:14:22

07:18

SUCCESS

6


dev-aai-aai-champ-5777c455dd-7lrd5

20:21:41

09:35

SUCCESS

7


dev-aai-aai-data-router-d4cc5584d-4q5s6

20:31:16

02:45

FAILURE

8

Chromium/Selenium failure on VID

dev-aai-aai-elasticsearch-75bcf895c5-dpstp

20:34:02

08:28

SUCCESS

9


dev-aai-aai-gizmo-78f58874d7-mz2ns

20:42:30

07:59

SUCCESS

10


dev-aai-aai-graphadmin-85b977c7df-7pdl7

20:50:30

08:26

SUCCESS

11


dev-aai-aai-modelloader-7cf5648d8f-frbgz

20:58:57

07:58

SUCCESS

12


dev-aai-aai-resources-6964945c8f-ctpln

21:06:55

08:40

SUCCESS

13


dev-aai-aai-schema-service-6c644cdcf6-hbl2d

21:15:36

03:24

FAILURE

14

Chromium/Selenium failure on VID

dev-aai-aai-search-data-66b7d59877-7nwpg

21:19:01

06:12

FAILURE

15

Chromium/Selenium failure on VID

dev-aai-aai-sparky-be-56df767478-5x9vp

21:25:13

08:25

SUCCESS

16


dev-aai-aai-spike-f958fdf6-sgr57

21:33:39

08:05

SUCCESS

17


dev-aai-aai-traversal-cd7c55df8-fjfxx

21:41:45

18:35

SUCCESS

18


dev-cassandra-cassandra-0

22:00:21

15:57

SUCCESS

19


dev-mariadb-galera-mariadb-galera-0

22:16:19

20:00

SUCCESS

20


dev-multicloud-multicloud-976ff7b8-gl4fd

22:36:20

08:57

SUCCESS

21


dev-multicloud-multicloud-azure-589669c4b5-bs7fx

22:45:17

06:55

FAILURE

22

Chromium/Selenium failure on VID

dev-multicloud-multicloud-fcaps-59779c855-hv7wc

22:52:12

08:32

SUCCESS

23


dev-multicloud-multicloud-k8s-6dfb987cc6-wwqvq

23:00:44

08:36

SUCCESS

24


dev-multicloud-multicloud-k8s-etcd-0

23:09:21

08:02

SUCCESS

25


dev-multicloud-multicloud-k8s-mongo-0

23:17:24

07:59

SUCCESS

26


dev-multicloud-multicloud-lenovo-db4fd57f5-kdksx

23:25:24

08:12

SUCCESS

27


dev-multicloud-multicloud-ocata-88cb4c8c7-n2n4l

23:33:37

08:22

SUCCESS

28


dev-multicloud-multicloud-pike-6b899d5d-zddct

23:42:00

13:28

SUCCESS

29


dev-multicloud-multicloud-starlingx-779f94d5cf-tcj2t

23:55:29

08:40

SUCCESS

30


dev-multicloud-multicloud-vio-76db6c7fbf-nm6x2

00:04:10

08:08

SUCCESS

31


dev-multicloud-multicloud-windriver-5cd7574896-g55t8

00:12:18

08:18

SUCCESS

32


dev-sdc-sdc-be-56d8f658-q7rst

00:20:36

09:21

SUCCESS

33


dev-sdc-sdc-dcae-be-6dd4df6cf6-nhtxj

00:29:58

12:32

FAILURE

34

Chromium/Selenium failure on VID

dev-sdc-sdc-dcae-dt-6f669b4d4c-vsswr

00:42:30

11:15

FAILURE

35

Chromium/Selenium failure on VID

dev-sdc-sdc-dcae-fe-684f4495b7-g4t47

00:53:46

27:34

FAILURE

36

404 on AAI POST

dev-sdc-sdc-dcae-tosca-lab-74cf68f5ff-mq4c2

01:21:21

07:58

SUCCESS

37


dev-sdc-sdc-es-76c4b9f57b-gdgq8

01:29:19

09:20

FAILURE

38

Chromium/Selenium failure on VID

dev-sdc-sdc-fe-6577f8fb4f-97g9c

01:38:40

07:37

FAILURE

39

404 on AAI POST

dev-sdc-sdc-kb-559976fd47-pwfzb

01:46:18

03:19

FAILURE

40

Chromium/Selenium failure on VID

dev-sdc-sdc-onboarding-be-84cc8bb944-62z4z

01:49:38

09:16

SUCCESS

41


dev-sdc-sdc-wfd-be-56c7747ffc-5td7j

01:58:55

08:12

SUCCESS

42


dev-sdc-sdc-wfd-fe-c487c8b75-mjnfc

02:07:08

08:33

SUCCESS

43


dev-sdnc-cds-blueprints-processor-7b4bfdb55f-gdrqv

02:15:42

09:48

SUCCESS

44


dev-sdnc-cds-command-executor-fbb9857b-qnd6w

02:25:31

08:21

SUCCESS

45


dev-sdnc-cds-controller-blueprints-6649d85898-lbxsk

02:33:52

09:13

SUCCESS

46


dev-sdnc-cds-db-0

02:43:06

07:40

SUCCESS

47


dev-sdnc-cds-sdc-listener-695c8fdc75-24hmd

02:50:47

08:10

SUCCESS

48


dev-sdnc-cds-ui-794bbf9fb5-fxj6j

02:58:57

08:13

SUCCESS

49


dev-sdnc-nengdb-0

03:07:11

03:04

FAILURE

50

Chromium/Selenium failure on VID

dev-sdnc-network-name-gen-5bd65b8f99-8z26h

03:10:16

03:42

FAILURE

51

Chromium/Selenium failure on VID

dev-sdnc-sdnc-0

03:13:58

04:32

FAILURE

52

Chromium/Selenium failure on VID

dev-sdnc-sdnc-ansible-server-57bdc47678-cdw5l

03:18:31

10:27

SUCCESS

53


dev-sdnc-sdnc-dgbuilder-86bd576dc9-g46l6

03:28:59

08:16

SUCCESS

54


dev-sdnc-sdnc-dmaap-listener-858d6568d4-2fbfl

03:37:15

11:45

SUCCESS

55


dev-sdnc-sdnc-ueb-listener-6756b97f98-vjtwl

03:49:01

07:40

SUCCESS

56


dev-so-so-bpmn-infra-5bfc99c6d8-2nzp5

03:56:42

08:24

SUCCESS

57


dev-so-so-catalog-db-adapter-767dd889f5-rffbc

04:05:06

03:36

FAILURE

58

Chromium/Selenium failure on VID

dev-so-so-df69f5bb7-d95lx

04:08:42

06:49

FAILURE

59

Chromium/Selenium failure on VID

dev-so-so-monitoring-848c945fb6-zbpjw

04:15:32

06:58

FAILURE

60

Chromium/Selenium failure on VID

dev-so-so-openstack-adapter-5cfb9d7cc9-8gmh8

04:22:31

08:16

SUCCESS

61


dev-so-so-request-db-adapter-579dccb955-2jxhb

04:30:48

08:24

SUCCESS

62


dev-so-so-sdc-controller-58f5cbbb9f-hjltw

04:39:13

08:42

SUCCESS

63


dev-so-so-sdnc-adapter-75545c8b6b-hlqcz

04:47:55

06:59

FAILURE

64

Chromium/Selenium failure on VID

dev-so-so-vfc-adapter-6b7d95f564-6gf8s

04:54:55

08:56

SUCCESS

65


dev-so-so-vnfm-adapter-796b97b6b7-xtkrc

05:03:52

08:58

SUCCESS

66


dev-vid-vid-5547b8d577-lvggt

05:12:51

08:43

FAILURE

67

404 on AAI POST

dev-vid-vid-mariadb-galera-0

05:21:34

01:23

FAILURE

68

 VID is unrecoverable once vid-mariadb-galera-0 pod is deleted; no clear manual recovery steps available.  This bug was found during Casablanca Resilience Testing but still has not been fixed.

Closed Loop:

Pod DeletedStart TimeDurationResultLogsNotes

dep-dcae-dashboard-5c9ddbd7d5-bwbhk

14:22:52

04:06

SUCCESS

2


dep-dcae-hv-ves-collector-7f8bcddc4b-mnzv2

14:26:58

03:20

SUCCESS

3


dep-dcae-prh-5695c8b78c-rnfx5

14:30:19

03:01

SUCCESS

4


dep-dcae-snmptrap-collector-96d5858f6-tnk27

14:33:21

03:50

SUCCESS

5


dep-dcae-tca-analytics-7868c85b85-mtn45

14:37:11

04:14

SUCCESS

6


dep-dcae-ves-collector-66b74dffbf-knt4j

14:41:25

04:10

SUCCESS

7


dep-holmes-engine-mgmt-54cf76654f-rsslm

14:45:35

03:50

SUCCESS

8


dep-holmes-rule-mgmt-7b7f94b59-9hjls

14:49:26

04:06

SUCCESS

9


dev-aai-aai-77d8c648b4-p4b4w

14:53:33

03:51

SUCCESS

10


dev-aai-aai-babel-6c4f8878bd-vg2d2

14:57:24

03:05

SUCCESS

11


dev-aai-aai-champ-5777c455dd-xmbrb

15:00:30

05:22

SUCCESS

12


dev-aai-aai-data-router-d4cc5584d-4mgkd

15:05:53

03:00

SUCCESS

13


dev-aai-aai-elasticsearch-75bcf895c5-v82w8

15:08:53

05:01

SUCCESS

14


dev-aai-aai-gizmo-78f58874d7-gdgc8

15:13:55

04:38

SUCCESS

15


dev-aai-aai-graphadmin-85b977c7df-2jkfl

15:18:33

03:59

SUCCESS

16


dev-aai-aai-modelloader-7cf5648d8f-xj9rr

15:22:33

03:50

SUCCESS

17


dev-aai-aai-resources-6964945c8f-brdfs

15:26:23

03:29

SUCCESS

18


dev-aai-aai-schema-service-6c644cdcf6-7lr2n

15:29:53

04:00

SUCCESS

19


dev-aai-aai-search-data-66b7d59877-gc69g

15:33:53

03:49

SUCCESS

20


dev-aai-aai-sparky-be-56df767478-wzs5g

15:37:43

03:50

SUCCESS

21


dev-aai-aai-spike-f958fdf6-c7hqh

15:41:34

03:13

SUCCESS

22


dev-aai-aai-traversal-cd7c55df8-9tkg5

15:44:47

02:34

SUCCESS

23


dev-appc-appc-0

15:47:22

14:21

SUCCESS

24


dev-appc-appc-ansible-server-0

16:01:44

05:00

SUCCESS

25


dev-appc-appc-cdt-856b465f4-4pq2p

16:06:44

04:12

SUCCESS

26


dev-appc-appc-db-0

16:10:56

03:35

SUCCESS

27


dev-appc-appc-dgbuilder-5fbfccb55-snf2t

16:14:32

03:58

SUCCESS

28


dev-cassandra-cassandra-0

16:18:31

06:25

SUCCESS

29


dev-dcaegen2-dcae-bootstrap-56bf5f5b77-hk9dv

16:24:56

03:56

SUCCESS

30


dev-dcaegen2-dcae-cloudify-manager-5d5cd6d667-66lcn

16:28:53

04:50

SUCCESS

31


dev-dcaegen2-dcae-config-binding-service-7c9466d94b-n6f6d

16:33:43

05:47

SUCCESS

32


dev-dcaegen2-dcae-db-0

16:39:31

03:06

SUCCESS

33


dev-dcaegen2-dcae-deployment-handler-76bc887fcd-czxzg

16:42:38

03:56

SUCCESS

34


dev-dcaegen2-dcae-healthcheck-7f5d5586f5-bl5bm

16:46:34

03:57

SUCCESS

35


dev-dcaegen2-dcae-inv-pg-0

16:50:31

03:05

SUCCESS

36


dev-dcaegen2-dcae-inv-pgpool-75cf498b5f-hzcl4

16:53:37

02:53

SUCCESS

37


dev-dcaegen2-dcae-inv-pgpool-75cf498b5f-xpnh7

16:56:30

03:00

SUCCESS

38


dev-dcaegen2-dcae-inventory-api-6bd7f59547-72cfl

16:59:31

04:07

SUCCESS

39


dev-dcaegen2-dcae-pgpool-7f64667b9-5sjhr

17:03:38

02:52

SUCCESS

40


dev-dcaegen2-dcae-pgpool-7f64667b9-9fdq2

17:06:31

03:06

SUCCESS

41


dev-dcaegen2-dcae-policy-handler-768579866d-qkn9j

17:09:37

06:54

SUCCESS

42


dev-dcaegen2-dcae-redis-0

17:16:32

04:00

SUCCESS

43


dev-dcaegen2-dcae-servicechange-handler-687664985d-n52mv

17:20:32

04:01

SUCCESS

44


dev-dmaap-dbc-pg-0

17:24:34

03:43

SUCCESS

45


dev-dmaap-dbc-pgpool-5fb9d89d5c-c4fbn

17:28:17

03:20

SUCCESS

46


dev-dmaap-dbc-pgpool-5fb9d89d5c-tgrp4

17:31:38

02:52

SUCCESS

47


dev-dmaap-dmaap-bc-8654446979-bst95

17:34:31

04:00

SUCCESS

48


dev-dmaap-dmaap-dr-db-0

17:38:31

02:59

SUCCESS

49


dev-dmaap-dmaap-dr-node-0

17:41:31

05:57

SUCCESS

50


dev-dmaap-dmaap-dr-prov-84b6f85d98-8hv5l

17:47:28

05:41

SUCCESS

51


dev-dmaap-message-router-0

17:53:10

05:28

SUCCESS

52


dev-dmaap-message-router-kafka-0

17:58:39

03:36

SUCCESS

53


dev-dmaap-message-router-mirrormaker-748b75fc48-5llpm

18:02:15

03:08

SUCCESS

54


dev-dmaap-message-router-zookeeper-0

18:05:23

03:12

SUCCESS

55


dev-mariadb-galera-mariadb-galera-0

18:08:36

02:35

SUCCESS

56


dev-policy-brmsgw-6d4f9c6567-mt4g4

18:11:11

03:05

SUCCESS

57


dev-policy-drools-0

18:14:17

06:17

SUCCESS

58


dev-policy-nexus-6f6fcb6675-h7dnf

18:20:34

03:39

SUCCESS

59


dev-policy-pap-654966b459-w4bsd

18:24:14

02:56

SUCCESS

60


dev-policy-pdp-0

18:27:11

03:02

SUCCESS

61


dev-policy-policy-apex-pdp-0

18:30:14

03:14

SUCCESS

62


dev-policy-policy-api-8bbff857d-qx5xm

18:33:29

02:36

SUCCESS

63


dev-policy-policy-distribution-8497d87554-nhl5d

18:36:05

03:08

SUCCESS

64


dev-policy-policy-pap-6d65cb4f99-lqhzj

18:39:13

02:51

SUCCESS

65


dev-policy-policy-xacml-pdp-65bbc9697f-s8c5s

18:42:05

03:06

SUCCESS

66


dev-policy-policydb-7f56989bf-llqtm

18:45:11

05:20

SUCCESS

67