dcae controller-startup.sh stalls after initiating vm-docker-host-1

 
1
0
-1

This issue seems very strange. Somehow dcae controller-startup.sh stalls.


NETWORKPATH=/openstack/locations/$ZONE/projects/OPEN-ECOMP/networks/$NETWORK
KEYPATH=/openstack/locations/$ZONE/projects/OPEN-ECOMP/keypairs/$OPENSTACK_KEYNAME
FLAVORPATH=/openstack/locations/$ZONE/flavors/$FLAVOR

## wait for flavor but since flavor name may have spaces which 'wait-for' does not support we do this hack
## wait 11 minutes

i=0
until [ $i = "66" ]; do
((i++))
waiting for data/resources//openstack/locations/bm01/flavors/m1.mlarge
if [ -e "data/resources/$FLAVORPATH" ]; then break; fi
echo waiting for data/resources/$FLAVORPATH
sleep 10
done

sleep 1m
bin/dcae-controller.sh wait-for --timeout 300 --frequency 5 --path $NETWORKPATH --exists --verbose
bin/dcae-controller.sh wait-for --timeout 300 --frequency 5 --path $KEYPATH --exists --verbose
bin/dcae-controller.sh deploy-service-instance -i $ZONE -s vm-docker-host-1



I would not say this happens every time but I have seen this problem multiple times.

  1. kranthi guttikonda

    Complete logs....


    sleep 1m
    bin/dcae-controller.sh wait-for --timeout 300 --frequency 5 --path $NETWORKPATH --exists --verbose
    bin/dcae-controller.sh wait-for --timeout 300 --frequency 5 --path $KEYPATH --exists --verbose
    bin/dcae-controller.sh deploy-service-instance -i $ZONE -s vm-docker-host-1
    Mon Jun 26 23:00:31 GMT 2017 java.net.SocketTimeoutException: Read timed out
    java.net.SocketTimeoutException: Read timed out
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:153)
    at java.net.SocketInputStream.read(SocketInputStream.java:122)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
    at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
    at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:707)
    at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:650)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1371)
    at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
    at org.openecomp.ncomp.sirius.manager.JavaHttpClient.httpBinaryTransaction(JavaHttpClient.java:168)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpStringTransaction(AbstractClient.java:219)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpJsonTransaction(AbstractClient.java:205)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operationPath2(AbstractClient.java:65)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operation(AbstractClient.java:97)
    at org.openecomp.ncomp.sirius.manager.AbstractClient$operation.call(Unknown Source)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:110)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:146)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy:107)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSite.java:187)
    at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.call(PogoMetaMethodSite.java:68)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:110)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:138)
    at deploy-service-instance.run(deploy-service-instance.groovy:50)
    at groovy.lang.GroovyShell.runScriptOrMainOrTestOrRunnable(GroovyShell.java:261)
    at groovy.lang.GroovyShell.run(GroovyShell.java:522)
    at groovy.lang.GroovyShell.run(GroovyShell.java:511)
    at groovy.ui.GroovyMain.processOnce(GroovyMain.java:650)
    at groovy.ui.GroovyMain.run(GroovyMain.java:381)
    at groovy.ui.GroovyMain.process(GroovyMain.java:367)
    at groovy.ui.GroovyMain.processArgs(GroovyMain.java:126)
    at groovy.ui.GroovyMain.main(GroovyMain.java:106)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.codehaus.groovy.tools.GroovyStarter.rootLoader(GroovyStarter.java:109)
    at org.codehaus.groovy.tools.GroovyStarter.main(GroovyStarter.java:131)
    Caught: java.lang.RuntimeException: http error: java.net.SocketTimeoutException: Read timed out
    java.lang.RuntimeException: http error: java.net.SocketTimeoutException: Read timed out
    at org.openecomp.ncomp.sirius.manager.JavaHttpClient.httpBinaryTransaction(JavaHttpClient.java:204)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpStringTransaction(AbstractClient.java:219)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpJsonTransaction(AbstractClient.java:205)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operationPath2(AbstractClient.java:65)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operation(AbstractClient.java:97)
    at org.openecomp.ncomp.sirius.manager.AbstractClient$operation.call(Unknown Source)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy:107)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy)
    at deploy-service-instance.run(deploy-service-instance.groovy:50)
    Caused by: java.net.SocketTimeoutException: Read timed out
    at org.openecomp.ncomp.sirius.manager.JavaHttpClient.httpBinaryTransaction(JavaHttpClient.java:168)
    ... 8 more

    sleep 1m
    bin/dcae-controller.sh wait-for --timeout 300 --frequency 5 --path $NETWORKPATH --exists --verbose
    bin/dcae-controller.sh wait-for --timeout 300 --frequency 5 --path $KEYPATH --exists --verbose
    bin/dcae-controller.sh deploy-service-instance -i $ZONE -s vm-postgresql
    Tue Jun 27 00:01:38 GMT 2017 java.net.SocketTimeoutException: Read timed out
    java.net.SocketTimeoutException: Read timed out
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:153)
    at java.net.SocketInputStream.read(SocketInputStream.java:122)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
    at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
    at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:707)
    at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:650)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1371)
    at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
    at org.openecomp.ncomp.sirius.manager.JavaHttpClient.httpBinaryTransaction(JavaHttpClient.java:168)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpStringTransaction(AbstractClient.java:219)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpJsonTransaction(AbstractClient.java:205)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operationPath2(AbstractClient.java:65)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operation(AbstractClient.java:97)
    at org.openecomp.ncomp.sirius.manager.AbstractClient$operation.call(Unknown Source)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:110)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:146)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy:107)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSite.java:187)
    at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.call(PogoMetaMethodSite.java:68)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:110)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:138)
    at deploy-service-instance.run(deploy-service-instance.groovy:50)
    at groovy.lang.GroovyShell.runScriptOrMainOrTestOrRunnable(GroovyShell.java:261)
    at groovy.lang.GroovyShell.run(GroovyShell.java:522)
    at groovy.lang.GroovyShell.run(GroovyShell.java:511)
    at groovy.ui.GroovyMain.processOnce(GroovyMain.java:650)
    at groovy.ui.GroovyMain.run(GroovyMain.java:381)
    at groovy.ui.GroovyMain.process(GroovyMain.java:367)
    at groovy.ui.GroovyMain.processArgs(GroovyMain.java:126)
    at groovy.ui.GroovyMain.main(GroovyMain.java:106)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.codehaus.groovy.tools.GroovyStarter.rootLoader(GroovyStarter.java:109)
    at org.codehaus.groovy.tools.GroovyStarter.main(GroovyStarter.java:131)
    Caught: java.lang.RuntimeException: http error: java.net.SocketTimeoutException: Read timed out
    java.lang.RuntimeException: http error: java.net.SocketTimeoutException: Read timed out
    at org.openecomp.ncomp.sirius.manager.JavaHttpClient.httpBinaryTransaction(JavaHttpClient.java:204)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpStringTransaction(AbstractClient.java:219)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpJsonTransaction(AbstractClient.java:205)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operationPath2(AbstractClient.java:65)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operation(AbstractClient.java:97)
    at org.openecomp.ncomp.sirius.manager.AbstractClient$operation.call(Unknown Source)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy:107)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy)
    at deploy-service-instance.run(deploy-service-instance.groovy:50)
    Caused by: java.net.SocketTimeoutException: Read timed out
    at org.openecomp.ncomp.sirius.manager.JavaHttpClient.httpBinaryTransaction(JavaHttpClient.java:168)
    ... 8 more

    sleep 2m
    bin/dcae-controller.sh wait-for --timeout 300 --frequency 5 --path $NETWORKPATH --exists --verbose
    bin/dcae-controller.sh wait-for --timeout 300 --frequency 5 --path $KEYPATH --exists --verbose
    bin/dcae-controller.sh deploy-service-instance -i $ZONE -s vm-cdap-cluster
    Tue Jun 27 01:03:45 GMT 2017 java.net.SocketTimeoutException: Read timed out
    java.net.SocketTimeoutException: Read timed out
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:153)
    at java.net.SocketInputStream.read(SocketInputStream.java:122)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
    at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
    at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:707)
    at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:650)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1371)
    at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
    at org.openecomp.ncomp.sirius.manager.JavaHttpClient.httpBinaryTransaction(JavaHttpClient.java:168)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpStringTransaction(AbstractClient.java:219)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpJsonTransaction(AbstractClient.java:205)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operationPath2(AbstractClient.java:65)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operation(AbstractClient.java:97)
    at org.openecomp.ncomp.sirius.manager.AbstractClient$operation.call(Unknown Source)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:110)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:146)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy:107)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSite.java:187)
    at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.call(PogoMetaMethodSite.java:68)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:110)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:138)
    at deploy-service-instance.run(deploy-service-instance.groovy:50)
    at groovy.lang.GroovyShell.runScriptOrMainOrTestOrRunnable(GroovyShell.java:261)
    at groovy.lang.GroovyShell.run(GroovyShell.java:522)
    at groovy.lang.GroovyShell.run(GroovyShell.java:511)
    at groovy.ui.GroovyMain.processOnce(GroovyMain.java:650)
    at groovy.ui.GroovyMain.run(GroovyMain.java:381)
    at groovy.ui.GroovyMain.process(GroovyMain.java:367)
    at groovy.ui.GroovyMain.processArgs(GroovyMain.java:126)
    at groovy.ui.GroovyMain.main(GroovyMain.java:106)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.codehaus.groovy.tools.GroovyStarter.rootLoader(GroovyStarter.java:109)
    at org.codehaus.groovy.tools.GroovyStarter.main(GroovyStarter.java:131)
    Caught: java.lang.RuntimeException: http error: java.net.SocketTimeoutException: Read timed out
    java.lang.RuntimeException: http error: java.net.SocketTimeoutException: Read timed out
    at org.openecomp.ncomp.sirius.manager.JavaHttpClient.httpBinaryTransaction(JavaHttpClient.java:204)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpStringTransaction(AbstractClient.java:219)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.httpJsonTransaction(AbstractClient.java:205)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operationPath2(AbstractClient.java:65)
    at org.openecomp.ncomp.sirius.manager.AbstractClient.operation(AbstractClient.java:97)
    at org.openecomp.ncomp.sirius.manager.AbstractClient$operation.call(Unknown Source)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy:107)
    at org.openecomp.ncomp.sirius.manager.console.Console.operation(Console.groovy)
    at deploy-service-instance.run(deploy-service-instance.groovy:50)
    Caused by: java.net.SocketTimeoutException: Read timed out
    at org.openecomp.ncomp.sirius.manager.JavaHttpClient.httpBinaryTransaction(JavaHttpClient.java:168)
    ... 8 more

    bin/dcae-controller.sh wait-for --timeout 900 --path /services/vm-docker-host-1/instances/$ZONE --attribute healthTestStatus --match GREEN --verbose
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 162 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 30203 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 60234 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 90264 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 120300 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 150338 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 180367 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 210397 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 240436 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 270466 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 300492 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 330519 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 360555 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 390586 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 420607 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 450630 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 480654 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 510679 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 540706 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 570731 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 600758 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 630789 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 660811 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 690856 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 720870 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 750893 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 780920 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 810942 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 840962 milliseconds
    Waiting: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 870975 milliseconds
    Error: Timeout: Attribute match: /services/vm-docker-host-1/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 900975 milliseconds
    bin/dcae-controller.sh wait-for --timeout 900 --path /services/vm-postgresql/instances/$ZONE --attribute healthTestStatus --match GREEN --verbose
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 132 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 30188 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 60215 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 90255 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 120287 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 150312 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 180351 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 210390 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 240424 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 270459 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 300490 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 330515 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 360536 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 390565 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 420592 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 450619 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 480653 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 510679 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 540702 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 570726 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 600753 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 630781 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 660799 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 690849 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 720872 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 750893 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 780911 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 810941 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 840964 milliseconds
    Waiting: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 870987 milliseconds
    Error: Timeout: Attribute match: /services/vm-postgresql/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 900989 milliseconds


    bin/dcae-controller.sh deploy-service-instance -i $ZONE -s docker-databus-controller


    bin/dcae-controller.sh wait-for --timeout 900 --path /services/vm-cdap-cluster/instances/$ZONE --attribute healthTestStatus --match GREEN --verbose
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 144 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 30195 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 60224 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 90248 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 120276 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 150311 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 180346 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 210381 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 240407 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 270438 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 300463 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 330492 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 360517 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 390543 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 420571 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 450598 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 480629 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 510652 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 540668 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 570696 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 600722 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 630747 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 660771 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 690801 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 720820 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 750844 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 780870 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 810899 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 840935 milliseconds
    Waiting: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 870955 milliseconds
    Error: Timeout: Attribute match: /services/vm-cdap-cluster/instances/bm01@healthTestStatus 'YELLOW' != 'GREEN' : waited 900956 milliseconds
    #bin/dcae-controller.sh wait-for --timeout 900 --path /services/vm-controller/instances/$ZONE --attribute healthTestStatus --match GREEN --verbose

    bin/dcae-controller.sh deploy-service-instance -i $ZONE -s cdap-helloworld
    bin/dcae-controller.sh deploy-service-instance -i $ZONE -s cdap-tca-hi-lo
    bin/dcae-controller.sh deploy-service-instance -i $ZONE -s docker-common-event


    while [ 1 ]; do sleep 1d; done

CommentAdd your comment...

1 answer

  1.  
    1
    0
    -1

    These failures are because of public network name configured as not "public"

    Status fails like following

    root@9d46609643a0:/opt/app/dcae-controller-platform-server# bin/dcae-controller.sh report -n /reports/dcae/service-instances
    ________________________________________________________________________________________________________
    | service | instance | status | healthTestStatus | healthTestMessageCode |
    ________________________________________________________________________________________________________
    | cdap-helloworld | bm01 | UNDEPLOYED | YELLOW | Cluster not deployed |
    | cdap-tca-hi-lo | bm01 | UNDEPLOYED | YELLOW | Cluster not deployed |
    | docker-common-event | bm01 | UNDEPLOYED | YELLOW | Not deployed |
    | docker-databus-controller | bm01 | UNDEPLOYED | YELLOW | Not deployed |
    | vm-cdap-cluster | bm01 | DEPLOYED_PARTIALLY | YELLOW | Not deployed |
    | vm-controller | bm01 | UNDEPLOYED | YELLOW | Not deployed |
    | vm-docker-host-1 | bm01 | DEPLOYED_PARTIALLY | YELLOW | Not deployed |
    | vm-postgresql | bm01 | DEPLOYED_PARTIALLY | YELLOW | Not deployed |
    ________________________________________________________________________________________________________
    null
    root@9d46609643a0:/opt/app/dcae-controller-platform-server#


    root@9d46609643a0:/opt/app/dcae-controller-platform-server# bin/dcae-controller.sh report -n /reports/dcae/vms
    ______________________________________________________________________________________________________________________________________________________________
    | service | instance | name | dns | ip-assignment | state | public-ip | private-ip |
    ______________________________________________________________________________________________________________________________________________________________
    | vm-cdap-cluster | bm01 | zldcbm01njcdap00 | zldcbm01njcdap00.dcae.simpledemo.openecomp.org | 10.0.4.103 | OPERATIONAL | NULL | NULL |
    | vm-cdap-cluster | bm01 | zldcbm01njcdap01 | zldcbm01njcdap01.dcae.simpledemo.openecomp.org | 10.0.4.104 | OPERATIONAL | NULL | NULL |
    | vm-cdap-cluster | bm01 | zldcbm01njcdap02 | zldcbm01njcdap02.dcae.simpledemo.openecomp.org | 10.0.4.105 | OPERATIONAL | NULL | NULL |
    | vm-controller | bm01 | zldcbm01njcont00 | zldcbm01njcont00.dcae.simpledemo.openecomp.org | NULL | OPERATIONAL | NULL | NULL |
    | vm-docker-host-1 | bm01 | zldcbm01njcoll00 | zldcbm01njcoll00.dcae.simpledemo.openecomp.org | 10.0.4.102 | OPERATIONAL | 135.25.67.207 | 10.0.4.102 |
    | vm-postgresql | bm01 | zldcbm01njpstg00 | zldcbm01njpstg00.dcae.simpledemo.openecomp.org | 10.0.4.101 | OPERATIONAL | NULL | NULL |
    ______________________________________________________________________________________________________________________________________________________________
    null
    root@9d46609643a0:/opt/app/dcae-controller-platform-server#


    Carsten Lund helped me to fetch the details from scripts.Thanks Carsten

    After editing the public network name to public everything works fine 


    root@9d46609643a0:/opt/app/dcae-controller-platform-server# bin/dcae-controller.sh report -n /reports/dcae/service-instances
    ________________________________________________________________________________________________
    | service | instance | status | healthTestStatus | healthTestMessageCode |
    ________________________________________________________________________________________________
    | cdap-helloworld | bm01 | DEPLOYED | GREEN | NULL |
    | cdap-tca-hi-lo | bm01 | DEPLOYED | GREEN | NULL |
    | docker-common-event | bm01 | DEPLOYED | GREEN | OK |
    | docker-databus-controller | bm01 | DEPLOYED | GREEN | NULL |
    | vm-cdap-cluster | bm01 | DEPLOYED | GREEN | NULL |
    | vm-controller | bm01 | UNDEPLOYED | YELLOW | Not deployed |
    | vm-docker-host-1 | bm01 | DEPLOYED | GREEN | NULL |
    | vm-postgresql | bm01 | DEPLOYED | GREEN | NULL |
    ________________________________________________________________________________________________
    null
    root@9d46609643a0:/opt/app/dcae-controller-platform-server#


    JIRA case filed  DCAEGEN2-39 - DCAE health checks will fails if the cloud public network name is not "public" Closed


    1. Josef Reisinger

      Sounds familiar ... see here: https://wiki.onap.org/questions/6592019/.demo.sh-appc-demomodule-returns-an-error-keyerror-upublic

    2. kranthi guttikonda

      Josef Reisinger That is for robot scripts and myself raised that question (smile)

    CommentAdd your comment...