Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

7. The default configuration should have have 11 failed out of 62 run tests (88 total tests but 26 skipped) 

Expand
titleTest Results
Clearwater Test Script:
 
ubuntu@vm1-robot:~/clearwater-live-test$ rake test[bdftestvimstest.openecomponap.org] SIGNUP_CODE=secret ELLIS=172.99.116.54<ellis-0 IP> PROXY=104.130.138.183<bono-0 IP> GEMINI=162.209.77.90 MEMENTO_SIP=162.209.77.90<sprout-0 IP> MOMENTO_SIP=<sprout-0 IP> MOMENTO_HTTP=162.209.77.90<sprout-0 IP> ELLIS_API_KEY=secret
/usr/lib/ruby/vendor_ruby/bundler/shared_helpers.rb:78: warning: Insecure world writable dir /home in PATH, mode 040777
Basic Call - Mainline (TCP) - (55555510165555551002, 55555510135555551008) Passed
Basic Call - SDP (TCP) - (55555510135555551011, 55555510025555551009) Passed
Basic Call - Tel URIs (TCP) - (55555510015555551002, 55555510155555551008) Passed
Basic Call - Unknown number (TCP) - (55555510035555551008, 55555510085555551002) Passed
Basic Call - Rejected by remote endpoint (TCP) - (55555510155555551001, 55555510035555551008) Passed
Basic Call - Messages - Pager model (TCP) - (55555510005555551019, 55555510045555551005) Passed
Basic Call - Pracks (TCP) - (55555510155555551018, 55555510175555551002) Passed
Basic Registration (TCP) - (55555510105555551001) Passed
Multiple Identities (TCP) - (55555510115555551006, 55555510195555551004) Passed
Call Barring - Outbound Rejection (TCP) - (55555510005555551015, 55555510165555551005) Passed
Call Barring - Allow non-international call (TCP) - Skipped (No PSTN support)
   - Call with PSTN=true to run test
Call Barring - Reject international call (TCP) - Skipped (No PSTN support)
   - Call with PSTN=true to run test
Call Barring - Inbound Rejection (TCP) - (55555510175555551010, 55555510035555551002) Passed
Call Diversion AS - Unconditional (TCP) - Skipped (No Call Diversion AS hostname provided)
   - Call with CDIV_AS=<hostname>
Call Diversion AS - Busy (TCP) - Skipped (No Call Diversion AS hostname provided)
   - Call with CDIV_AS=<hostname>
Call Diversion AS - No answer (TCP) - Skipped (No Call Diversion AS hostname provided)
   - Call with CDIV_AS=<hostname>
Call Diversion - Not registered (TCP) - (55555510095555551012, 55555510105555551016, 55555510115555551017) Passed
Call Diversion - Not reachable (not registered) (TCP) - (55555510015555551019, 55555510055555551006, 55555510045555551000) Passed
Call Diversion - Not reachable (408) (TCP) - (55555510145555551000, 55555510115555551006, 55555510035555551019) Passed
Call Diversion - Not reachable (503) (TCP) - (55555510025555551007, 55555510105555551016, 55555510015555551019) Passed
Call Diversion - Not reachable (500) (TCP) - (55555510155555551001, 55555510125555551009, 55555510015555551012) Passed
Call Diversion - Busy (TCP) - (5555551006, 55555510015555551011, 55555510075555551015) Passed
Call Diversion - Unconditional (TCP) - (55555510075555551011, 55555510105555551009, 55555510085555551013) Passed
Call Diversion - No answer (TCP) - (55555510045555551009, 55555510015555551005, 55555510005555551013) Passed
Call Diversion - Bad target URI (TCP) - (55555510035555551004, 55555510115555551019) Passed
Call Diversion - Audio-only call (TCP) - (55555510145555551006, 55555510165555551018, 55555510135555551014, 55555510105555551002) Passed
Call Diversion - Audio-video call (TCP) - (55555510005555551006, 55555510105555551005, 55555510155555551007, 55555510185555551002) Passed
Call Waiting - Accepted (TCP) - (55555510125555551009, 55555510035555551008, 55555510195555551017) Passed
Call Waiting - Cancelled (TCP) - (5555551011, 55555510135555551012, 55555510125555551007) Passed
CANCEL - Mainline (TCP) - (55555510095555551011, 55555510005555551017) Passed
Filtering - Accept-Contact (TCP) - (55555510095555551000, 55555510035555551016) Passed
Filtering - Accept-Contact no match (TCP) - (5555551005, 55555510015555551015) Passed
Filtering - Accept-Contact negated match (TCP) - (55555510055555551016, 55555510065555551019) Passed
Filtering - RFC3841 example (TCP) - (55555510145555551000, 55555510025555551008) Passed
Filtering - Reject-Contact no match (TCP) - (55555510035555551012, 55555510075555551011) Passed
Filtering - Reject-Contact match (TCP) - (55555510085555551005, 55555510015555551019) Passed
Gemini - INVITE - VoIP device answers (TCP) - (55555510085555551019, 55555510075555551000, 1235555551007@bdftest1235555551000@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- undefined method `include?' for nil:NilClass
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:72:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
Gemini - INVITE - Mobile device answers (TCP) - (55555510065555551016, 55555510155555551011, 1235555551015@bdftest1235555551011@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- undefined method `include?' for nil:NilClass
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:165:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
Gemini - INVITE - VoIP device rejects (TCP) - (55555510165555551015, 55555510115555551003, 1235555551011@bdftest1235555551003@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- undefined method `include?' for nil:NilClass
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:259:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
Gemini - INVITE - Mobile device rejects (TCP) - (55555510175555551014, 55555510055555551009, 1235555551005@bdftest1235555551009@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- undefined method `include?' for nil:NilClass
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:347:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
Gemini - INVITE - Mobile device rejects with a 480 (TCP) - (55555510155555551013, 55555510085555551001, 1235555551008@bdftest1235555551001@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- undefined method `include?' for nil:NilClass
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:443:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
Endpoint threw exception:
- undefined method `include?' for nil:NilClass
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:458:in `block (2 levels) in <top (required)>'
Gemini - INVITE - Both reject, choose mobile response (TCP) - (55555510125555551008, 55555510105555551001, 1235555551010@bdftest1235555551001@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- undefined method `include?' for nil:NilClass
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:535:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
Gemini - INVITE - Both reject, choose VoIP response (TCP) - (55555510045555551011, 55555510165555551013, 1235555551016@bdftest1235555551013@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- undefined method `include?' for nil:NilClass
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:610:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
Gemini - INVITE - Successful call with GR (TCP) - (55555510055555551015, 55555510015555551002, 1235555551001@bdftest1235555551002@vimstest.openecomponap.org) Passed
Gemini - INVITE - Failed call with GR (TCP) - (55555510095555551003, 55555510175555551002, 1235555551017@bdftest1235555551002@vimstest.openecomponap.org) Passed
Gemini - INVITE - Successful call with Accept-Contact (TCP) - (55555510075555551015, 55555510015555551017, 1235555551001@bdftest1235555551017@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- sip:1235555551001@bdftest1235555551017@vimstest.openecomponap.org timed out waiting for new incoming call
   - /home/ubuntu/.bundle/ruby/2.3.0/bundler/gems/quaff-f92372cac3e1/lib/endpoint.rb:65:in `rescue in incoming_call'
   - /home/ubuntu/.bundle/ruby/2.3.0/bundler/gems/quaff-f92372cac3e1/lib/endpoint.rb:62:in `incoming_call'
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:808:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
Gemini - INVITE - Failed call with Accept-Contact (TCP) - (55555510135555551005, 55555510175555551003, 1235555551017@bdftest1235555551003@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- sip:1235555551017@bdftest1235555551003@vimstest.openecomponap.org timed out waiting for new incoming call
   - /home/ubuntu/.bundle/ruby/2.3.0/bundler/gems/quaff-f92372cac3e1/lib/endpoint.rb:65:in `rescue in incoming_call'
   - /home/ubuntu/.bundle/ruby/2.3.0/bundler/gems/quaff-f92372cac3e1/lib/endpoint.rb:62:in `incoming_call'
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:864:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
Gemini - SUBSCRIBE - Mobile Notifies (TCP) - (55555510135555551015, 55555510065555551000, 1235555551006@bdftest1235555551000@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- undefined method `include?' for nil:NilClass
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:926:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
Gemini - SUBSCRIBE - Joint 408 (TCP) - (55555510195555551003, 55555510095555551004, 1235555551009@bdftest1235555551004@vimstest.openecomponap.org) Failed
Endpoint threw exception:
- undefined method `include?' for nil:NilClass
   - /home/ubuntu/clearwater-live-test/lib/tests/gemini.rb:988:in `block (2 levels) in <top (required)>'
Terminating other threads after failure
GRUU - REGISTER - two bindings with and without GRUU (TCP) - (5555551010) Passed
GRUU - REGISTER - binding suggested GRUU (TCP) - (55555510095555551014) Passed
GRUU - REGISTER - instance ID requires escaping (TCP) - (55555510115555551003) Passed
GRUU - REGISTER - three bindings with GRUUs (TCP) - (55555510125555551014) Passed
GRUU - Call - first endpoint GRUU as target (TCP) - (55555510145555551000, 55555510105555551017) Passed
GRUU - Call - second endpoint GRUU as target (TCP) - (55555510175555551013, 55555510095555551006) Passed
GRUU - Call - only GRUU as target (TCP) - (55555510055555551013, 55555510155555551019) Passed
GRUU - Call - AoR as target (TCP) - (55555510035555551015, 55555510005555551014) Passed
GRUU - Call - unknown GRUU as target (TCP) - (55555510065555551003, 55555510005555551008) Passed
GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) - (55555510105555551003, 55555510115555551005) Passed
GRUU - Call - Reject-Contact interop (TCP) - (55555510065555551013, 55555510035555551010) Passed
GRUU - Call - Accept-Contact interop (TCP) - (55555510015555551003, 5555551012) Passed
GRUU - Call - AoR with other param as target (TCP) - (55555510155555551013, 55555510075555551003) Passed
GRUU - Call - GRUU with other param as target (TCP) - (55555510115555551013, 55555510085555551006) Passed
ISC Interface - Terminating (TCP) - Skipped (No hostname given)
   - Call with HOSTNAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Terminating (UDP AS) (TCP) - Skipped (No hostname given)
   - Call with HOSTNAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Terminating Failed (TCP) - Skipped (No hostname given)
   - Call with HOSTNAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Third-party Registration (TCP) - Skipped (No hostname given)
   - Call with HOSTNAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Third-party Registration - implicit registration (TCP) - Skipped (No hostname given)
   - Call with HOSTNAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Redirect (TCP) - Skipped (No hostname given)
   - Call with HOSTNAME=<publicly accessible hostname/IP of this machine>
ISC Interface - B2BUA (TCP) - Skipped (No hostname given)
   - Call with HOSTNAME=<publicly accessible hostname/IP of this machine>
Live Call - Dial out to a real number (TCP) - Skipped (No live number given)
   - Call with LIVENUMBER=<number>
Memento - Incorrect Password (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Wrong Call List (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Basic Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Unknown Number (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Rejected Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Cancelled Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Privacy Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Barred Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Busy Call Forwarding (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Nonce-Count - Mainline (TCP) - Skipped (No nonce-count support)
   - Call with NONCE_COUNT=true to run test
Nonce-Count - Reject Re-Use (TCP) - Skipped (No nonce-count support)
   - Call with NONCE_COUNT=true to run test
Off-net calls - tel: URI (TCP) - Skipped (No off-net number given)
   - Call with OFF_NET_TEL=<a number set up in ENUM/BGCF to route to port 5072 on this machine>
Off-net calls - sip: URI (TCP) - Skipped (No off-net number given)
   - Call with OFF_NET_TEL=<a number set up in ENUM/BGCF to route to port 5072 on this machine>
SUBSCRIBE - reg-event (TCP) - (55555510115555551015) Passed
SUBSCRIBE - reg-event with a GRUU (TCP) - (55555510175555551005) Passed
SUBSCRIBE - Subscription timeout (TCP) - (55555510035555551002) Passed
SUBSCRIBE - Registration timeout (TCP) - (55555510125555551010, 55555510105555551014) Passed
11 failures out of 88 tests run
    Gemini - INVITE - VoIP device answers (TCP) at 2017-07-13 0019:3541:2011 +0000
    Gemini - INVITE - Mobile device answers (TCP) at 2017-07-13 0019:3541:2517 +0000
    Gemini - INVITE - VoIP device rejects (TCP) at 2017-07-13 0019:3541:3023 +0000
    Gemini - INVITE - Mobile device rejects (TCP) at 2017-07-13 0019:3541:3529 +0000
    Gemini - INVITE - Mobile device rejects with a 480 (TCP) at 2017-07-13 0019:3541:4137 +0000
    Gemini - INVITE - Both reject, choose mobile response (TCP) at 2017-07-13 0019:3541:4643 +0000
    Gemini - INVITE - Both reject, choose VoIP response (TCP) at 2017-07-13 0019:3541:5149 +0000
    Gemini - INVITE - Successful call with Accept-Contact (TCP) at 2017-07-13 0019:3642:3635 +0000
    Gemini - INVITE - Failed call with Accept-Contact (TCP) at 2017-07-13 0019:3743:1008 +0000
    Gemini - SUBSCRIBE - Mobile Notifies (TCP) at 2017-07-13 0019:3743:14 +0000
    Gemini - SUBSCRIBE - Joint 408 (TCP) at 2017-07-13 0019:3743:1920 +0000
26 tests skipped
Error logs, including Call-IDs of failed calls, are in the 'logfiles' directory

...