Test cases revision

Rev Changes Date
1.0 Initial revision 2020/1/7
1.1 Updated Supplementary functions 2020/1/14
1.3 Failover modification 2020/4/6
1.4 Webex Rebranding 2021/07/13
1.5 Removed acronym from title 2021/07/14
1.6 Added High-Level Self-Certification Steps 2022/01/10
1.7 Updated BYoPSTN terminology. 2022/06/15

Introduction

The system test requirements are based on specifications covering the areas of Bring Your Own PSTN (BYoPSTN) Webex for Cisco BroadWorks Acceptance Procedure, conferencing function and features, and interoperability and compliance with BYoPSTN VoIP trunking, end to end network redundancy, resiliency confirmation, and impact assessment.

It's important that the results are recorded in logs, match the test case's expectations, and be reported accordingly.

High level self-certification steps

The Webex Meeting PSTN Certification team validates and archives BYoPSTN partner-provided self-certification results.

  • Validation—The Certification team ensures that due diligence items are complete (for example, the trace set must demonstrate the call flows that the test plan requires)
  • Archive—The Certification team saves results in the internal BYoPSTN Onboarding Dashboard Wiki page for future cross-functional teams to reference. Target is to serve as the baseline in case of escalation.

Following is the current process flow for the Webex Meeting PSTN Certification team boundary to boundary:

  1. The Customer Success Manager creates the external Team space, which includes the following participants:
    • Partner technical contact(s)
    • Technical onboarding
    • Certification team lead
  2. The partner works with the technical onboarding and certification teams on how to remove technical obstacles and meet the self-certification evidence requirements. Webex Meeting engineers may be added to the team space to suggest best practices or to facilitate troubleshooting by technical onboarding.
  3. Once the partner attests that self-certification is complete, the Customer Success Manager updates the BYoPSTN OnboardingDashboard and uses the BYoPSTN onboarding template to create a new BYoPSTN onboarding page dedicated to that partner. The Customer Success Manager also notifies the technical onboarding and certification team leads so that they can invoke the review process.
  4. The certification team lead creates a task in GPK2 of the Cisco engineering Jira ticketing system as a backlog task waiting for assignment.
  5. The ticket gets assigned to a certification engineer who can validate the submitted material. The assigned engineer is also added to the team space that was created for that partner in step 1.
  6. The assigned engineer contacts the partner technical contact(s) to provide comments, feedback or additional inquiries.
  7. Once the engineer validates the partner’s submitted material successfully, the engineer notifies the Customer Success Manager and the technical onboarding team.
  8. The technical onboarding team completes the remaining dashboard requirements, updates the BYoPSTN onboarding page for that partner along with the BYoPSTN Onboarding Dashboard.

Prerequisites

BYoPSTN redundant network provisioning

Validate that BYoPSTN has at least dual DC, and connections are reachable over TCP/IP network, a connection is routed with E.164 format.

diagram that BYoPSTN has at least dual DC, and connections are reachable over TCP/IP network routed with E.164 format.

Figure 1: BYoPSTN redundant network provisioning

BYoPSTN local DNIS numbers

Validate provisioned DNIS

CountryPromptDNIS
1USAEnglish
2FranceFrench, English UK
3GermanyGerman, English UK

Table 1: BYoPSTN local DNIS numbers

BYoPSTN phone numbers for acceptance

PhoneFunctionForwarded to Webex
1Caller 1/G722DID1 – ____________________
2Caller 2/G722DID2 – ____________________
3Caller 3/G711aDID3 – ____________________
4Caller 4/G711aDID4 – ____________________
5Caller 5/G711uDID5 – ____________________
6Caller 6/G711uDID6 – ____________________
7Caller 7/G729DID7 – ____________________
8Caller 8/G729DID8 – ____________________

Table 2: BYoPSTN phone numbers for acceptance

Ingress test cases

Ingress DTMF/voice verification BYoPSTN trunk group G722

Test Objective

This test case verifies that an ingress call that is sent to the Webex BYoPSTN trunk group accepts the G722 codec, contains the appropriate localized prompts, and that the digits that the user enters after the first prompt get repeated in the appropriate language. Both participants must be able to hear each other.

Test steps

  1. Tester places a call from the BroadWorks to a BYoPSTN provided number DID1 table.

  2. Verify that the first audio prompt responded according to the designated localization

  3. Interrupt prompt by valid entry associated to Caller 1: _________# _____#

  4. Verify that prompt about successful joining conference responded according to the designated localization

  5. 2nd Tester places a call from the BroadWorks to a BYoPSTN provided number, which associates with localization from table 1

  6. Verify that the first audio prompt responded according to the designated localization

  7. Interrupt prompt by valid entry associated to Caller 2: _________# _____#

  8. Verify that prompt about successful joining conference responded according to the designated localization

  9. Verify both participants can hear each other

  10. Disconnect the call from the originating device.

  11. Record Results.

Expected results

  1. Call placed to a DNIS and answered with appropriate combination localized prompts.

  2. After entering the correct conference, ID numbers are responded to with appropriate localization prompts.

  3. Both Participants can hear each other.

  4. Call terminates properly.

Ingress DTMF/voice verification BYoPSTN trunk group G711a

Test Objective

This test case verifies that an ingress call that is sent to the Webex BYoPSTN trunk group accepts the G711a codec, contains the appropriate localized prompts, and that the digits that the user enters after the first prompt get repeated in the appropriate language. Both participants must be able to hear each other.

Test steps

  1. Tester places a call from the BroadWorks to a BYoPSTN provided number DID1 table.
  2. Verify that the first audio prompt responded according to the designated localization.
  3. Interrupt prompt by valid entry associated to Caller 3: _________# _____#
  4. Verify that prompt about successful joining conference responded according to the designated localization.
  5. 2nd Tester places a call from the BroadWorks to a BYoPSTN provided number, which associates with localization from table 1 .
  6. Verify that the first audio prompt responded according to the designated localization.
  7. Interrupt prompt by valid entry associated to Caller 4: _________# _____#
  8. Verify that prompt about successful joining conference responded according to the designated localization.
  9. Verify both participants can hear each other.
  10. Disconnect the call from the originating device.
  11. Record Results.
Expected results
  1. Call placed to a DNIS and answered with appropriate combination localized prompts.

  2. After entering the correct conference, ID numbers are responded to with appropriate localization prompts.

  3. Both Participants can hear each other.

  4. Call terminates properly.

Ingress DTMF/voice verification BYoPSTN trunk group G711u

Test Objective

This test case verifies that an ingress call that is sent to the Webex BYoPSTN trunk group accepts the G711u codec, contains the appropriate localized prompts, and that the digits that the user enters after the first prompt get repeated in the appropriate language. Both participants must be able to hear each other.

Test steps

  1. Tester places a call from the BroadWorks to a BYoPSTN provided number DID1 table.
  2. Verify that the first audio prompt responded according to the designated localization.
  3. Interrupt prompt by valid entry associated to Caller 5: _________# _____#
  4. Verify that prompt about successful joining conference responded according to the designated localization.
  5. 2nd Tester places a call from the BroadWorks to a BYoPSTN provided number, which associates with localization from table 1.
  6. Verify that the first audio prompt responded according to the designated localization.
  7. Interrupt prompt by valid entry associated to Caller 6: _________# _____#
  8. Verify that prompt about successful joining conference responded according to the designated localization.
  9. Verify both participants can hear each other.
  10. Disconnect the call from the originating device.
  11. Record Results.
Expected results
  1. Call placed to a DNIS and answered with appropriate combination localized prompts.

  2. After entering the correct conference, ID numbers are responded to with appropriate localization prompts.

  3. Both Participants can hear each other.

  4. Call terminates properly.

Ingress DTMF/voice verification BYoPSTN trunk group G729

Test Objective

This test case verifies that an ingress call that is sent to the Webex BYoPSTN trunk group accepts the G729 codec, contains the appropriate localized prompts, and that the digits that the user enters after the first prompt get repeated in the appropriate language. Both participants must be able to hear each other

Test steps

  1. Tester places a call from the BroadWorks to a BYoPSTN provided number DID1 table.
  2. Verify that the first audio prompt responded according to the designated localization.
  3. Interrupt prompt by valid entry associated to Caller 7: _________# _____#
  4. Verify that prompt about successful joining conference responded according to the designated localization.
  5. 2nd Tester places a call from the BroadWorks to a BYoPSTN provided number, which associates with localization from table 1.
  6. Verify that the first audio prompt responded according to the designated localization.
  7. Interrupt prompt by valid entry associated to Caller 8: _________# _____#
  8. Verify that prompt about successful joining conference responded according to the designated localization.
  9. Verify both participants can hear each other.
  10. Disconnect the call from the originating device.
  11. Record Results.
Expected results
  1. Call placed to a DNIS and answered with appropriate combination localized prompts.

  2. After entering the correct conference, ID numbers are responded to with appropriate localization prompts.

  3. Both Participants can hear each other.

  4. Call terminates properly.

Egress test cases

Egress DTMF/voice verification BYoPSTN G722 subscriber

Test Objective

This test case verifies that an egress G722 call that is sent by Webex into BYoPSTN number subscribers plays the appropriate localized prompts. The responses include localized prompts to press 1 (DTMF digits). Both participants must be able to hear each other.

Test steps

  1. Create a Webex Conference.

  2. 1st Tester requesting a callback to BYoPSTN number DID1 (Table 2) and respond with a localized prompt from table 1.

  3. Verify that the audio prompt responded according to the designated localization.

  4. Interrupt prompt by entry 1 DTMF.

  5. Verify that prompt about successful joining conference responded according to the designated localization.

  6. 2nd Tester requesting a callback to BYoPSTN number DID2 (Table 2) and respond with a localized prompt from table 1.

  7. Verify that the audio prompt responded according to the designated localization.

  8. Interrupt prompt by entry 1 DTMF.

  9. Verify that prompt about successful joining conference responded according to the designated localization.

  10. Verify both participants can hear each other.

  11. Disconnect the call from the BYoPSTN number subscribers.

  12. Record Results.

Expected results

  1. Call placed to a DID1 and DID2 numbers and played with appropriate localized prompts.

  2. While joining the conference, both participants can hear an appropriate localized prompt.

  3. Voice path is available in both directions between both participants.

  4. Calls are terminated successfully.

Egress DTMF/voice verification BYoPSTN G711a subscriber

Test Objective

This test case verifies that an egress G711a call that is sent by Webex into BYoPSTN number subscribers plays the appropriate localized prompts. The response includes localized prompts to press 1 DTMF. Both participants must be able to hear each other.

Test steps

  1. Create a Webex Conference.

  2. 1st Tester requesting a callback to BYoPSTN number DID3 (Table 2) and respond with a localized prompt from table 1.

  3. Verify that the audio prompt responded according to the designated localization.

  4. Interrupt prompt by entry 1 DTMF.

  5. Verify that prompt about successful joining conference responded according to the designated localization.

  6. 2nd Tester requesting a callback to BYoPSTN number DID4 (Table 2) and respond with a localized prompt from table 1.

  7. Verify that the audio prompt responded according to the designated localization.

  8. Interrupt prompt by entry 1 DTMF.

  9. Verify that prompt about successful joining conference responded according to the designated localization.

  10. Verify both participants can hear each other.

  11. Disconnect the call from the BYoPSTN number subscribers.

  12. Record Results.

Expected results

  1. Call placed to a DID3 and DID4 numbers and played with appropriate localized prompts.

  2. While joining the conference, both participants can hear an appropriate localized prompt.

  3. Voice path is available in both directions between both participants.

  4. Calls are terminated successfully.

Egress DTMF/voice verification BYoPSTN G711u subscriber

Test Objective

This test case aims to verify that an egress G711u calls sent by Webex into BYoPSTN number subscribers play the appropriate localized prompts. Responses include localized prompts to press 1 (DTMF). Both participants must be able to hear each other.

Test steps

  1. Create a Webex Conference.

  2. 1st Tester requesting a callback to BYoPSTN number DID5 (Table 2) and respond with a localized prompt from table 1.

  3. Verify that the audio prompt responded according to the designated localization.

  4. Interrupt prompt by entry 1 DTMF.

  5. Verify that prompt about successful joining conference responded according to the designated localization.

  6. 2nd Tester requesting a callback to BYoPSTN number DID6 (Table 2) and respond with a localized prompt from table 1.

  7. Verify that the audio prompt responded according to the designated localization.

  8. Interrupt prompt by entry 1 DTMF.

  9. Verify that prompt about successful joining conference responded according to the designated localization.

  10. Verify both participants can hear each other.

  11. Disconnect the call from the BYoPSTN number subscribers.

  12. Record Results.

Expected results

  1. Call placed to a DID5 and DID6 numbers and played with appropriate localized prompts.

  2. While joining the conference, both participants can hear an appropriate localized prompt.

  3. Voice path is available in both directions between both participants.

  4. Calls are terminated successfully.

Egress DTMF/voice verification BYoPSTN G729 subscriber

Test Objective

This test case aims to verify that an egress G711 call sent by Webex into BYoPSTN, and transcoded to G729 codec, plays appropriately localized responses. Responses include localized prompts to press 1 (DTMF). Both participants must be able to hear each other.

Test steps

  1. Create a Webex Conference.

  2. 1st Tester requesting a callback to BYoPSTN number DID7 (Table 2) and respond with a localized prompt from table 1.

  3. Verify that the audio prompt responded according to the designated localization.

  4. Interrupt prompt by entry 1 DTMF.

  5. Verify that prompt about successful joining conference responded according to the designated localization.

  6. 2nd Tester requesting a callback to BYoPSTN number DID8 (Table 2) and respond with a localized prompt from table 1.

  7. Verify that the audio prompt responded according to the designated localization.

  8. Interrupt prompt by entry 1 DTMF.

  9. Verify that prompt about successful joining conference responded according to the designated localization.

  10. Verify both participants can hear each other.

  11. Disconnect the call from the BYoPSTN number subscribers.

  12. Record Results.

Expected results

  1. Call placed to a DID7 and DID8 numbers and played with appropriate localized prompts.

  2. While joining the conference, both participants can hear an appropriate localized prompt.

  3. Voice path is available in both directions between both participants.

  4. Calls are terminated successfully.

Failover test cases

Ingress – Primary Webex DC Outage

This test case aims to verify that an ingress calls into Webex during DC outage can be successfully made, and both participants can hear each other after joining a conference.

Test steps

  1. Primary Webex DC Invoke BGP failover.

  2. Tester places a call from the BroadWorks to a BYoPSTN provided number DID1 table.

  3. Verify that the first audio prompt responded according to the designated localization.

  4. Interrupt prompt by valid entry associated to Caller 1: _________# _____#

  5. Verify that prompt about successful joining conference responded according to the designated localization.

  6. 2nd Tester places a call from the BroadWorks to a BYoPSTN provided number, which associates with localization from table 1.

  7. Verify that the first audio prompt responded according to the designated localization.

  8. Interrupt prompt by valid entry associated to Caller 2: _________# _____#

  9. Verify that prompt about successful joining conference responded according to the designated localization.

  10. Verify both participants can hear each other.

  11. Disconnect the call from the originating device.

  12. Recover BGP routes.

  13. Record Results.

Expected results

  1. Call placed to a DNIS and answered with appropriate combination localized prompts.
  2. After entering the correct conference, ID numbers are responded to with appropriate localization prompts.
  3. Both Participants can hear each other.
  4. Call terminates properly.

Egress - Primary BYoPSTN DC Outage

This test case aims to verify that an egress calls into BYoPSTN during DC outage can be successfully made, and both participants can hear each other after joining a conference.

Test steps

  1. Primary BYoPSTN DC Invoke BGP failover.

  2. Create a Webex Conference.

  3. 1st Tester requesting a callback to BYoPSTN number DID1 (Table 2) and respond with a localized prompt from table 1.

  4. Verify that the audio prompt responded according to the designated localization.

  5. Interrupt prompt by entry 1 DTMF.

  6. Verify that prompt about successful joining conference responded according to the designated localization.

  7. 2nd Tester requesting a callback to BYoPSTN number DID2 (Table 2) and respond with a localized prompt from table 1.

  8. Verify that the audio prompt responded according to the designated localization.

  9. Interrupt prompt by entry 1 DTMF.

  10. Verify that prompt about successful joining conference responded according to the designated localization.

  11. Verify both participants can hear each other.

  12. Disconnect the call from the BYoPSTN number subscribers.

  13. Recover BGP routes.

  14. Record Results.

Expected results

  1. Call placed to a DID1 and DID2 numbers and played with appropriate localized prompts.
  2. While joining the conference, both participants can hear an appropriate localized prompt.
  3. Voice path is available in both directions between both participants.
  4. Calls are terminated successfully.

Supplementary functions

Ingress – OnHold G722

The objective of this test case is to verify that in event of changing media, BYoPSTN provided provider consumes re-invite.

Test steps

  1. Tester places a call from the BroadWorks to a BYoPSTN provided number DID1 table.

  2. Verify that the first audio prompt responded according to the designated localization.

  3. Interrupt prompt by valid entry associated to Caller 1: _________# _____#

  4. Verify that prompt about successful joining conference responded according to the designated localization.

  5. 2nd Tester places a call from the BroadWorks to a BYoPSTN provided number, which associates with localization from table 1.

  6. Verify that the first audio prompt responded according to the designated localization.

  7. Interrupt prompt by valid entry associated to Caller 2: _________# _____#

  8. Verify that prompt about successful joining conference responded according to the designated localization.

  9. Verify both participants can hear each other.

  10. Place call from DID3 to DID1.

  11. Caller 1 will place conference call on hold.

  12. Caller 1 will hang up call with DID3 and resume conference call.

  13. Verify both Caller 1 and Caller 2 participants can hear each other.

  14. Disconnect the call from the originating device.

  15. Record Results.

Expected results

  1. Call placed to a DNIS and answered with appropriate combination localized prompts.
  2. After entering the correct conference, ID numbers are responded to with appropriate localization prompts.
  3. Both Participants can hear each other before call placed on hold and after resume.
  4. Call terminates properly.

Ingress – G722 Muted for extended period of time

The objective of this test case is to verify that BYoPSTN provided for codec G722 can continuously transmit RTP stream (30 min) without interruption and it doesn’t use packet suppression.

Test steps

  1. Tester places a call from the BroadWorks to a BYoPSTN provided number DID1 table.

  2. Verify that the first audio prompt responded according to the designated localization.

  3. Interrupt prompt by valid entry associated to Caller 1: _________# _____#

  4. Verify that prompt about successful joining conference responded according to the designated localization.

  5. 2nd Tester places a call from the BroadWorks to a BYoPSTN provided number, which associates with localization from table 1.

  6. Verify that the first audio prompt responded according to the designated localization.

  7. Interrupt prompt by valid entry associated to Caller 2: _________# _____#

  8. Verify that prompt about successful joining conference responded according to the designated localization.

  9. Verify both participants can hear each other.

  10. Caller 1 will place conference call device on Mute.

  11. Caller 1 will resume conference call device from Mute.

  12. Verify both Caller 1 and Caller 2 participants can hear each other.

  13. Disconnect the call from the originating device.

  14. Record Results.

Expected results

  1. Call placed to a DNIS and answered with appropriate combination localized prompts.
  2. After entering the correct conference, ID numbers are responded to with appropriate localization prompts.
  3. Both Participants can hear each other before call placed on hold and after resume.
  4. Call terminates properly.

Ingress – G711a Muted for extended period of time

The objective of this test case is to verify that BYoPSTN for codec G711a can continuously transmit RTP stream (30 min) without interruption and it doesn’t use packet suppression.

Test steps

  1. Tester places a call from the BroadWorks to a BYoPSTN provided number DID1 table.

  2. Verify that the first audio prompt responded according to the designated localization.

  3. Interrupt prompt by valid entry associated to Caller 3: _________# _____#

  4. Verify that prompt about successful joining conference responded according to the designated localization.

  5. 2nd Tester places a call from the BroadWorks to a BYoPSTN provided number, which associates with localization from table 1.

  6. Verify that the first audio prompt responded according to the designated localization.

  7. Interrupt prompt by valid entry associated to Caller 4: _________# _____#

  8. Verify that prompt about successful joining conference responded according to the designated localization.

  9. Verify both participants can hear each other.

  10. Caller 3 will place conference call device on Mute.

  11. Caller 3 will resume conference call device from Mute.

  12. Verify both Caller 3 and Caller 4 participants can hear each other.

  13. Disconnect the call from the originating device.

  14. Record Results.

Expected results

  1. Call placed to a DNIS and answered with appropriate combination localized prompts.
  2. After entering the correct conference, ID numbers are responded to with appropriate localization prompts.
  3. Both Participants can hear each other before call placed on hold and after resume.
  4. Call terminates properly.