Automating the real-user scenarios across multi-apps, and multi-devices

Simulating real-user scenarios as part of your automation is a solved problem. You need to understand the domain, the product, the user, and then define and implement your scenario.

But there are some types of scenarios that are complex to implement. These are the real-world scenarios having multiple personas (users) interacting with each other to use some business functionalities. These personas may be on the same platform or different (web / mobile-web / native apps / desktop applications).

Example scenarios:

• How do you check if more than 1 person is able to join a zoom / teams meeting? And that they can interact with each other?
• How do you check if the end-2-end scenario that involves multiple users, across multiple apps works as expected?
• Given user places order on Amazon (app / browser)
• When delivery agent delivers the order (using Delivery app)
• Then user can see the order status as "Delivered"

Even though we will automate and test each application in such interactions independently, or test each persona scenarios independently, we need a way to build confidence that these multiple personas and applications can work together. These scenarios are critical to automate!

In this session, I will demonstrate teswiz, an open-source framework that can easily automate these multi-user, multi-app, multi-device scenarios. I will also mention how to run these tests on local and in CI pipelines.

Example: Multi-user, Multi-device test scenario

Example: Multi-user, Multi-app, Multi-device test scenario

Teswiz enables, and guides you to implement your automated tests while adhering to the principles of test automation, like - independent tests that run in parallel, against multiple environments using environment-specific-test-data and generate rich and contextual reports (and test execution trends) in reportportal. 

Test coverage is increased by using Applitools Visual AI, along with Applitools Ultrafast Test Cloud. 

In addition, teswiz takes away the pain of managing your browsers, and android / ios / windows devices for automation. The automated tests can run on local browsers / devices, or against any cloud provider, such as HeadSpin, BrowserStack, SauceLabs, pCloudy.

The following features makes teswiz unique:

The ability to do:

• Multi-user scenario automation between all platforms (android, iOS, Web, Windows desktop applications)
• Managing browsers / devices and parallel execution automatically
• Completely configurable options - means no code change required to run different combinations of tests, on demand
• Integration with Applitools Visual AI and Applitools Ultrafast Test Cloud
• Rich contextual reports (including screenshots, browser / device logs) and trend analysis via ReportPortal.io
• Run test orchestration across different platforms, using different app(s) and different users
• Integration of Applitools Ultrafast Grid for scaling

Outline/Structure of the Demonstration

• Understanding of multi-user scenarios and why multi-device capability is required as a core capability of your framework - 5 min
• Introducing teswiz and its tech stack (https://github.com/znsio/teswiz) - 5 min
• Configurations and capabilities (logging, reporting, visual testing) - 5 min
• Demo 1 - multi-user, multi-device scenario execution - 8 min
• A new requirement - multi-app support - 5 min
• Demo 2 - multi-user, multi-device, multi-app scenario execution - 8 min
• Running in the CI pipelines - 5 min
• What next? - 2 min
• Q&A

Learning Outcome

• Simulate real-world scenarios, including data-setup for multi-user, multi-app, multi-device tests for web (Selenium WebDriver) and android, iOS, windows applications (Appium) using teswiz
• Execute multi-user, multi-app, multi-device tests easily on local machines and in the cloud
• Increase test coverage using Visual AI
• Steps to getting started with teswiz in your project