Automated Regression Test Suite Case Study

The Client

Our client builds online platforms that facilitate two-way communications between customers, employees, and citizens in contexts ranging from market research to civic engagement.

They are developers of cloud-based software built around their own platform which matches an accessible user interface with full-featured modules for survey authoring, community management, discussion forums, and reporting.

The Challenge

The client provides a web-based service for creating online surveys and questionnaires. The service is based on Microsoft’s Silverlight platform.

Given the size and dynamism in the platform, manual testing alone was not efficient; therefore, our client needed increased automated white box testing of their UI.

Key Challenges

– There was no documentation for the business logic and the behavior of the survey panel’s various functions.

– There were no specifications for the workflow, alternative path, or boundary conditions for the development of the survey panel’s features.

– The development environment that was accessible over the Internet was unstable, leading to intermittent and frequent downtimes

The Process

  1. Study the code.
  2. Create test cases and data.
  3. Execute and validate the results.

How Optimus Helped

The OptimusQA team first gathered information about the system’s environment and the application dependencies. We then traced problems to incompatibility issues between some versions of the test system’s components. By making sure all the versions were up to date, the OptimusQA team stabilized the development environment.

The OptimusQA team took a reverse engineering-based approach for this project. We studied and traversed the code to determine the expected behavior, and then created test cases for UI elements in C#. The UI controls were detected using Silverlight Spy.

This automation framework configured tests, validated results, and could be run at pre-configured times. The test results were collated in the form of logs.

The project helped significantly reduce the time needed to test the website, consequently leading to quicker reporting times and faster resolution of issues.