Report Testing for Data Validation and Functionality Case Study

The Client

The client is a company that specializes in providing software solutions that help the aviation industry improve their operations.

The Challenge

Our client had an existing vendor develop reports about supplier surveillance and supplier approval, among other things, using the BIRT reporting platform. The client was now looking for someone to help test the functionality and data of these reports.

Our client’s key need was validating the data within their existing reports. As well as they wanted to conduct overall tests of the reports, which would look at report location, report parameters, fields, layout, and the complete UI.

Key Challenges

– There was a complex database structure that consisted of hundreds of suppliers and over a million manufactured pieces.

– The business process was not captured in any document, therefore we needed to exert significant effort in learning about the domain.

– There was complex business logic for each report requirement.

– Most reports were multiple-level, drill-down reports.

The Process

  1. Understand the client’s needs, their database and data structure.
  2. Identify the report requirements and the scope of testing.
  3. Build test cases and update results for each report with the SQL scripts.
  4. Log defects in JIRA.

How Optimus Helped

Optimus’ team had an orientation session with our client’s operations manager to understand their different business modules and processes.

We then developed a plan for testing the report and shared it with our client. All the terms were agreed upon before the project commenced.

Optimus met the vendor’s QA and development lead to understand the high-level project requirements. Throughout the project, we worked closely with the QA lead and consulted the tech lead for any database related questions.

For data validation, we developed complex SQL scripts that were specific to each report’s requirement. We compared the outputs from the SQL to the figures projected in the reports using relevant parameters.

For report functional testing, our team used a requirements document that was specific to each report for reference. The test cases and results were reported in another document specific to each report. The defects were logged in JIRA, our client’s defect tracking system.

Reports with a list of issues to work on were sent to our client’s developer. Since supplier surveillance and approval data can be quite sensitive and crucial for an airline company, the QA services provided by Optimus assured our client that they had quality business intelligence from their supplier data.