Testlink Implementation for Black Box Testing

  1. Create Test Project
  2. Assign Users to Test Project
  3. Create Requirement Specification
    1. Create Requirement Specification Operations
    2. Create Requirement Operations
    3. Requirement Overview
  4. Create Test Specification
    1. Create Test Suite
    2. Create Test Case Operations
    3. Automatically generate Test Cases from Requirement Operations
  5. Create Test Plan
  6. Create Build / Releases (Set mile stones)
  7. Assign Test cases to Test Plan
  8. Assign Test Cases for Test Execution
  9. Execute Test Cases and log defects
  10. Add Test Cases in between of Execution (if required)
  11. Generate Test Reports and metrics
    1. Test Report
    2. Failed Test Cases

1. Create Test Project

Users with Manager or Admin role can create Test Projects.

To create a new Test Project, click on Project link -> Test Project Management and click the Create button.

create-test-project Testlink Implementation for Black Box Testing

Enter your project details and click the Create button.

Click Project link and in the Test Project drop down at the top right select your project.

test-project-dropdown Testlink Implementation for Black Box Testing

2. Assign Users to Test Project

If a project is not created as Public, then we have to assign users to project and specify their roles. Once again, only users with Admin or Manager role can perform this action.

Use the following procedure to assign users to the new Test Project.

  • Create a Project without Public Rights.
  • Click the User Management link at the top right of the page.
  • Click Assign Test Project Roles.
  • Select your project from the Test Project drop down and click the Change button.select-project Testlink Implementation for Black Box Testing
  • Assign users appropriate rights and click the Update button when done.

3. Create Requirement Specification

3.1 . Create Requirement Specification Operations

Use the following procedure to create your Requirement Specification in TestLink.

  • Go to Project -> Requirement Specification.
  • Click the Create button.
  • Create your section requirements, user requirements and system requirements as necessary.

create-requirements Testlink Implementation for Black Box Testing

3.2 . Create Requirement Operations

Once Requirement Specification Operations are created, we can create Requirement Operations by selecting particular Requirement Specification Operations and clicking the Create button under the desired Requirement Operations.

User can create the following types of Requirement Operations:

  • Informational
  • Feature
  • Use Cases
  • User interface
  • Non Functional
  • Constraint
  • System Function

create-requirement-operations Testlink Implementation for Black Box Testing

Once all requirements are created, their status can be assigned to the following options:

  • Draft
  • Review
  • Rework
  • Finish
  • Implemented
  • Valid
  • Non testable
  • Obsolete

requirement-operation-status Testlink Implementation for Black Box Testing

The user can also enter the number of test cases required to get 100 percent test coverage for each Requirement Operation.

test-cases-needed Testlink Implementation for Black Box Testing

Once the requirements are frozen you can freeze the current version by clicking on Freeze this version.

freeze-version Testlink Implementation for Black Box Testing

When changes are required, you can create a new version of your requirements by clicking on the Create a new revision button.

create-new-revision Testlink Implementation for Black Box Testing

3.3. Requirement Overview

Users can generate a Requirement Specification overview to check the coverage of requirements and their coverage in test cases.

To access this overview, go to Project -> Requirement Overview.

requirement-overview Testlink Implementation for Black Box Testing

4. Create Test Specification

4.1 Create Test Suite

Use the following procedure to create your test suite.

  • Go to Project Link -> Test Specification and select your project.select-project1 Testlink Implementation for Black Box Testing
  • Click the Create button.create-test-suite Testlink Implementation for Black Box Testing
  • Enter mandatory details and click the Create Test Suite button.

4.2 Create Test Case Operations

Click the Create button under the Test Case Operations heading.

test-case-operations Testlink Implementation for Black Box Testing

Alternately, Test Cases can also be generated from Requirement Operations. Below are the steps to do that.

  • Navigate to Project -> Requirement Specifications.
  • Select Requirement Specification Operation.

requirement-specification-operation Testlink Implementation for Black Box Testing

4.2.1 Automatically generate Test Cases from Requirement Operations

Use the following procedure to automatically generate Test Cases from Requirement Operations.

  • Click the Create Test Cases button under the Requirement Operations heading.create-test-cases Testlink Implementation for Black Box Testing
  • Select Requirement -> Enter number of Test Cases and click the Create Test Cases button.

test-cases-requirements Testlink Implementation for Black Box Testing

This automatically generates a Test Suite with name of the Requirement Specification Operation and test cases with the name of Requirement Operation auto-incrementing by one for each required test case.

All automatically generated test cases need to be refined by editing the summary, preconditions and adding test steps. All generated test cases are automatically linked with their requirements.

generated-test-cases Testlink Implementation for Black Box Testing

5. Create Test Plan

Once Requirement and Test Cases are created we need to create a Test Plan to cover them.

Use the following procedure to create a Test Plan.

  • Navigate to Project -> Test Plan Management and click the Create button.create-test-plan Testlink Implementation for Black Box Testing
  • Enter mandatory details and click the Create button

test-plan-creation Testlink Implementation for Black Box Testing

If all goes well, your test plan should appear as follows.

test-plan Testlink Implementation for Black Box Testing

6. Create Build / Releases

Use the following procedure to create a build or release.

  • Navigate to Build / Releases and click the Create button.build-management Testlink Implementation for Black Box Testing
  • Enter Title , Description, Release Date and Click Create Button

create-build Testlink Implementation for Black Box Testing

The new Build should appear as follows.

new-build Testlink Implementation for Black Box Testing

7. Assign Test Cases to Test Plan

Next we need to assign our test cases to the test plan.

  • Navigate to your Project and select Add /Remove Test Cases.
  • Select the Test Suite under your Project.select-test-suite Testlink Implementation for Black Box Testing
  • Click on the check/uncheck all test cases for adding button to select all test cases.select-all Testlink Implementation for Black Box Testing
  • Click on the Add Selected button. All Test Cases get highlighted in yellow .

add-selected Testlink Implementation for Black Box Testing

8. Assign Test Cases for Test Execution

Now we need to assign test cases for test execution.

  • Navigate to your project and select Assign Test Case Execution.
  • Select the desired Test Suite.
  • Select Check/Uncheck All Test Cases and click the Do button to select all test cases.

select-all-test-cases Testlink Implementation for Black Box Testing

Test cases can be assigned in bulk or individually

For bulk user assignment, follow these steps.

  • Select the tester’s name and click the Do button. The tester’s name will appear in the Assign drop down to the right of each page.test-case_assignment Testlink Implementation for Black Box Testing
  • Click the Save button.

9. Execute Test Cases and log Defects

Now your testers can login with their credentials and start test execution of their assigned test cases using the following procedure:

  • Find the desired project and click Execute Tests.
  • Select the desired test cases, and click Execute.

The results will return one of the following:

  • Not Run
  • Passed
  • Failed
  • Blocked

test-case-execution Testlink Implementation for Black Box Testing

Depending on the results, select the appropriate radio button and click the Save execution button.

passed-test Testlink Implementation for Black Box Testing

failed-test Testlink Implementation for Black Box Testing

Link the defect with the failed test case and click Access to Bug Tracking System (Redmine).

bug-tracking Testlink Implementation for Black Box Testing

Log the defect in your bug tracking system, in this case Redmine. And click Link Existent Issue under Bug Management in Testlink.

bug-management Testlink Implementation for Black Box Testing

The Add bug report window will open.

Enter the Bug id and click the Add Bug button.

add-bug-report Testlink Implementation for Black Box Testing

A summary of the bug will now load with the failed test case.

Repeat as necessary.

10. Adding New Test Cases in Between Test Execution

If new test case needs to be added in between of test execution, below are the steps for same

  • Navigate to your project and select Test Specification.
  • Select the desired requirement operation.requirement-operation Testlink Implementation for Black Box Testing
  • Under the Test Case Operations heading, click the Create button.create-test-case-operation Testlink Implementation for Black Box Testing
  • Enter the mandatory test case details.
  • Navigate to Project -> Requirement Specification -> Assign Requirements.requirement-specification Testlink Implementation for Black Box Testing
  • Select the newly added test case.
  • Select Available requirements and click the Assign button to assign requirements to the test case.available-requirements Testlink Implementation for Black Box Testing
  • Navigate to the project and click Add / Remove Test cases.
  • Select the newly added test case and click the Add/Remove selected button.add-remove-test-cases Testlink Implementation for Black Box Testing
  • Navigate to the project and select Assign Test Case Execution.
  • Select newly added test case and add choose tester name from the Assigned to drop down and click the Save button.test-case-assignment Testlink Implementation for Black Box Testing

Now the tester can login with his or her normal credentials and execute the newly added test case in existing test plan.

11 .Generate Test Reports

11.1 Test Report

The test report shows the Pass/Fail status of test cases. Once execution is completed, users can generate test reports and metrics for each Test Plan.

To generate a test report,

  • Click the Test Report link at the top of the page
  • Set the Report format to HTML, or whatever other format you want.
  • Select the appropriate test plan from Test plan drop down.reports-metrics Testlink Implementation for Black Box Testing
  • Select Test Report.select-test-report Testlink Implementation for Black Box Testing
  • Select the content that you want to include in the report.test-report-content Testlink Implementation for Black Box Testing
  • Select the test project or test suite for which the test report needs to be generated.
  • Click Print button and then save as PDF.

report Testlink Implementation for Black Box Testing

11.2 Failed Test Cases

Use the following procedure to generate a report on failed test cases.

  • Select HTML as your Report format .
  • Select the desired test plan from the Test Plan drop down.
  • Click the Failed Test Cases link.failed-test-cases-settings Testlink Implementation for Black Box Testing
  • Click the Print button and save the report in PDF format.

failed-test-cases-report Testlink Implementation for Black Box Testing