Test Execution Analytics

You can perform status analyses for one or several test plans or test packages, with different types of analyses.

Features

You can start the reports from the launchpad, under Test Suite - Analytics. The following reports are available under Test Execution Analytics:

Multiple Test Plan Status

In your search results, you will see all test plans corresponding to your search criteria, with aggregated information on test execution, for example, the number of test cases in progress, with no result, errors or OK, and the number of open defects.

For the overall test plan, the test plan status, person responsible, number of test packages and testers, and the number of unassigned test cases is displayed.

When you select a test plan, several graphics illustrate the status:

Test cases per type
Test cases per status
Defects per priority

You can also access the test case analysis for the selected test plan.

Test Plan - Test Package Analysis

The search result shows a hierarchy with three levels: test plan, test packages, and assigned testers.

For the test plan and test package rows, you can see aggregated values about test evaluation, for example the number of involved testers, number of test case per specific status, number of defects, and the number of test cases per type.

For tester row, you can see, the business partner of the tester and whether his assignment is locked or unlocked. Choose Go to to navigate to the other reports available for the selected line.

Choose Personalization to add additional columns. In the hierarchy, the node description is a link with which you can navigate to the relevant object, for example to the test plan or test package.

Test Plan - Test Cases Analysis

The search result shows the test plan hierarchy, with status information. On test plan level, you see aggregated values about test cases execution status: number of unassigned test cases, number of test cases per status, and number of defects.

On test case level, you can see individual status information, such as date and last tester, and some test case data, such as the test case classification and priority.

Choose Personalization to add additional columns. In the hierarchy, the node description is a link with which you can navigate to the relevant object.

Click on the status icon for a test case, to open a popup with all test statuses per package and tester. These statuses are aggregated to the overall test case status.

Test Package - Test Cases Analysis

The search result shows the test package hierarchy, with status information. On test package level, you see aggregated values about test cases execution status: percentage of results still missing, test cases per status, and number of defects.

On test case level, you can see individual status information, the date and last tester, and for example the test case classification and priority.

Choose Personalization to add additional columns. In the hierarchy, the node description is a link with which you can navigate to the relevant object.

Click on the status icon for a test case, to open a popup with all test statuses per package and tester. These statuses are aggregated to the overall test case status.

Test Plan - Defects Analysis

This report gives an overview of the defects that were created in a test plan. Testers create defects if a test could not be performed.

You can define several criteria, to get an analysis for all test plans.
- To determine the granularity of the report, use the following lists:
  - Defect Analysis: details about the defect and the related test case. So if a defect has been assigned to more than one test case, it appears several times in the list.
  - Defect Overview: defect information in an aggregated mode, so that each defect only appears once.
- You can select defect transaction types.
Depending on the search criteria, the system displays an analysis or an overview of the defects for the test plans, including useful information such as the defect ID, status, priority, and reporter.
To open the incident for a defect in your incident management system, click the defect ID. Here you get more information and can process the incident in IT Service Management.

Defect information is directly retrieved from the incident system, and therefore continuously up to date.

Alternatively, you can access reports a test plans in the Test Plan Management application. Select a test plan and choose Start of the navigation path Go To Next navigation step Defects Overview End of the navigation path .

Test Package - Defects Analysis

This report shows the defects that were created for test cases in one test package. It is similar to the defects analysis for test cases, but only shows the defects for a selected test package.

Test Result Document

With this report you can generate a Microsoft Word document with information on a test plan. This comprises test package information, defects, and landscape details.

Select a test plan and the information you want to have in the document. Then choose Execute and save the file locally.