Results

Results for Apps, Tests, Actions, Steps, Runs, Rules, Requests, Conditions, and Domains are displayed in their respective profile pages & on other pages.

Views

Results are seperated into different tabs/views to provide context into different aspects of the testing results.

Results View

The "Results" view displays Requests, along with the result of each Condition that the Request was tested against. This view also displays the total number of Conditions that were tested, and the counts of their results.


Conditions View

The "Condition" view displays a list of Conditions that failed during that Run, along with the total number of each failing condition.


Requests View

The "Requests" view displays a list of Requests along with their respective test results. The total number of Requests, including the number that passed and failed are displayed.

Scannable Items

A scannable item is an item that has a contextual relationship with the data that is produced after a Run. Scannable items include Apps, Tests, Actions, Steps, Runs, Rules, Requests, Conditions, and Domains.

Statuses

Most scannable items are assigned the status of passed failed error or skipped after the item has been Run & data processed.

  • A scannable item is assigned a status of passed if the Requests associated with that item does not fail any Condition assigned to the item.

  • A scannable item is assigned a status of failed if any Request fails any of the Assertions in Rules that are assigned to that item.

  • A scannable item is assigned a status of error if an error occurs during the run. Errors are typically accompanied with an error message on the item's profile page.

  • A scannable item is assigned a status of skipped if the Condition, in the Rule that is assigned to that item, is disabled.


Counts

A scannable item can have many Requests. Each Request is checked against all of the Conditions in the Rules that are assigned to the item. The numbers represent the amount of Request-Condition assignments that either passed, failed or error. Below are examples of scannable items and the pass/fail/error counts given the examples below:

Item Hypothetical Scenario
Test - 12 Requests produced from Test Run
- 1 Rule assigned to Test with 4 Conditions
- 48 Request-Condition checks conducted (12 * 4)
- 35 checks pass, 13 checks fail
STATUS
35 13
Action - 24 Requests produced from Action Run
- 2 Rules assigned to Test with 3 Conditions each (6 total)
- 144 Request-Condition checks conducted (24 * 6)
- 111 checks pass, 28 checks fail, 5 error
STATUS
111 28 5