Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

After opening, the most recent run which has failures will be automatically selected for you so you can easily begin checking the failures. You will also notice that the header title, left panel icon and breadcrumb now reference the ID and Name of the execution set for easier identification.

...

Details Pane

On the detail panel on the right, the following information will be displayed in the top section along with the main status:

...

  1. ID: This is dynamically generated and contains the ID of the execution set (shown in the first image above) and the ID of the selected execution separated by a dot.

  2. Started By: This shows the username of the person who started the execution. It may or may not be the same user who created the execution set

  3. Started On: This shows the date/time in which the run was triggered (in other words, sent to cloud run, but may not necessarily have started execution yet)

  4. Completed On: This shows the date/time in which the execution finished

  5. Duration: This shows the duration of the execution

  6. Runs: This shows the number of execution runs

  7. Reruns: This shows the number of reruns that were either started automatically or manually by the user

  8. Type: This shows the type of cloud run request. The value here could be one of 3:

    1. Portal: Started directly by the user (clicking Cloud Run icon)

    2. Scheduled: Started by Subject7 automatically using a schedule defined by the user

    3. Web Service: Started by API (Either directly via the API or by using Jenkins CI/CD plugin)

  9. Pool: This shows you the pool configured in the execution set where execution took place

  10. Browsers: This shows you which browser(s) you configured in the execution set. The greyed out ones have not been select in the below image.

...

...

Navigation Between Layers

In order to avoid opening multiple tabs, all layers of execution will be open on a single tab and you can use the arrows on the top left (next to Add to Bookmarks) to navigate between the layers.

...

Schedules

If you would like to review your schedule, you can do in one of the following ways:

  1. Click Schedule tab. It will show you a fixed schedule for you to review (cannot be edited from here)

    image-20241227-113143.png
  2. Click Edit Settings which will show you the execution set edit form where you can adjust the schedule

    image-20241227-113236.png

Execution Details

In the last section of the detail pane, you will see your Test Runs separated into 2 categories: All and Failed. Since the user will mostly be concerned with checking the failures, the Failed view will be activated by default, but you can click All to see all of the executions.

...

In the table below the widgets, we will see the executions in each run. The summary column will show a summary bar to graphically highlight where the test failed. While the details pane on the right will automatically show the image highlighting where the failure took place in the video. The bottom section of the details pane also shows you the ID, Status, Failure Message as well as additional information that may be of help to you.

Execution Metadata

If you would like to view additional details about your execution, you can click Metadata tab.

...

This will show you all the information you need related to your execution as follows:

...

Comparison and Export

The table also shows you the status of each execution as well as the datasets on the right side of the status. More Actions (ellipsis) icon in both the last column and the details pane allows you to compare executions, download videos or view any additional data as shown below. You can also compare using the icon highlighted on the left side.

...