"DESKTOP_CLICK" Command

Owned by Joseph Hamdan
Last updated: Jun 11, 2024
2 min read

Description: This command clicks on a desktop element defined by a screenshot of the target (Desktop locator) or by OCR with the option Use Text.
Usage Scenario: Suppose we want to click the Start button on Windows 10.

Procedure: Take a screenshot of the Start bar icon and upload it to be used in a Desktop locator for the command to interact with. Your step will look like this:

image-20240611-150411.png

  • NOTE: The Similarity field is to adjust the matching approximation (minimum of 0.10 - maximum of 0.98) which improves the accuracy of matching the exact image in the case of multiple images with similar appearance.

Desktop commands are controlled by Locator Timeouts under User Execution Preferences. If the locator timeout is not sufficient enough for the command to find the element, you can increase Locator Timeout to give the step more time to work. It’s recommended to use 20 seconds for desktop commands.

Notes:

  1. If you do not see any highlight during execution, please enable the option Desktop Highlight under User Execution Preferences and save.

  2. Offsets can be used to to shift the search region from the supporting element. This field accepts positive and negative values. The X field will shift horizontally (positive value = move to the right / negative value = move to the left) and the Y field will shift vertically (positive value = move downwards / negative value = move upwards)

  3. Extensions can be used to extend/shrink the area to interact with as seen by the highlight during execution. This field accepts positive and negative values.

  4. Crop Region Offset can be used to designate an area for execution to look through to reduce execution duration and ensure additional accuracy. The values provided will crop the area. For example, if you provide 50 points in the Left field, only the 50% of the right side of your screen will be interacted with.

  5. Multiline can be used to interact with text which is visible on multiple lines.

The following video demonstrates how this step gets executed and the result is retrieved:

Â