Mouse

The Mouse component enables automation of user actions like move, left click, right click, middle click, double click, drag, drop, and paste which otherwise are performed manually using the mouse. The Mouse component uses hardware interrupts to simulate mouse actions, hence it is more reliable when working with some applications, such as Citrix.

Screenshot

Ports

The Mouse component exposes Control In and Control Out ports by default.

Port Description
Control In Must be connected to the Control Out port of one or more components.
Control Out Must be connected to the Control In port of any other component.

Properties

To edit the properties of the Mouse component, change the required property in the lower-right pane. This is necessary to select the action to be performed with the mouse component. Users can edit the following properties

Property Description
Search Search for the respective property.
Delay After Execution Specifies the wait time (in seconds) after the action is executed
Delay Before Execution Specifies the wait time (in seconds) before the action is executed.
Name The name for the Mouse action.Always set the name to match the application field you are interacting with
Click X The location of the Mouse action on the X-axis.
Click Y The location of the Mouse action on the Y-axis.
Type The mouse action such as left-click, right-click to be performed.
Search As Gray Scale Image Enable check box to search the selected area in Mouse component as a gray scale image.
Threshold specifies the image matching accuracy before performing the Mouse operation.The value of 1 defines a 100% match while 0.5 defines 50% match.The default value is 0.9 or 90% match.
Max Wait Time in Seconds Specifies the wait time (in seconds) for the Mouse operation to be performed. The default value is set to 30 seconds.
Wait After Image Found Specifies the wait time (in seconds) after the image is found.
Wait for Create Specifies if the Mouse component must wait for the operation to be performed on the screen. The default value is True.

Example

Let us consider an example of using the Mouse functionality to move a document to a folder.

Screenshot

To use the Mouse component:

  1. In the Toolbox, expand the Actions category.

  2. Drag the Mouse component and drop it on the design surface.

  3. Double click on the Mouse component to add multiple images .

    Screenshot

  4. To select the region, click Screenshot.Then Press “CTRL+SHIFT” for selection message is displayed.

  5. Press CTRL+SHIFT.The mouse pointer becomes a crosshair.

  6. If the First captured image is not displayed on the screen then it searches for next captured image. Click Screenshot sign to add next image.

  7. Select the region of the file which which is needed to be transfered to another folder.
    The selected region is displayed in the Mouse component.

  8. To move a document to a folder for this Mouse component, in properties, under Type, click Drag.

  9. Similarly, drag another Mouse component and drop it in the design surface.

  10. To select the region, click Screenshot.

  11. The user have to select the area of the folder where they want to transfer the document.

  12. To move a document to a folder for this Mouse component, in properties, under Type,click Drop.

  13. Connect:

    • The control ports between Start and the Mouse component.

    • The Control Out port of the Mouse component with the Control In port of the next Mouse component.

    • The Control Out port of the Mouse component with the Control In port of the next End component.

  14. Click Run.