Skip to content

ActionSet

The ActionSet component groups together multiple user actions that can be executed using the Intellibot Studio. The ActionSet component helps abstract an application screen into a the "ActionSet" component with simple inputs and outputs. This is similar to creating a model of an application screen.

Screenshot

Supported Functions

The user drags and drops the ActionSet component onto the design surface. Then double clicks on the ActionSet title bar to open the ActionSet Settings Window.

Screenshot

  1. Anchoring surface is used to capture UI screens and defining anchors and user actions.

  2. Capture Image button is used to capture the image of an application that renders on the screen. Note that as opposed to individual Action (UI) components such as
    Click, SetText, SendKeys, etc, where image of only specific UI elements is taken (buttons, text box, etc.), while using ActionSet, you need to grab the image of the complete application screen.

  3. Use the Add Anchor button to add anchor to uniquely identify a business application. Users can add more than one Anchor if needed.

  4. Right click on Yellow Box of added Anchor, to see the user actions that can be performed on the application.

  5. For each user action created, ActionSet component will dynamically create a Data In or Data Out port, based on the selection.

  6. Each user action can be renamed to match the UI element it is interacting with using the Name property from the Property Window.

  7. Action List window lists all the Anchors and User Actions created in a hierarchal view. Each user action displays its execution sequence number next to it to aid in development.

  8. Execution sequence of user actions can be changed by dragging them above or below other user actions in the Action List window.

Actions

Using the ActionSet component, you can execute the following actions on UI based applications:

Action Description Data Port
Click Performs a click action on the captured application screen. CreatePortByDefault: No
DataPortType:Data In DataType: String/Boolen
SetText Enters text into text boxes, drop down list, etc. CreatePortByDefault:Yes
DataPortType: Data In
DataType: String
GetText Acquires text from specific windows form controls such as labels, textboxes, drop down menus, list boxes, etc CreatePortByDefault:Yes
DataPortType: Data Out DataType: String
TextSelection Selects the text displayed in the application screen and enables user to copy or delete after selection. CreatePortByDefault:Yes
DataPortType: Data Out DataType: String
GetImage Retrieves the image displayed the application screen. CreatePortByDefault:Yes
DataPortType: Data Out
DataType: Image
GetTable Retrieves the data from list and table. CreatePortByDefault:Yes
DataPortType: Data Out DataType: Object
OCR Extracts text information from images. CreatePortByDefault:Yes
DataPortType: Data Out
DataType: Image
SendKeys Sends keystrokes to applications using keyboard events CreatePortByDefault:Yes
DataPortType: Data In DataType: String
MouseAction Performs various mouse actions like click, right–click and more on the application. CreatePortByDefault:No
DataPortType:Data In DataType: String/Boolean
Delete Deletes the anchor or any action. NA

Note

Please refer to the individual component documentation for each of the above actions to understand how to use them.

Ports

The ActionSet component exposes the Control In and Control Out ports. The Data In and Data Out ports on the ActionSet component are dynamic and are configured as per automation workflow or project requirements.

Port Description
Control In Must be connected to the Control Out port of one or more components.
Control Out Can be connected to the Control In port of another component, or the default end component.
Data In Can be connected to the Data Out port of another component from where data is to be collected. Data In ports are created by selecting the Expose Port property of SetText and SendKeys actions, within the ActionSet Settings.
Data out Can be connected to the Data In port of another component. Data Out ports are created by selecting the Expose Port property of GetText, OCR and GetImage actions, within the Action Set settings.

Example

Let us consider an example of entering data into a sample Quote Entry Application.

Screenshot

  1. From the Toolbox, expand Actions and click ActionSet.

  2. Drag the ActionSet component and drop it on the Design surface.

  3. On the Design surface, double-click the title bar of the ActionSet component.
    The ACTIONSET SETTINGS dialog box is displayed.

    Screenshot

  4. In the ACTIONSET SETTINGS dialog box, under ANCHORING SURFACE, the FindWindow function enables users to retrieve an active window whose window name and properties, match with the provided identifiers.

  5. Click CAPTURE IMAGE, Press “CTRL+SHIFT” to select the region. The selected area is displayed in the ACTIONSET SETTINGS window. In this example, an image of Quote Entry Form is displayed.

    Note

    While using `ActionSet' component, always capture the image of the complete application screen.

    Screenshot

  6. Under ANCHORING SURFACE, click ADD ANCHOR. Intellibot adds an anchor under ACTIONS LIST and a yellow highlight is displayed on the captured image.

  7. Position the yellow box on a fixed area in the captured image. This yellow box is the anchor element that will help Intellibot identify the application screen it has to perform user actions on. Adjust the size of the Anchor box to cover the text or image you want to use as the screen Anchor.

    Screenshot

  8. Right-click the anchor to view the available actions.

    Screenshot

    In this example, we will use the SetText action. You can use any another action as per your requirement.

  9. From the list of actions, select SetText.
    A green circle with a cross-hair is displayed.

  10. Position the green circle on the image where the SetText action is required.

    Screenshot

  11. Edit the properties of the SetText action from the ACTIONSET SETTINGS window, under PROPERTIES:

    Screenshot

    Action Description
    Search Search the property you want to set
    After Delay in Seconds Specifies the wait time (in seconds) to be estimated after the actions is performed.
    Before Delay in Seconds Specifies the wait time (in seconds) to be taken before the actions is performed.
    Execution Order Define the order in which the actions are to be performed
    Expose Port Expose the user action as a data in or data out port on the ActionSet component.
    Name Specifies the name for the action. Always set the name to match the application field you are interacting with.
    X Specifies the location of the Click action on the X-axis.
    Y Specifies the location of the Click action on the Y-axis
  12. Set the Expose Port property to dynamically create a Data In port.

  13. Repeat the steps for the all fields you want to set the data in.

  14. To click the submit button, right-click the Anchor and select Click action.

  15. Place the green circle on the Submit button.

    Screenshot

    • Every action added will display a serial number besides it. This number will denote the order in which the action is executed.

    • Users can view all the anchors, actions and also the order in which they will run, in ACTIONS LIST window.

    • Users can change the order of execution by dragging and moving the selected action in the ACTIONS LIST Window.

    • To view all the action in an anchor, expand the anchor.

  16. Click Close to save and exit from the ACTIONSET SETTINGS dialog box.
    All the SetText actions will be displayed as data input ports on the component. Any data provided to the Data In ports will be filled in the respective fields.

    Screenshot

  17. To provide inputs into the ActionSet component, Let's add a Variable component.

  18. To add the Variable component:

    • In the Toolbox, expand General.

    • Drag the Variable component and drop it on the design surface.

    • To add additional variables, click on the title bar of the Variable component.

    • Double-click the variables and enter the values you want to send to the data in ports of the ActionSet component.

  19. Connect all the Control ports.

  20. Connect the data out ports of the Variable component to the data in ports of the ActionSet Component.

  21. In the toolbar, click Run.

The data provided from the Variable component is auto-populated in the sample Quote Entry Form