Open Agent Studio No-Code Actions
This documentation details Open Agent Studio’s no-code actions, designed to build powerful desktop automations without writing code. Each action is described along with its input parameters and an example use case.
Icon:
Description: Initiates the automation process by opening a specified application or a URL.
Input Parameters:
Example Use Case: To begin your automation by opening the Cheat Layer website, put your browser’s path in “Initial Program” and “https://cheatlayer.com” in “Arguments”.
Icon: Description: Moves the mouse cursor to precise coordinates on your screen.
Input Parameters:
Example Use Case: Place the cursor over a specific area within an application before clicking or typing.
Icon:
Description: Simulates various mouse click types, either by coordinates or using semantic targeting of elements.
Input Parameters:
Example Use Cases:
Icon:
Description: Automates keyboard input, sending keystrokes and typing text to the active window.
Input Parameters:
We support the following keyboard keys if you enter them only into the string input:
Input String | Output Action |
---|---|
”Current Directory” | Write resource path |
”resource_path” | Write resource path |
”backspace” | Press backspace |
”space” | Write space |
”period” | Write period (.) |
“slash” | Write slash (/) |
“return” | Press enter |
”shift” | Hold shift key |
”ctrl” | Hold ctrl key |
”alt” | Hold alt key |
”tab” | Hold tab key |
”enter” | Press enter |
Example Use Cases:
Icon:
Description: Introduces a pause in the automation to allow time for websites to load, processes to complete, etc.
Input Parameters:
Example Use Case: Wait for a web page to load after clicking a link before trying to interact with it.
Icon:
Description: Opens a specified program on your computer with optional arguments.
Input Parameters:
Example Use Case: Open a website in Chrome by setting “program” to your Chrome executable path and “Arguments” to “https://www.example.com”.
Icon:
Description: Executes a bash command in your operating system’s terminal.
Input Parameters:
Example Use Case: Run a command to update a system package: sudo apt-get update
Icon:
Description: Embed custom Python code directly into your workflow to add complex logic or interact with external libraries.
Input Parameters:
Special Features:
{{my_variable}}
will be replaced by the corresponding values from your global variables.Example Use Cases:
Downloading a tikto video to repurpose it:
Icon:
Description: Describes a targeted region of a screenshot using AI. This provides a way to dynamically identify web elements, even if their visual presentation changes.
Input Parameters:
Example Use Case: Accurately target a button that has a varying position or changes its appearance from time to time.
Icon:
Description: Displays the value of a specific global variable in Open Agent Studio’s console for debugging.
Input Parameters:
Example Use Case: Ensure that data scraped from a website has been stored correctly in a global variable before using it in another action.
Icon:
Description: Automates the scrolling of a window - primarily useful for web pages.
Input Parameters:
Example Use Case: Scroll to the bottom of a long web page to reveal more content to be scraped.
Icon:
Description: Sends data to an external application or webhook using HTTP requests. Enables integration with web services.
Input Parameters:
**Example Use Cases: **
Icon:
Description: Adds conditional logic to your automations, letting the agent make choices based on data or conditions.
Input Parameters:
includes
: Checks if one string contains another.equals
: Tests for an exact match.greater than / less than
: For numerical comparisons.regex match
: Uses regular expressions for more complex pattern matching.Example Use Case: You’re scraping a webpage. If the text “Out of Stock” is found, you might want to trigger one set of actions, and a different set if its “In Stock’.
Icon:
Description: Execute a pre-built automation agent — a self-contained automation flow — as a step within your larger workflow.
Input Parameters:
Example Use Case: You’ve downloaded a file. Use a Generalized Agent to automate the process of uploading it to your chosen cloud storage provider.
Icon:
Description: Reads or writes data to and from Google Sheets, ideal for storing scraped information, managing lists, or dynamic input.
Input Parameters:
Example Use Cases:
Icon:
Description: Sends an email message with optional attachments.
Input Parameters:
Example Use Case: Alert yourself by email when a specific condition is met during automation, such as a product becoming available.
Okay, here is the documentation for the remaining no-code actions.
Icon:
Description:: Perform basic arithmetic operations within your workflow.
Input Parameters:
Example Use Case: Calculate discounts on e-commerce prices by subtracting a percentage.
Icon:
Description: Retrieves data from a URL, including web pages, APIs, or local files.
Input Parameters:
Example Use Cases:
Icon:
Description: Downloads a file from a URL to your computer.
Input Parameters:
Example Use Case: Automate the process of downloading a file from a remote server.
Icon:
Description: Captures a screenshot of your entire screen or a specified region.
Input Parameters:
Example Use Case: Document the state of your desktop during automation or capture images for visual analysis.
Icon:
Description: Captures an image from a connected webcam, saving the image to your computer.
Input Parameters:
Example Use Case: You could integrate webcam captures into a workflow that analyzes images for visual inspection tasks or for gathering visual data.
Icon:
Description: Generates videos based on text descriptions, using a variation of Stable Diffusion optimized for dynamic video content (requires Replicate API integration).
Input Parameters:
maintain_aspect_ratio
: Keeps the original dimensions.crop_to_16_9
: Fits video into a 16:9 widescreen format.use_image_dimensions
: If your input is an image, the generated video will use its dimensions.Example Use Cases:
Icon:
Description: Leverage the power of OpenAI’s GPT-4 language model for advanced language processing and content creation.
Input Parameters:
Example Use Cases:
Icon:
Description: Describes the task you want to automate in plain English and lets the Cheat Layer AI (Project Atlas) figure out how to execute it, using its knowledge of UI patterns and web elements.
Input Parameters:
Example Use Case: “Create a Twitter post with a picture of a cat and the hashtag #cutecats.” Project Atlas will attempt to launch Twitter (if not already open), compose the post, find an image of a cat (possibly using AI image generation), and publish the tweet.
Icon:
Description: Records audio and screenshots to process downstream using language models. Outputs a transcript of the recording using OpenAI Whisper.
Input Parameters:
Audio File: the file name to save the .wav (no extension necessary)
Time: The time in seconds to record the audio.
Screenshot File(optional): The file name to save a screenshot.
Example Use Case: Build a fact-checker that loops constantly and allows verifying what people in a zoom or live meeting are saying.
Open Agent Studio No-Code Actions
This documentation details Open Agent Studio’s no-code actions, designed to build powerful desktop automations without writing code. Each action is described along with its input parameters and an example use case.
Icon:
Description: Initiates the automation process by opening a specified application or a URL.
Input Parameters:
Example Use Case: To begin your automation by opening the Cheat Layer website, put your browser’s path in “Initial Program” and “https://cheatlayer.com” in “Arguments”.
Icon: Description: Moves the mouse cursor to precise coordinates on your screen.
Input Parameters:
Example Use Case: Place the cursor over a specific area within an application before clicking or typing.
Icon:
Description: Simulates various mouse click types, either by coordinates or using semantic targeting of elements.
Input Parameters:
Example Use Cases:
Icon:
Description: Automates keyboard input, sending keystrokes and typing text to the active window.
Input Parameters:
We support the following keyboard keys if you enter them only into the string input:
Input String | Output Action |
---|---|
”Current Directory” | Write resource path |
”resource_path” | Write resource path |
”backspace” | Press backspace |
”space” | Write space |
”period” | Write period (.) |
“slash” | Write slash (/) |
“return” | Press enter |
”shift” | Hold shift key |
”ctrl” | Hold ctrl key |
”alt” | Hold alt key |
”tab” | Hold tab key |
”enter” | Press enter |
Example Use Cases:
Icon:
Description: Introduces a pause in the automation to allow time for websites to load, processes to complete, etc.
Input Parameters:
Example Use Case: Wait for a web page to load after clicking a link before trying to interact with it.
Icon:
Description: Opens a specified program on your computer with optional arguments.
Input Parameters:
Example Use Case: Open a website in Chrome by setting “program” to your Chrome executable path and “Arguments” to “https://www.example.com”.
Icon:
Description: Executes a bash command in your operating system’s terminal.
Input Parameters:
Example Use Case: Run a command to update a system package: sudo apt-get update
Icon:
Description: Embed custom Python code directly into your workflow to add complex logic or interact with external libraries.
Input Parameters:
Special Features:
{{my_variable}}
will be replaced by the corresponding values from your global variables.Example Use Cases:
Downloading a tikto video to repurpose it:
Icon:
Description: Describes a targeted region of a screenshot using AI. This provides a way to dynamically identify web elements, even if their visual presentation changes.
Input Parameters:
Example Use Case: Accurately target a button that has a varying position or changes its appearance from time to time.
Icon:
Description: Displays the value of a specific global variable in Open Agent Studio’s console for debugging.
Input Parameters:
Example Use Case: Ensure that data scraped from a website has been stored correctly in a global variable before using it in another action.
Icon:
Description: Automates the scrolling of a window - primarily useful for web pages.
Input Parameters:
Example Use Case: Scroll to the bottom of a long web page to reveal more content to be scraped.
Icon:
Description: Sends data to an external application or webhook using HTTP requests. Enables integration with web services.
Input Parameters:
**Example Use Cases: **
Icon:
Description: Adds conditional logic to your automations, letting the agent make choices based on data or conditions.
Input Parameters:
includes
: Checks if one string contains another.equals
: Tests for an exact match.greater than / less than
: For numerical comparisons.regex match
: Uses regular expressions for more complex pattern matching.Example Use Case: You’re scraping a webpage. If the text “Out of Stock” is found, you might want to trigger one set of actions, and a different set if its “In Stock’.
Icon:
Description: Execute a pre-built automation agent — a self-contained automation flow — as a step within your larger workflow.
Input Parameters:
Example Use Case: You’ve downloaded a file. Use a Generalized Agent to automate the process of uploading it to your chosen cloud storage provider.
Icon:
Description: Reads or writes data to and from Google Sheets, ideal for storing scraped information, managing lists, or dynamic input.
Input Parameters:
Example Use Cases:
Icon:
Description: Sends an email message with optional attachments.
Input Parameters:
Example Use Case: Alert yourself by email when a specific condition is met during automation, such as a product becoming available.
Okay, here is the documentation for the remaining no-code actions.
Icon:
Description:: Perform basic arithmetic operations within your workflow.
Input Parameters:
Example Use Case: Calculate discounts on e-commerce prices by subtracting a percentage.
Icon:
Description: Retrieves data from a URL, including web pages, APIs, or local files.
Input Parameters:
Example Use Cases:
Icon:
Description: Downloads a file from a URL to your computer.
Input Parameters:
Example Use Case: Automate the process of downloading a file from a remote server.
Icon:
Description: Captures a screenshot of your entire screen or a specified region.
Input Parameters:
Example Use Case: Document the state of your desktop during automation or capture images for visual analysis.
Icon:
Description: Captures an image from a connected webcam, saving the image to your computer.
Input Parameters:
Example Use Case: You could integrate webcam captures into a workflow that analyzes images for visual inspection tasks or for gathering visual data.
Icon:
Description: Generates videos based on text descriptions, using a variation of Stable Diffusion optimized for dynamic video content (requires Replicate API integration).
Input Parameters:
maintain_aspect_ratio
: Keeps the original dimensions.crop_to_16_9
: Fits video into a 16:9 widescreen format.use_image_dimensions
: If your input is an image, the generated video will use its dimensions.Example Use Cases:
Icon:
Description: Leverage the power of OpenAI’s GPT-4 language model for advanced language processing and content creation.
Input Parameters:
Example Use Cases:
Icon:
Description: Describes the task you want to automate in plain English and lets the Cheat Layer AI (Project Atlas) figure out how to execute it, using its knowledge of UI patterns and web elements.
Input Parameters:
Example Use Case: “Create a Twitter post with a picture of a cat and the hashtag #cutecats.” Project Atlas will attempt to launch Twitter (if not already open), compose the post, find an image of a cat (possibly using AI image generation), and publish the tweet.
Icon:
Description: Records audio and screenshots to process downstream using language models. Outputs a transcript of the recording using OpenAI Whisper.
Input Parameters:
Audio File: the file name to save the .wav (no extension necessary)
Time: The time in seconds to record the audio.
Screenshot File(optional): The file name to save a screenshot.
Example Use Case: Build a fact-checker that loops constantly and allows verifying what people in a zoom or live meeting are saying.