This documentation is for Macro Recorder v4 beta. Click here the for current production version 3 documentation.
AI
Macro Recorder integrates access to the online OpenAI service and the self-hosted AI engine "Ollama" for use with your automation projects.
"OpenAI" is 3rd party paid online service. An API key is required to use OpenAI in Macro Recorder. Your AI prompts are sent to OpenAI and the result can then be used with other macro actions.
"Ollama" is a free 3rd party software that runs locally on your computer. No data is leaving your computer.
Macro Recorder itself does not perform any AI processing itself but integrates 3rd party AI engines into the user interface. The AI engine(s) must be set up in Macro Recorder which is a one-time procedure.
Due to the early stage of AI technology, the AI text output can be nonsensical, and the feature is considered experimental. It is provided "as-is" and is not part of the official Macro Recorder specification.
AI text processing
This AI text processing action let you process the text, provided as an input with the an instruction and save the result from OpenAI or Ollama into a variable for further use in your macro:
You can enter any static text as an input or right-click in the input box to add one or multiple variables that contain text from a parameter list, the clipboard, OCR text, etc:
Example applications:
- OCR-extract text from any part of a website and feed it to the AI engine to generate a blog article based on the extracted text.
- Read AI prompts from a text file line-by-line and let Macro Recorder insert the result wherever you want.
- Enter a text and insert AI generated variations into programs as needed.
AI image processing
This AI image analysis action can send a a bitmap together with an instruction ("prompt") for analysis by OpenAI and save the result into a variable for further use in your macro.
Example applications:
- Capture a screenshot and let "OpenAI Vision" count the occurrence of items in the bitmap.
- Load a bitmap file from your harddisk into a variable and use that variable to feed OpenAI Vision with the bitmap.
- Observe any desktop/program area and let OpenAI Vision check for occurrence of a particular item in that bitmap
Visual AI is limited to OpenAI at this time.
AI image generation
Macro Recorder can utilize the OpenAI AI service to generate a bitmap based on your description (aka "prompt") and saves the picture into a variable for further use in Macro Recorder.
For example, the variable containing the image can then be stored into the clipboard, as a file or interpreted by the AI image processing action.