Open Agent Studio: Introduce new RPA concepts for the agent era(github.com)
github.com
Open Agent Studio: Introduce new RPA concepts for the agent era
https://github.com/rohanarun/Open-Agent-Studio
2 comments
This seems really well-suited for our plan of creating an application usage assistant / interactive tutorial.. what do you think?
https://www.upwork.com/jobs/~01966592f96356c59c
Agentic Process Automation (APA) We introduce powerful new RPA concepts like "Semantic Targets" in simple language that are more robust and easier to use than the previous generation of brittle code selectors.
Agent Recorder Records clicks/mouse movement/keypresses to re-build the automation graph for you with accurate semantic targets in english, making it as easy as possible to build agents and edit them in simple language.
Live Agents Automate common processes and trigger them from visual queues across your business with agents that intelligently suggest automations from your library based on the context of the screen.
Prompt To No-Code Graph Type open-ended automations as prompts to generate custom no-code graphs. Our framework has access to install every open source python library, so you can ask for wild custom automations like generating movie trailers. Our generalized agent state machine can perform arbitrary tasks like booking a flight from Boston to LA, buying products on Amazon, and it even takes a different path each time since it considers each step using GPT-4 Vision.
Target Markets Untouched By AI Open Agent Studio is not just another co-pilot--it's a no-code co-pilot builder that enables solutions that're impossible in all other RPA tools today. Our customers have a head start over the new few months to target markets previously untouched by AI with their deep industry insight. Subscribers have access to a free 4 week course, which teaches how to evaluate product ideas and launch a custom agent with an enterprise-grade white label.
Key technical breakthroughs
Semantic targets are a 100% replacement for previous targeting strategies, solving a problem that frequently breaks all other RPA tools today when services update their designs.
Our own multi-modal model Atlas-2, outperforms all public UI models today using a mostly synthetic dataset we generated to get our accuracy from 95-100% for detecting UI elements.
Websocket server integration with the browser for advanced automations, including scraping links using semantic english targets.
Ships with multiple unlimited free open models like Llama 2, Mystral 7B, and top performing models like GPT-4 Vision and Claude 3 Opus.
We're excited to see what will be built and appreciate your feedback on how to make it even better.