Skip to content
Tech News
← Back to articles

Show HN: Magnitude – Open-source AI browser automation framework

read original get Google Pixel β†’ more articles

The AI browser automation framework

Magnitude uses vision AI to enable you to control your browser with natural language

🧭 Navigate - Sees and understands any interface to plan out actions

- Sees and understands any interface to plan out actions πŸ–±οΈ Interact - Executes precise actions using mouse and keyboard

- Executes precise actions using mouse and keyboard πŸ” Extract - Intelligently extracts useful structured data

- Intelligently extracts useful structured data βœ… Verify - Built-in test runner with powerful visual assertions

You can use it to automate tasks on the web, integrate between apps without APIs, extract data, test your web apps, or as a building block for your own browser agents.

↕️ Magnitude in action! ↕️

// Magnitude can handle high-level tasks await agent . act ( 'Create a task' , { // Optionally pass data that the agent will use where appropriate data : { title : 'Use Magnitude' , description : 'Run "npx create-magnitude-app" and follow the instructions' , } , } ) ; // It can also handle low-level actions await agent . act ( 'Drag "Use Magnitude" to the top of the in progress column' ) ; // Intelligently extract data based on the DOM content matching a provided zod schema const tasks = await agent . extract ( 'List in progress tasks' , z . array ( z . object ( { title : z . string ( ) , description : z . string ( ) , // Agent can extract existing data or new insights difficulty : z . number ( ) . describe ( 'Rate the difficulty between 1-5' ) } ) ) , ) ;

Get started

... continue reading