Skip to content
Tech News
← Back to articles

Raycast adds a new way to ask AI about whatever is on your screen

read original more articles
Why This Matters

Raycast's new Screen Awareness feature enhances AI interactions by providing direct access to the content and context of the active window or app, streamlining workflows for users. This innovation reduces the need for manual copying, pasting, or explaining, making AI assistance more efficient and integrated into daily tasks. It signifies a step forward in making AI tools more context-aware and user-friendly for both developers and consumers.

Key Takeaways

Raycast has a new feature called Screen Awareness, which lets users bring context from their active app or window directly into AI Chat. Here are the details.

Raycast AI can now work with what’s on your screen

Depending on how you use AI chatbots such as ChatGPT, Claude, or Raycast AI, there is a good chance you have to keep copying and pasting text, uploading screenshots, or explaining the context of what you are working on before asking for help.

Raycast was recently updated with a feature that is intended to streamline this workflow, giving Raycast AI direct access to the content of the focused window.

The feature, called Screen Awareness, “brings context from your focused app or window into AI Chat or Quick AI, so you don’t have to copy text, attach screenshots, or explain what you’re looking at,” says Raycast.

Use the Send Focused Window to AI command, choose Screen Awareness from the @ menu, or simply ask “summarise this” or “reply to this”.

When activated, the context sent to Raycast AI can include app and window details, selected text, the focused control, and a screenshot of the focused window.

On the Mac, it can also provide information about selected files or folders when triggered from Finder, while Raycast’s Browser Companion lets it pull in webpage details and content beyond what is currently visible onscreen.

According to the company, users can set up a hotkey to trigger Screen Awareness through a short onboarding guide that appears the first time they use the command. Raycast says its team “likes to double-tap the right Command key.” Users can also set up keyboard shortcuts for related commands such as Send Selected Text to AI, Send Screen Area to AI, and Send Screen to AI.

Here’s the feature in action:

... continue reading