VoiceInk Context Awareness: what it reads from your Mac, and where that text goes

Context Awareness lets a VoiceInk Mode give its AI model more than your words. It can add the text you have selected, the text on your clipboard, and text read off your screen, so a reply matches the email you are answering or a name comes out spelled the way it is on screen. It only works with AI Enhancement, and the text it adds goes to whichever AI provider that Mode uses. That second part is worth reading before you turn it on.

I built YapToText, a different dictation app for the Mac, so read what I say about VoiceInk with that in mind. Every fact about VoiceInk here comes from its own docs, read on October 10, 2026.

Download YapToText on the Mac App StoreThis app is completely free. You don't have to make an account. There are no subscriptions, no difficult downloads, and nothing is locked. Made for Apple silicon Macs. Source on GitHub.

The three sources

From VoiceInk's docs, Context Awareness, read October 10, 2026. Without a permission, that source is skipped.

SourceHow VoiceInk gets itPermission
Selected TextReads the current selection through macOS AccessibilityAccessibility
ClipboardReads the text on the clipboard when recording startsNone extra
ScreenCaptures the active window and reads its text with OCR, on the MacScreen Recording

Turning it on for a Mode

  1. Open Modes.
  2. Edit a Mode that has AI Enhancement on.
  3. Expand Context Awareness.
  4. Turn on Selected Text, Clipboard or Screen.
  5. Save the Mode.

In a custom prompt you can point at each source with a tag: <CURRENTLY_SELECTED_TEXT>, <CLIPBOARD_CONTEXT> and <CURRENT_WINDOW_CONTEXT>. The docs suggest uses such as rewriting a selection by speaking an instruction, or drafting a reply to a selected email thread.

What gets sent, and to whom

  • To the AI provider. The context goes with the AI Enhancement request, to the provider and model that Mode uses. Local transcription does not make cloud enhancement local.
  • Screen text, not the picture. OCR runs on the Mac with Apple's Vision framework, and the extracted text is what is sent, not the screenshot.
  • A snapshot is still taken. At the start of a live recording VoiceInk prepares a context snapshot in memory. The switches decide what is included in the request, not whether VoiceInk reads it locally.
  • Saved in History. The AI request saved in History can contain the context text that was sent.
  • Not for every Mode. Modes without enhancement send no context. VoiceInk Refine ignores it, and imported files capture none.

When to leave it off

VoiceInk's own advice is to turn on only the sources a task needs and to think about which provider will receive the text. A Screen source in a Mode that runs in your mail app sends the visible text of whatever email is open. If that matters, keep context on in one Mode for one app, and leave your everyday Mode without it. The VoiceInk privacy page covers its providers, and the Modes page covers how a Mode is picked per app.

How YapToText handles context

VoiceInk from its docs, read October 10, 2026. YapToText from its own settings and source.

VoiceInkYapToText
Selected textYes, through AccessibilityYes
ClipboardYesYes
The app you are inThrough Mode matchingYes, and Auto mode leans by app, such as Email in Mail
Screen text by OCRYes, with Screen RecordingNo. It does not capture the screen
Where the AI runsThe Mode's provider, local or cloudOn the Mac

Each YapToText mode has its own switches for context from the app, your selection and your clipboard, and its cleanup model runs on your Mac, so that text is not sent to an AI provider. It cannot read what is on screen beyond that, which is a real limit if you wanted replies drafted from a window you have not selected. The modes help page covers the switches.

Download YapToText on the Mac App StoreThis app is completely free. You don't have to make an account. There are no subscriptions, no difficult downloads, and nothing is locked. Made for Apple silicon Macs. Source on GitHub.

The short version

  • What it is. Extra text sent to the AI with a dictation.
  • Sources. Selected text, clipboard, screen text by OCR.
  • Needs. AI Enhancement on, plus Accessibility or Screen Recording.
  • Goes to. The Mode's AI provider, and it can be saved in History.
  • Advice. Only the sources a task needs.

If VoiceInk changes how Context Awareness works, open an issue on GitHub and I will update this page. Every one gets read.

Download YapToText on the Mac App StoreThis app is completely free. You don't have to make an account. There are no subscriptions, no difficult downloads, and nothing is locked. Made for Apple silicon Macs. Source on GitHub.

About the author. Ryleigh Newman is a developer whose hands make typing difficult and who dictates every day with YapToText, the app this site describes. Facts about other apps come from their own sites, with the date they were read. More about the project.

Sources

Questions

What does VoiceInk Context Awareness do?

It adds your selected text, clipboard text, or text read from the active window to the AI Enhancement request, so the AI can shape the output.

Does VoiceInk send screenshots to the AI?

No. It reads the window's text with OCR on the Mac and sends that text, not the image.

Why is VoiceInk screen context not working?

Screen context needs Screen Recording permission, and selected text needs Accessibility. Without them those sources are skipped. The Mode also needs AI Enhancement on.

Is VoiceInk Context Awareness private?

The context goes to the AI provider the Mode uses. With a cloud provider, that text leaves your Mac.

Does YapToText read my screen?

No. A mode can use the app you are in, your selection and your clipboard, and its cleanup runs on the Mac.