YapSketch

Show your agent
what you mean

Some things are faster to show than to type. Talk, draw on your screen, and paste the result into any agent.

Powered by Jev from TypeSafe
Talk, draw, and point at your screen While talking, the pen circles a card's off-centre text (marker 1), draws around a card that doesn't match the others (marker 2), and draws an arrow at a small button (marker 3). YapSketch copies the words with a picture for each marker. Fri 9:41 localhost:3000 Studio Overview Projects Team New project S Good morning, Sam Here’s what’s happening in your studio. Projects 12 active · 3 due this week Activity Team 5 members

Pasted into your agent

As you can see here these are not centered properly [1] and this one should match it [2]. Also make this button bigger [3]

1 2 3

Features

Show it once. Say it once.

Draw right on your screen

Press ⌃⌥D, or hold ⌃⌥ and drag. Circle it, box it, point an arrow at it.

fn

Or just dictate

Hold fn, speak, let go. Your words land wherever you’re typing.

As you can see these aren’t centered [1] and make this button bigger [2]

…/shots/1.jpg
…/shots/2.jpg

Paste into any coding agent

Anything with a prompt box. Agents can open the whole recording with the yapsketch command.

1 2 3

A picture for every point

Each mark gets a number in your words and one clear picture. Nothing extra.

On your MacPrivate, free, works offline ✓
In the cloudOpperTypeSafeOpenRouter

Local or cloud, your call

Speech is turned into text on your Mac by default. Prefer a cloud model? Use Opper, TypeSafe or OpenRouter.

SupabaseTailwind umuhlike

Knows your words

Teach it names and jargon. Fillers like “um” are tidied away.

Fri 9:41
Start recording ⌃⌥R Dictate fn Settings…

Lives in your menu bar

A small native Mac app. Start from anywhere, stop when you’re done.

How it works

No magic. Here’s what happens.

  1. 00:03
    1

    You record

    Press ⌃⌥R. YapSketch records your screen and your voice, on your Mac.

  2. 2

    You talk and mark

    Say what you mean, the way you’d tell a colleague. Circle, box or point at what you’re talking about.

  3. 3

    It lines things up

    Your speech becomes text. Jev matches each thing you said to what you marked and picks the clearest moment for its picture.

  4. ⌘V
    4

    You paste

    Your words with [1], [2] and a picture for each are on your clipboard. Paste them into your agent.

Recordings stay in ~/Movies/YapSketch. Words and pictures only leave your Mac if you turn on Jev or a cloud speech model, and then only to the provider you picked.

For your agent

There’s a CLI too.

The paste is the short version. The yapsketch command, installed with the app, gives your agent the rest: when you said each thing, what you drew and on which page, the full video and the transcript.

yapsketch latest
the newest recording
yapsketch show je89
its full report, moment by moment
yapsketch list
recent recordings and their ids
yapsketch path je89
the folder: video, transcript, every event
studio — zsh — 80×24

~/code/studio ❯ yapsketch show je89

Recording je89 (folder: ~/Movies/YapSketch/…01-13-36)

 

# Screen recording · 18 Oct 2026 at 01:13 · 00:15

Google Chrome — Studio (`http://localhost:3000/`)

 

…a section that covers the CLI, so the agent can get the video and look closer [1]

 

**[1]** 00:04.4 · 1 drew a red box

![1](~/Movies/YapSketch/…01-13-36/shots/1.jpg)

 

Full video: `recording.mp4`; raw data: `events.jsonl`.

~/code/studio ❯