Skip to content
ChalkJoin the waitlist

A Mac screenshot tool for you and your AI agent

Mark the screen. Your agent reads every mark.

Box a button, pin a field, say what is wrong, press ⌘↩. Your agent gets the picture and each mark as data: your words, where you pointed, and the app, page and exact button under it. No more guessing at pixels.

Used only to tell you when Chalk is ready.

  • Native Mac app
  • Works with Claude Code over MCP
  • No account, no cloud
  • Every mark as JSON

An animated illustration. A Safari checkout page is captured with Chalk. A red box goes round the Place order button with the comment “Button label is cut off at this width”, a red arrow points at the $74.00 total with “Total leaves out the $10 shipping”, and a numbered pin marks the coupon field with “Pressing Enter here does nothing”. After Copy for agent, the agent receives each mark with the button, text or field under it, and answers by naming all three.

An illustration, not a screenshot. The marks match the example marks.json further down.

both ways

You point things out to your agent. Your agent can ask you too.

Most screenshot tools stop at the picture. Chalk carries what the picture means, in both directions, so neither of you has to describe a screen in words.

You → your agent

You
mark it, ⌘↩
Chalk
marks as data
Your agent

Your agent → you

You
you answer
Chalk
marks + a question
Your agent

You show your agent

Copy for agent puts one item on the clipboard: the marked picture, the marks as JSON and a plain-text summary. Paste it into Claude Code or any agent chat. Or just say “look at what I just marked”: an agent connected over MCP fetches the newest shot itself.

  • Your words: the comment under each mark, word for word
  • Where you pointed: each mark's kind and position in the picture, numbered
  • Where it was: the app, the window title and the page URL
  • What it is: the button, field or text under each mark, from the Mac's accessibility tree
Pasted into your agent's chat

…/Chalk/shots/01JDA7Q3M8X4V2N6P9RTKZB5CE

1. box | "Button label is cut off at this width" | element: AXButton "Place order"

2. arrow | "Total leaves out the $10 shipping" | element: AXStaticText "$74.00"

3. pin | "Pressing Enter here does nothing" | element: AXTextField "Coupon code"

Your agent asks you

When an agent isn't sure, it sends a shot with its own numbered marks and a question. Chalk opens it in a review window without taking your keyboard, so whatever you were typing stays put. Reply to a mark, move it or draw your own, then choose an answer.

  • Who drew what is always clear. Agent marks are purple with a small sparkle, yours are red, and every comment names its author.
  • Answer with the mouse. Send to agent, Looks right or Dismiss. Each button shows its key.
  • Nothing piles up. At most three review windows open at once; the rest wait in Chalk's menu. A review nobody answers within 24 hours expires.
the agent gets back
{
  "state": "returned",
  "verdict": "changes",
  "diff": {
    "replies": {
      "01JD…": "The second one"
    },
    "added": [],
    "changed": [],
    "removed": []
  }
}

how it works

Capture, mark, hand it over. In one breath.

It feels like the Mac screenshot you already know: drag, let go. Every step works with the mouse alone, and every key is shown next to the button it drives.

  1. 1Capture

    Press ⇧⌘2 and the screen freezes. Drag over any app, press Space to pick a window, or ↩ for the whole screen. Let go and you are already editing.

  2. 2Mark

    Draw a box, an arrow, a highlight, a numbered pin, text or a redaction. A comment field opens under each mark: say what is wrong, in your words.

  3. 3Hand it to your agent

    Press ⌘↩ (Copy for agent) and paste into your agent's chat, or let your agent fetch it. A small thumbnail confirms it worked.

features

Everything you need to point. Nothing to learn.

  • Show exactly what you mean

    Six marks: box, arrow, highlight, numbered pin, text and redact. A comment field opens under each one. Pins are numbered in order, and the number on the picture is the number in the data.

    Area ⇧⌘2, window ⌥⇧⌘2 or whole screen ⌃⇧⌘2. Resize the selection by its handles. Save ⌘S also puts the marked picture where your Mac saves screenshots.

  • Your agent knows what it is looking at

    Chalk notes the app, the window title, the page URL and the element under each mark: the Place order button, not a guess at some pixels. A value it can't read is left empty with a reason, never guessed.

  • It reads the text in the picture

    On-device text recognition reads every shot. You can search by what was on screen, and agents get the text of the shot and the text under each mark.

  • Capture the whole page

    Press Scroll S and a selection grows into one tall picture of a long page, thread or list. Chalk scrolls by itself; scroll yourself at any time to take over. Up to 20,000 pixels, and it tells you why it stopped.

  • Find any shot again

    Open History with ⌃⇧⌘H and search by app, title, URL, your comments, replies and the text in the picture. Filter by time, app or who marked it, star what matters, then reopen a shot to edit it or copy it for your agent again.

Chalk keeps your newest 200 shots, up to 2 GB. Starred shots and open reviews are always kept. Shots agents create are kept apart, the newest 50, so they never push yours out. Older shots go to the Trash, never straight to deletion.

for developers and agents

A command line, an MCP server and a schema you can build on.

Agents capture, read, search and ask through the chalk command and chalk mcp, a local MCP server over stdio. Both talk to Chalk.app over a private local socket, so your terminal needs no screen permission of its own.

Add Chalk to Claude Code
$ claude mcp add chalk -- /path/to/chalk mcp
Or from a shell
$ chalk capture --window Safari --json
$ chalk latest --json
$ chalk marks <bundle>
$ chalk search "send quote" --json
$ chalk annotate marks.json --shot <id> --prompt "Which one?"
$ chalk await <review-id>

Errors are one JSON line on stderr with a stable exit code, so a script can tell a missing permission from a failed capture. chalk search reads the history index directly, so it works even when Chalk.app is closed.

  • 2 usage
  • 3 invalid marks
  • 4 permission
  • 5 capture
  • 6 write

Eight MCP tools

  • latestThe newest shot: app, window, URL, the full marks.json and the marked image.
  • getThe same for one shot, by id.
  • listRecent shots, newest first.
  • searchFinds shots by app, title, URL, comments, replies and the text in the picture.
  • captureTakes a new shot of the screen, a window or an area, through Chalk.
  • element_atThe accessibility element under a point on screen.
  • annotateShows the person a shot with the agent's marks and a question.
  • await_reviewWaits for the person's answer: replies, their marks and the verdict.
marks.json
{
  "schema": "marks/v0",
  "id": "01JDA7Q3M8X4V2N6P9RTKZB5CE",
  "created_at": "2026-11-17T10:42:08+05:30",
  "author": { "kind": "person", "name": "jags" },
  "image": { … },
  "capture": { … },
  "context": {
    "app": { "name": "Safari", "bundle_id": "com.apple.Safari", "pid": 812 },
    "window": { … },
    "url": "https://shop.example.com/checkout",
    "url_source": "ax-web-area"
  },
  "marks": [
    {
      "id": "01JDA7Q3M8X4V2N6P9RTKZB5D1",
      "n": 1,
      "kind": "box",
      "color": "#FF3B30",
      "geometry": { "rect": { "x": 1548, "y": 760, "width": 204, "height": 120 } },
      "anchor": { "x": 1650, "y": 820 },
      "comment": "Button label is cut off at this width",
      "element": {
        "role": "AXButton",
        "title": "Place order",
        "frame": { "x": 1564, "y": 776, "width": 172, "height": 88 },
        "path": [ … ]
      }
    },
    // … 2 more marks
  ]
}

What every mark carries

Where
Each mark's kind and geometry in image pixels, origin top left. n is the number drawn on the picture.
What you said
The comment you typed under the mark, word for word.
Where it was
context: the app, the window title and the page url, with where the URL came from.
What is under it
element: the accessibility element at the mark's anchor, with its role, title or value, frame and path.
Never a guess
A value Chalk could not read is null with a *_reason beside it, such as no-accessibility.

Newer data sits beside it in extra.json (marks-extra/v0): who drew each mark, your replies, the text read from the shot and the review's state. marks.json stays at v0, so a reader built for v0 keeps working.

privacy

Your screen stays on your Mac.

  • Nothing leaves the Mac

    No account, no cloud and no network code: a test fails if any is added. Your shots are folders on your disk.

  • You see every agent capture

    Chalk's menu-bar icon flashes and a notice says what the agent captured. Turn off Allow Agent Capture and agents can only read the shots you made.

  • Agent reviews on your terms

    Allow Agent Reviews turns them off. A review never takes your keyboard, at most ten wait at once, and one nobody answers within 24 hours expires.

  • Redact for real

    A redaction is burned into the saved pictures, and the text under it is dropped from the data and the recognised text too.

  • Private on disk

    Chalk's local socket and search index are readable only by your user account, and pictures an agent sends are deleted once the review holds them.

  • Permissions, explained

    Screen Recording to capture. Accessibility to read the element under a mark; without it Chalk still captures and each mark says why the element is missing.

questions

Questions, answered.

Can I try Chalk now?
Not yet. Chalk is in early, private use, and there is no public download. Join the waitlist and we'll write when you can try it on your Mac.
Which agents does it work with?
Any agent that speaks MCP, such as Claude Code, through chalk mcp. Without MCP, Copy for agent puts the picture, the marks as JSON and a plain-text summary on the clipboard, so you can paste into any agent chat.
Does it need an account or an internet connection?
No. Chalk has no account and no network code. Shots, marks and the search index stay in a folder on your Mac.
Can an agent look at my screen without me knowing?
No. Every capture an agent asks for flashes Chalk's menu-bar icon and shows a notice. One switch in the menu turns agent capture off, another turns agent reviews off.
Which apps and browsers does it read?
Chalk captures any app on screen and reads the element under each mark through the Mac's accessibility tree. It reads page URLs in Safari and in Chromium browsers such as Chrome, Brave, Arc and Edge. When a value can't be read, the data says why instead of guessing.
How do I hide a password or a customer's name?
Use the redact mark. It blacks out the pixels in both saved pictures and drops any text read from under it, including the window title or URL when it covers them.
What happens to old shots?
Chalk keeps your newest 200 shots, up to 2 GB. Star a shot to keep it for good. Older ones go to the Trash, where Finder's Put Back still works.
Is there a Windows or Linux version?
No. Chalk is a native Mac app, and only the Mac is planned.

be first to try it

Stop describing your screen. Mark it.

Chalk is in early, private use. Leave your email and we'll tell you when you can try it on your Mac.

Used only to tell you when Chalk is ready.