Skip to content
AI Field Notes

Entry 2026-04-02

Visual annotation beats text descriptions

Last verified 2026-07-22 · Primary source

Cursor 3 shipped Design Mode. Instead of typing "change the third button in the second card on the settings page," you click on the element.

Design Mode opens a browser panel inside Cursor showing your running app. Click any UI element — a button, a heading, a card — and annotate it with instructions. The agent receives the component tree path, computed styles, and surrounding context. You can draw directly on the preview to indicate layout changes or spacing adjustments.

In my use, pointing at the element has usually produced a better first attempt than describing its position in prose. That is an experience report, not a measured success rate; verify the resulting change against the rendered page.

This is the direction. Text descriptions of visual problems are lossy. Pointing at the thing and saying "fix this" is how humans communicate about UI. The tooling is catching up to the gesture.