What Is the AI-Enabled Pointer?
DeepMind’s new pointer system replaces text-heavy AI prompts with simple pointing gestures and voice commands. The AI understands visual and semantic context around the cursor — it knows whether you’re pointing at a word, a paragraph, part of an image, or a code block. This transforms pixels into structured entities (dates, places, objects) that users can interact with instantly.
How Does the AI Cursor Work in Practice?
The system operates on four key principles:
- Works across all apps — no need to switch to an “AI mode” or separate tool
- Understands context — a photo of a scribbled note becomes an interactive to-do list
- Accepts natural shorthand — say “fix this” or “compare these” instead of writing paragraphs
- Runs wherever you are — available in Chrome, PDFs, tables, recipes, and more
What Products Will Get the AI Pointer?
Google is integrating these capabilities into Chrome and the new Googlebook laptop experience starting today. Users can select products on a page and ask to compare them, or point to where they want to visualize a new couch. The “Magic Pointer” feature will roll out in Googlebook soon, with further testing across Google Labs’ Disco platform.