Premise
When someone teaches us something, we don’t always need the answer shipped into us. We want to think it through ourselves, while someone who’s watching guides us there. Hand over the answer too early and the guiding stops being teaching — it becomes dictation.
Teaching is Clicky’s strongest use case. Teaching means guidance. Guidance means correction.
Hey Clicky explores how an AI teaching assistant can correct user mistakes subtly—without taking over agency or interrupting the flow of active learning.
Finding the Dots
Two fundamental insights shaped the system architecture:
- Two-Layer Reasoning: Perception happens first (coupling user action with object context to infer intent), before any verbal or visual response decision is made.
- Clarification vs. Guidance: Clarification is taskless (no ongoing state), while Guidance is task-full (requiring real-time state tracking against user screen state).
Connecting the Dots
Four core interaction mechanisms follow from the architectural discoveries:
- Automation as Branch Unchanged: Preserving full manual execution paths.
- Subtle Correction: Multi-channel ambient feedback through position (Step Tracker red indicator) and state (Eye gesture shake).
- Recovery Keeps Agency: Allowing users to redo steps or query the prompt bar without forcing automated overrides.
- Shared Attention: Directing gaze and visual pointers (
[POINT:…]tags) so user and AI attend to the same spatial context.