← Build log

🤖 When "Magic" Breaks Trust: A Product Manager’s Guide to Agent UX

Published on VoiceCatcher.io
By a solo builder & technical product manager who listens, thinks, and builds.


🧠 The Spark: Can We Paste Just by Hovering?

I was using my Mac like I always do — scrolling through a window without clicking it — and I wondered:

“What if VoiceCatcher could paste my transcript into any app just by hovering over it?”

The idea felt magical. Invisible. Intuitive.
But as a product manager, I’ve learned to interrogate “magic.”

So I brought it to my co-pilot: AI.


🤝 A Conversation Worth Having

Through a back-and-forth with GPT-4o, we broke the idea down across three dimensions:

✅ Feasibility

Yes, technically you can detect the app under your mouse.
No, macOS won’t reliably let you paste into a text field without focus — and even when it does, not all apps behave the same.

🧠 UX Risk

Here’s the catch: if it sometimes works, and sometimes doesn’t…
Users won’t blame macOS. They’ll blame VoiceCatcher.

As the AI put it:

“Perception is reality — and inconsistency is a trust killer.”

🔐 Control vs Convenience

People trust apps that do exactly what they expect.
They abandon apps that feel unpredictable — even if they’re “smart.”


🧭 What We Decided To Build Instead

We outlined a 4-phase roadmap that balances innovation with user control:

Phase 1: Simple Hotkey

Cmd+Shift+V pastes your most recent transcription into the focused app.
If no text field is focused, we show a clear message.

Phase 2: “Copy This To…” Menu

Users can choose where to send the text — Notion, Notes, etc.
Always explicit. Always user-driven.

Phase 3: Agent Suggestions

The agent can ask:

“Want me to send that to Apple Notes?”
Users must confirm.

Phase 4: Agent Actions

Only when the agent is predictable and proven, it’ll perform those actions for you.


🧠 Why This Matters

This wasn’t just about a feature.
It was about learning to trust your instincts, but test them through dialogue.

As a solo builder, I use AI not just to write code — but to refine my thinking.

I bring the product vision.
AI brings the edge-case counterpoints.
Together, we ship something real.


✍️ What You Can Learn From This

  • Don’t chase magic until you can guarantee clarity
  • Use AI as a co-strategist, not just a code tool
  • Always ask: “What happens when this fails?”

🚀 Want More?

I’ve documented the entire VoiceCatcher build process in over 30 blog posts.
Check them out at voicecatcher.io/blog — or follow along as I turn a solo idea into a product people trust.