How it came together Draft
From the Media Lab
PointerPals started with CheWei of CW&T while we were at the MIT Media Lab. Years later I came back to it, because I realized I could now make a really refined version of the idea as a native app.
A quieter kind of presence
Remote work flattened presence into a series of video calls and status dots. PointerPals is a quieter experiment: what if you could just see where your collaborators’ cursors were, right on your screen, without any meeting or notification?
The app renders remote cursors as a transparent, always-on-top overlay. They show up labeled with a name, move in real time at 30 frames per second, and fade after five seconds of inactivity. They don’t block anything. They don’t ask for attention. They’re just there, a peripheral signal that someone else is working too.
How it works
The architecture uses normalized coordinates so cursor positions translate correctly across different screen sizes. A WebSocket server running on Google Cloud handles the pub/sub layer. The macOS client is Swift and SwiftUI; a Windows client exists in C# and WPF for cross-platform pairs.
assets/media/pointerpals/process-1.webpPals, both ways
To add a pal, you swap Pointer IDs: copy yours, send it however you already talk, and paste theirs into Add a Pal. There are no accounts and no friend requests. While PointerPals is running, your cursor is shared with anyone who has your ID, so swapping IDs is what makes it mutual: you each see the other.
assets/media/pointerpals/process-5.webpA pal’s cursor is drawn at 75% of the size of your own, so you don’t get confused about which one is yours. You can turn pals down to 50% in Settings.
assets/media/pointerpals/process-6.webpTen days in January
The Mac app came together in about ten days, and some of the best changes were subtractions: fewer permission prompts, a smaller menu, and a welcome window instead of a string of alerts.
assets/media/pointerpals/process-3.webpCompany
It’s been installed on my computer ever since, and I always have CheWei’s cursor keeping me company while I work. Every so often our cursors dance: we circle each other rapidly, and it puts a big smile on my face. It’s only slightly confusing when I’m presenting to others.
assets/media/pointerpals/process-2.webpThe website
The website demonstrates the idea without any installation: two animated cursors trace paths across the page, showing exactly what the experience feels like before you download anything.
assets/media/pointerpals/process-4.webpThe name
The name came easily. They follow you around. They’re your pals.
