Projects

ScreenTracker

Always-on AI that observes how you use your computer, and nudges when required

Built
October–December 2025; used through April 2026

I sometimes open social media for something, then forget why I opened it, spend the next 10 minutes scrolling, close it and wonder wtf I opened it for.

So I built an AI that regularly takes a screenshot of my laptop, then decides what I'm doing. Just silently works in the background.

After every screenshot, it takes a note of what I was doing. At the end of the day, all the notes are run through an LLM which summarizes how the day went - what I did, what I should be called out on.

If I didn't touch the keyboard or mouse for 2 minutes, it took a photo through my webcam to check if I was still there - reading or watching something, or on my phone and gone.

It ran on my laptop for six months - a screenshot every 20 seconds, 88,167 notes, about $15 a month.

Every night it wrote me a recap. One from November 4th:

You shipped something and immediately started looking for the next thing.

Then you found it: BJ Fogg's “Persuasive Technology” from 2002. You spent the next 3-4 hours in a state I can only call intellectual flow - reading the book, taking notes, consulting Claude about messaging, researching how Fogg's predictions played out in YouTube Shorts and ChatGPT and Duolingo.

I'm thinking about AI that is continually watching what you do - it'd be pretty cool if it can learn more about you as a person through that. Perhaps it notices the kind of music I listen to, or the kind of articles I read and suggests similar ones.

And this level of monitoring cost just $15 a month then. In 2027, it'd probably cost 50 cents a month. Which worries me. Because mass surveillance requires not merely capturing data but also understanding it. For the longest time, that was not practically feasible because of the manpower and costs involved. But it's now cheap and will only get cheaper. Which means society will need to take concrete steps to avoid this outcome.

One idea from back then stuck: before opening a site, ask me what I'm opening for. Nine months later, that became Gatekeeper.