What is analytics debt and how do I know if I have it?
Analytics debt: the short answer
Analytics debt is the cost of every shortcut and inconsistency in your tracking, and it grows as you scale. Sloppy event names don't matter at 500 users but can skew a funnel by 15 to 20% at 50,000. The test: ask five people for your activation rate. Five different answers means you have it.
Analytics debt, in detail
Analytics debt is the accumulated cost of every shortcut, inconsistency, and missing data point in your analytics setup that makes it harder to make good decisions as you scale.
It compounds silently. At 500 users, event naming inconsistencies don't matter. At 50,000 users, that same sloppiness means your conversion funnel is wrong by 15-20%, and you've been making product decisions on bad data for months.
The fastest way to diagnose it: ask five people on your team these questions-what's your activation rate, weekly retention at 4 weeks, best acquisition channel, and percentage of users hitting core value in their first session? If you get five different answers to any of them, or if nobody can explain why their number is right, you have material analytics debt. Another red flag: if a new hire can't understand your data within 20 minutes, you don't have an analytics setup-you have a liability.
Most founders think they're in the "patchwork" stage of debt accumulation. They're usually already in the "dashboard graveyard" stage, where dashboards exist but nobody trusts them because everyone's pulling different numbers.
Analytics debt: where this answer comes from
Analytics debt: further reading
Other questions Ansh has answered
This is one of a handful of questions I've answered in advance. Ask me your own