The Cartographer's Regret: On the Maps We Draw After the Journey is Over
There is a quiet, almost mournful tradition among some cartographers, particularly those who mapped by exploration rather than by decree. It is the practice of drawing the final, definitive map of a territory only after having returned from the journey itself. The map drawn in the comfort of a study, based on field notes and sketches, is always cleaner, more accurate, and more logically ordered than the one hastily scrawled by firelight. It is also, in a profound way, a lie.
This tradition has a direct and painful parallel in how we manage web discovery. We build a site, we pour our content into it, and we send it out into the world. The crawlers come, like unknown explorers, and they map our territory based on the paths we’ve left for them—a tangled network of internal links, a few signposts in the header, maybe a hastily drawn sitemap.xml left pinned to the door. They traverse the routes we built under the pressure of launch, not the ones we wish we had built in hindsight.
And then, only after we see their map—the search engine results, the indexed pages, the gaps where our most important content lies hidden—do we understand the territory we actually built. We see the dead-end alleys, the pages that require three turns to find, the magnificent plaza with no entrance. This is the cartographer's regret: the realization that the map we should have provided was the one drawn after the journey, not before.
The After-Action Map
A sitemap, in its ideal form, is not a blueprint. It is an after-action report. It is the clean, logical, hierarchical map we draw once we know the lay of the land. It is our chance to say to the crawler, "Ignore the confusing paths we accidentally built. Here is the true structure. Here is what matters." It is an act of correction, an admission that our initial architecture was merely a draft.
This is not an admission of failure, but of process. The web is not built in a vacuum; it is discovered through use. The most honest thing we can do is acknowledge that our first pass is a sketch, and that the real work of cartography begins once the explorers have returned and told us what they found. We listen to their findings—the crawl logs, the index coverage reports—and we use that intelligence to draw a better guide for the next expedition.
The regret is not in the initial imperfection, but in the refusal to redraw the map. To leave the crawler with only the tangled, firelit sketch is to abdicate our role as the territory's steward. The true act of discovery isn't just building the pages; it's learning how they are found, and then meticulously, humbly, drawing the map that should have existed all along.
Notes & further reading
A few pages I came back to while writing this: