The Librarian's Unopened Book: On the Pages We Choose to Bind

I once spent three months building a digital archive for a local historical society. It was a labour of love, a meticulous process of scanning brittle photographs, transcribing handwritten letters from the 1890s, and crafting elegant, informative pages for each artifact. I was proud of it. The sitemap was a perfect, gleaming index of every single item, and I submitted it with the quiet confidence of a librarian who has catalogued every last volume.

Weeks later, I was showing the site to the society’s president, a wonderfully sharp woman in her eighties. With a few deft clicks, she navigated to a page I hadn’t built. It was a simple, unstyled text file I’d hastily created months prior—a raw, unformatted list of donor names and contribution amounts for an internal audit. I’d forgotten it existed. Yet there it was, sitting proudly in the third position on a site search for ‘historical records’, while our beautiful, painstakingly curated exhibit on the town’s founding sat pages back.

In that moment, I wasn't a developer or a strategist; I was a gardener watching a weed I’d unknowingly planted choke out a prized rose. The crawler, ever the dutiful but literal-minded assistant, had found my sitemap and indexed everything within it with equal, unthinking fervour. It had no way of knowing that one page was a treasure and the other was a scrap of administrative scratch paper. Its job was to bind every single book in the library, with no regard for the content within the covers.

This is the subtle weight of the sitemap we so often forget. It is not merely a list of addresses; it is a statement of priority, a collection of everything we have deemed worthy of a visitor’s time. By including that donor list, I had, in the eyes of the crawl, voted for its importance. I had asked for it to be discovered, to be considered, to be ranked. I had bound a ledger into the same collection as a first-edition novel.

The lesson wasn’t about exclusion, but about conscious inclusion. The power of a sitemap is profound—it is an invitation. And every invitation you extend, whether to a gala ball or a quick coffee, signals an intention. Now, before I compile that XML file, I take a moment to review its contents not as a developer, but as that librarian. I ask myself for every URL: is this a book I want to prominently place on the shelf? Does it deserve the invitation? It’s a small, quiet act of curation, but it’s the difference between a library and a mere collection of paper.

Notes & further reading

A few pages I came back to while writing this: