The Librarian's Unspoken Rule: On the Shelving of the Unvisited
I remember the precise, musty smell of the university library’s sub-basement. It was a place of pure potential, a cavernous room where every metal shelf groaned under the weight of theses, dissertations, and academic journals that had never been checked out. My job, one summer during my undergrad, was to help ‘weed’ the collection. The senior librarian, a woman named Elara with glasses on a chain and an air of infinite patience, gave me a single instruction: “If a book hasn’t been touched in twenty years, pull it. We need the space.”
I’d pull a heavy, cloth-bound volume from the shelf, its spine cracking in protest. I’d check the index card tucked in the back pouch. More often than not, the only date stamped on that yellowing card was the day it was accessioned, decades prior. No due dates. No eager hands. It had been discovered once, by a cataloguer, given a number, and placed neatly in its assigned location. And there it had sat, in perfect order, waiting for a patron who never came. It was a perfect, self-contained idea that the world had simply passed by.
I think of that basement often when I consider how search engines discover and shelve pages. We fret over sitemaps and crawl budgets, imagining a hyper-efficient digital librarian meticulously scanning every single volume we publish. But that’s not quite it. The discovery is just the first step. The real question is what happens after.
A page is crawled. Its content is indexed. It is given a digital call number and placed on an impossibly vast, virtual shelf. And then… it waits. The modern web’s equivalent of my stamping that index card isn’t just the initial crawl; it’s the subsequent silence. No clicks. No shares. No inbound links from other, more popular ‘books’ in the library. It just sits, a perfect, self-contained idea in a sub-basement of the index that users never browse.
Elara’s rule wasn’t cruel. It was practical. The library’s purpose was to be used, not just to store. Space—whether physical or in a crawl budget—is finite. Her weeding wasn’t a judgment on the quality of the ideas in those books, but a recognition of their relationship with the world. They had failed to spark a conversation.
Our websites are the same. We can obsess over making every page discoverable, ensuring the crawler can find its way into every corner. But discovery alone is just accessioning. It’s the first stamp on the card. The true measure of a page’s place isn’t that it was found, but that it is, eventually, visited. Without that, it’s just another volume in the silent, endless stacks, patiently awaiting its own quiet weeding.
Notes & further reading
A few pages I came back to while writing this: