The Scrivener's Nib: On the Ink That Makes a Thing Real
It was a Thursday, or maybe a Tuesday, during that long, low stretch of the year when summer’s momentum has finally bled out. I was clicking through the backend of a small site I tend, one of those pet projects that grows moss in the corners. The task was simple: I had to formally delete a handful of pages. They were old event listings, announcements for things that had happened and faded years ago. They hadn’t been linked to from anywhere in ages. By any rational measure—by the logic of the ‘crawl budget’ and the ‘sitemap protocol’—they were ghosts already.
And yet, there they were. In the sitemap. The little XML file I dutifully generated and submitted, a perfect, orderly ledger of everything I believed to be worthy of a search engine’s attention, still faithfully listed them. I had been updating this file for years, adding new entries with a curator’s care, but I’d never scrubbed the dead ones out. They were officially invited to a party that had long since ended.
My cursor hovered over the ‘remove’ button. It felt like a different kind of deletion. Not the technical ‘404’ or the server-side ‘rm -rf’, but something more profound: a revocation of citizenship. As long as their address was in that sitemap, they had a passport. They existed in the diplomatic pouch sent to the search engine’s headquarters. They were, in the cold calculus of discovery, meant to be found. Removing them wasn’t just cleaning up; it was admitting that their time for being found had passed.
We talk about pages being discovered by crawlers following links, which feels organic, like paths worn by footsteps. But the sitemap is different. It’s a declaration. It’s the scrivener’s ink on the vellum, stating for the record: This is a thing that is. That Thursday (or Tuesday), I realized my sitemap was less a map and more a registry of intent. In my negligence, my intent had become muddled. I was asking the crawler to witness ghosts, to spend its finite attention on echoes, thereby quietly diluting the signal for the pages that actually held breath and pulse.
The Weight of the Official Record
I clicked the button. The entries vanished from the list. The act felt less like destruction and more like a quiet, respectful burial. I wasn’t killing the pages; I was finally acknowledging their death to the systems that mattered. I was stopping the invitation from being sent.
It made me think of all the ways we make things ‘real’ for the digital eye. A page can exist on a server, but until it is linked to, or until its name is etched into the sitemap’s scroll, it lives in a kind of limbo. The crawler may stumble upon it, but it is not expected. The sitemap is the expectation. It is the formal summons. And with that formality comes a responsibility we often outsource to plugins and automated generators—the responsibility of the archivist, who must know not only what to add, but what to let go.
Now, when I update that file, I think of it as dipping the nib. The ink is the invitation. And I am more careful about who, and what, gets invited to the feast of attention. Because in the end, a crawler is just a diligent clerk, reading the ledgers we keep. We must ensure our ledgers tell a true story, not an old, cluttered one full of polite fictions about pages that no longer wish to be found.
Notes & further reading
A few pages I came back to while writing this:
- Saint Paul, MN
- The Silence Between Steps: On What the Crawler Chooses Not to Hear
- Springfield, MO
- The Beekeeper's Path: On the Wisdom of the Waggle Dance
- St Louis, MO
- The Glassblower's Furnace: On the Tempering of New Pages
- Jackson, MS
- Cary, NC
- Charlotte, NC
- Fayetteville, NC
- Greensboro, NC
- Raleigh, NC
- Lincoln, NE