The Lonely Lantern: On Tending Your Site's Most Isolated Pages

We talk a lot about the main thoroughfares of a website, the pages linked from the homepage and the primary navigation. These are the grand boulevards crawlers stroll down with confidence. But what about the quiet alleys and single-room cottages tucked away on your domain? The pages that, for one reason or another, have no other pages linking to them internally. They are the loneliest places in your digital territory, and they likely hold value you’re forgetting to signal.

Every site has them. An old press release uploaded directly to the server, a thank-you page after a form submission, a specialized tool accessible only via a direct link in a single email campaign. These are your orphaned pages. They exist, but without a single internal hyperlink pointing their way, they are functionally invisible to a crawler that relies on following links. They are like lanterns without fuel, waiting in the dark for a match that never comes.

The technique I want to suggest is simple, almost meditative. It’s not about complex scripts or expensive tools. It’s about creating a ritual of tending. Once a month, or at least every quarter, export a list of every URL your site has generated from your database or server logs. Then, using a simple crawling tool—many excellent, simple ones are available for free—map your site’s internal link structure. The goal is to perform a simple set difference: the list of all URLs minus the list of URLs that have at least one internal link pointing to them. The result is your orphan list.

A Tending, Not a Culling

Finding these pages isn’t an automatic signal to delete them. That’s the common, rash conclusion. Instead, view it as an act of tending. Hold each orphaned URL in your hand, so to speak, and ask two questions. First, does this page still have a purpose? Is it serving a visitor or representing a part of your work that should be found? If the answer is no, then yes, perhaps it’s time to let it go, to return that resource to the server. But if the answer is yes, then the second question is more important: where does this page belong?

This is the heart of the technique. You are now acting as a curator, deciding where in the existing structure of your site this idea, this tool, this piece of content, rightly lives. Could it be referenced naturally from a related blog post? Does it deserve a place in a ‘Resources’ section? Is it the perfect candidate for a ‘See Also’ link at the bottom of a more prominent page? This isn’t about forcing links; it’s about thoughtful integration.

By consciously re-integrating just a handful of these orphaned pages each time you perform this ritual, you accomplish something profound. You are not just improving crawl efficiency; you are enriching your site’s ecosystem. You are giving a crawler a reason to visit a page it would otherwise never know existed, and more importantly, you are creating pathways for your visitors to discover something valuable they didn’t know you offered. You are lighting the lanterns, one by one, ensuring no worthwhile part of your work remains in the dark.

Notes & further reading

A few pages I came back to while writing this: