The Geometer's Ghost: How Euclid’s Elements Quietly Shape the Web We Crawl

It’s tempting to think of web crawling as a purely modern invention, a digital creature born from the tangled wilderness of the early internet. Its logic, however, has older, more orderly roots. If you trace the lineage of the hyperlink back far enough, past Vannevar Bush’s memex and Ted Nelson’s Xanadu, you eventually arrive at a figure who wouldn’t know a server rack from a scribe’s desk: Euclid of Alexandria.

Euclid’s Elements, a thirteen-volume treatise compiled around 300 BCE, is more than a math book; it is a monumental feat of information architecture. Its enduring power lies not just in the geometric truths it contains, but in the meticulous, step-by-step structure by which those truths are presented. Every proposition rests upon previous definitions, postulates, and proven propositions. You cannot understand the Pythagorean theorem without first understanding what a right angle is, and you cannot prove a complex theorem about circles without first establishing the properties of triangles. This is a web of knowledge, rigidly and deliberately linked.

This architecture is the silent forerunner to the modern sitemap. Euclid’s work has a single, elegant entry point: his five postulates. From these foundational ‘homepages,’ the reader is guided on a predetermined crawl path. Proposition 1 links to Common Notion 1 and Postulate 3. Proposition 2 then links to Proposition 1, and so on, creating a perfect, acyclic graph of dependencies. There are no orphaned pages in the Elements. Every piece of knowledge is discoverable from the start, and more importantly, no piece of knowledge is accessible before its prerequisites are established. The crawl budget is spent with perfect economy, building understanding in a logical sequence.

Of course, the modern web is anything but Euclidean. It is a messy, dynamic, and often chaotic graph. Pages link in loops, deep content lies buried without a single internal link, and new ‘propositions’ are added hourly without regard for the existing structure. A crawler’s job is to navigate this beautiful chaos, but its ideal, its platonic form, is arguably Euclid’s perfectly structured treatise.

The ghost of the geometer appears most clearly when we think about authority and trust. In the Elements, the authority of a later proposition is entirely derived from the axioms and the unbroken chain of logic that supports it. Similarly, a crawler’s understanding of a page’s importance is often built upon the quality and relevance of the links pointing to it—a kind of digital logic chain. A page with many links from highly ‘authoritative’ sources (like Euclid’s foundational postulates) is deemed more significant than an isolated page with no incoming links, no matter how brilliant its content might be in isolation.

We build our websites not in the orderly library of Alexandria, but in the bustling, sprawling digital metropolis. Yet, beneath the noise, the ancient impulse to create a logical, interconnected structure persists. The next time you sketch out a site’s information architecture or review a crawl report showing broken links, remember the ghost in the machine. We are still, in our own way, trying to build a web where everything is connected, where every page can be found, and where the path to discovery is as elegantly logical as a proof from the Elements.

Notes & further reading

A few pages I came back to while writing this: