Tech●●●●●Difficulty 1 of 5

How did people find anything on the web before Google?

The first search engine searched file names, not web pages, and it was built by a student who just wanted to find files faster.

β–Ά Start the story

Before Google, people found things on the internet in two ways: by browsing lists that humans had written by hand, or by using programs that collected names or words and let you look them up. The very first of these, Archie, appeared in 1990 and did not even search the web. It searched the names of files stored on servers. Over the next five years the tools got steadily better, first with hand-made directories like Yahoo's, then with robots that read every word of every page, like AltaVista.

Archie came from Alan Emtage, a at McGill University in Montreal. It gathered the file listings of public sites so you could search them in one place. It never looked inside the files, so you had to already know the title of what you wanted. Even so, at its peak it accounted for half of the Internet traffic in Montreal.

50%

of Montreal's Internet traffic went through Archie at its peak, though it only knew file names

Then came the web, and at first it was indexed by hand. Until September 1993 there was a single list of webservers, edited by Tim Berners-Lee and hosted at CERN. As more and more servers came online, one list could no longer keep up.

Two answers appeared in 1994 and 1995. Jerry Yang and David Filo, two Stanford graduate students, kept a human-edited organized as a hierarchy: that was Yahoo, and by 1998 it was the most popular starting point on the web. Others built robots instead. WebCrawler, from 1994, let you search for any word in any page. AltaVista, launched in December 1995, was the first searchable index of the web, and it drew more than 80 million hits a day by 1997.

Even that was not the end. In 2000, AltaVista was still used by more Internet users than Google. The rest of this path follows the machine route: how robots read the web, how an index finds a word in a blink, and how the results get sorted.

Quiz me

0/3

  1. 1.Why could Archie not find a file when you only knew what was inside it?
  2. 2.Why did the hand-edited list of web servers stop working in the early 1990s?
  3. 3.What made WebCrawler and AltaVista different from Yahoo's original directory?

Recap

Early search tried two routes, people writing lists and robots reading pages, and the robots could keep up.

πŸ’‘ A trick to remember it Β· A librarian's list, a robot's notes: one runs out of hands, the other can keep reading.

Surprising fact Β· In 2000, more people still used AltaVista than Google.

Sources (4)

No source, no claim. Every fact in this lesson (15 claims) cites at least one of these.

  1. [1]Archie (search engine) Β· Wikipedia
  2. [2]Web search engine Β· Wikipedia
  3. [3]Yahoo! Β· Wikipedia
  4. [4]AltaVista Β· Wikipedia
More lessons in πŸ’» Tech (3) See all tech lessons β†’

One more light on your map.

Get one lesson like this every day, about the things you love. Free, in two or five minutes.

Get the share card for this lesson β†—