Tech●●●●●Difficulty 3 of 5

How does a network of fake neurons learn to recognise a cat?

In 1958 the New York Times called a learning machine 'the embryo' of a computer that would walk, talk and be conscious. Its descendants now write and draw.

▶ Start the story

A neural network learns to recognise a cat by adjusting a great many numbers, called weights, until its answers stop being wrong. It is a computer model loosely inspired by the brain: artificial neurons pass numbers to one another along connections, and each connection has a weight that sets how strongly one neuron's signal counts for the next. Signals flow from an input layer, through hidden layers, to an output layer. Training means nudging the weights so the output gets closer to the right answer.

The idea is old. In 1958 the psychologist Frank Rosenblatt described the perceptron, one of the first neural networks ever built, with funding from the US Navy. Its machine version, the Mark I Perceptron, looked at the world through 400 light sensors, and electric motors turned knobs to adjust its weights as it learned. After a Navy press conference, The New York Times called it the embryo of a computer that would walk, talk, see and be conscious of its existence.

Diagram of a small neural network: a column of input circles on the left, a hidden column in the middle and output circles on the right, every circle connected by arrows to the next column.
Signals flow from the input layer, through a hidden layer, to the output layer. Each arrow carries a weight, and learning means adjusting those weights.Photo: Glosser.ca · CC BY-SA 3.0

Reality was humbler. Early networks with a single layer could only solve simple problems, and a 1969 book by Marvin Minsky and Seymour Papert cooled interest for years. The revival came in the 1980s with backpropagation, a way to share out blame for each error backwards through many layers. With graphics chips and huge datasets, networks then took off: in 2012 one learned to recognise cats from unlabelled images alone. Today they power chatbots, image generators and robots.

Black-and-white photo of the Mark I Perceptron: tall cabinets of wiring and panels, with a camera on a tripod in front, labelled parts such as camera, plugboard and association units.
The Mark I Perceptron, from its 1960 operators' manual: a machine built for image recognition, whose motors turned knobs to store what it learned.Photo: John C. Hay, Albert E. Murray · Public domain

Quiz me

0/3

  1. 1.What actually changes when a neural network learns?
  2. 2.Why did backpropagation revive interest in neural networks in the 1980s?
  3. 3.What limitation of early single-layer perceptrons did Minsky and Papert highlight in 1969?

Recap

A neural network learns by nudging its weights to shrink its errors, layer by layer.

Surprising fact · In 1958 The New York Times reported the perceptron as the embryo of a computer that would one day be conscious of its existence.

Sources (2)

No source, no claim. Every fact in this lesson (21 claims) cites at least one of these.

  1. [1]Neural network (machine learning) · Wikipedia
  2. [2]Perceptron · Wikipedia
More lessons in 💻 Tech (3) See all tech lessons →

One more light on your map.

Get one lesson like this every day, about the things you love. Free, in two or five minutes.

Get the share card for this lesson ↗