color
By John K.··8 min read

Why you see colors that aren't there: afterimages explained

Stare at a red square, look at a white wall, and a green ghost floats into view. That green is not in the room. It is your own visual system telling on itself. Here is what an afterimage actually is, why it is always the opposite color, and what it reveals about how your eyes handle color in the first place.

Try this before you read any further. Find a saturated patch of color, a red app icon or a bright square on screen will do, and stare straight at it without moving your eyes for about twenty seconds. Then look at a plain white wall or a blank sheet of paper. A soft glowing shape will drift into view, and it will be the wrong color. Stare at red and you get a cyan-green ghost. Stare at blue and a yellowish one appears. The shape fades after a few seconds, and nothing about the wall has changed. The color was never out there. It came from inside your own eye.

That ghost has a name, the negative afterimage, and it is one of the most direct windows you have into how your visual system actually processes color. It is also quietly relevant to the whole premise of the Color Memory Game, because the same machinery that produces the afterimage is part of why a color you just saw is so slippery a second later. Worth understanding for its own sake, and useful once you do.

What an afterimage actually is

The everyday explanation you will hear is “your cones got tired,” and that is partly right but it undersells what is happening. Your retina has three types of cone cell, each most sensitive to roughly short, medium, or long wavelengths of light. When you fix your gaze on a strong red patch, the long-wavelength cones in that exact patch of retina fire hard and continuously, while their neighbors sit relatively idle. Hold that for long enough and the heavily used cones reduce their response. They adapt. This is the same thing your ears do when a loud constant hum stops seeming loud, or your nose does when you stop smelling your own house.

So far that only explains a dimming, not a color. The color comes from the next stage, and it is the part most explanations skip. When you then look at white, white light contains every wavelength equally, so it stimulates all three cone types at once. But in the adapted patch the long-wavelength cones are running at reduced gain while the others respond normally. The balance is tipped. Your brain reads that lopsided signal exactly the way it would read real light that was short on long wavelengths, and the perception it builds is the color opposite to the one you adapted to. The afterimage is not leftover red leaking out. It is the absence of red, read as its opposite.

Why the ghost is always the opposite color

This is where afterimages stop being a curiosity and start explaining something deeper. The reason the afterimage of red is specifically green, and never purple or orange, is that color does not travel to your brain as three independent cone signals. Before the information leaves the eye it gets rewired into opponent channels, and those channels are the real reason the ghost has the color it does.

The idea is old and it was a genuinely contrarian one when it appeared. In the nineteenth century the dominant view was that color was simply three primaries blended, the trichromatic theory, which is correct about the cones but stops there. Ewald Hering noticed something the three-primary picture could not explain: there is no such thing as a reddish green or a bluish yellow. You can imagine a bluish red, that is purple, and a greenish yellow, that is lime, but red and green seem to cancel rather than mix, and so do blue and yellow. Hering proposed that color vision is organized into opposing pairs, red against green, blue against yellow, and black against white, with each pair behaving like a single see-saw that can only tip one way at a time (Hering, 1920/1964).

For decades this sat awkwardly alongside the cone evidence, with each camp sure the other was wrong. The resolution, and it is one of the tidier stories in vision science, is that both are right at different stages. Leo Hurvich and Dorothea Jameson put numbers to Hering’s intuition in 1957, measuring exactly how much of one color it takes to cancel its opponent and showing the opponent channels were real, quantifiable signals rather than philosophy (Hurvich & Jameson, 1957). The modern textbook picture is that the three cones feed into these opponent channels just behind the retina: one channel computes roughly red minus green, another blue minus yellow, a third overall lightness. Your brain never sees raw cone values. It sees the see-saws.

Once you hold that picture, the afterimage falls out of it automatically. Staring at red drives the red-green see-saw hard to the red side, and it adapts there. Remove the red and the see-saw does not snap instantly back to center, it overshoots toward green, and green is what you see. The opposite color is not a coincidence. It is the only color the wiring can produce.

A quick way to predict any afterimage

Because the channels are fixed, you can predict the ghost of any color without staring at it. Find where the color sits on the two see-saws and flip both.

  • Red tips the red-green channel to red, so its afterimage is green (more precisely a cyan-green).
  • Blue tips the blue-yellow channel to blue, so its afterimage is yellow.
  • Yellow flips the same channel the other way, so its afterimage is a dim blue-violet.
  • Black and white are an opponent pair too, which is why a bright shape leaves a dark ghost and a dark shape leaves a bright one even when no color is involved.

Positive afterimages, and why most are negative

Not every afterimage is the opposite color. If you glance at a very bright light, a camera flash or the sun caught for an instant, the ghost that follows is briefly the same color, a glowing copy. That is a positive afterimage, and it comes from a different cause: the light-sensitive chemistry in your photoreceptors keeps responding for a moment after the light is gone, like a bell still ringing. Positive afterimages are short and tied to sudden intense light. The negative, opponent-color kind is the one you get from steady staring, and it is the one that tells you about the opponent channels, because it is built by adaptation rather than by leftover firing.

What this has to do with remembering colors

Here is the part that connects all of this back to the game, and it is genuinely useful to know. The opponent channels do not only produce afterimages. They constantly adapt to whatever you are looking at, which means your perception of a color is always relative to what your eye has recently been soaked in. Stare at a target color to “burn it in” before it disappears and you are doing the opposite of helping yourself. You are adapting the very channels you need to stay neutral, shifting your own baseline, and the longer you stare the more the color you are trying to memorize starts to drift in your perception even while it is still on screen.

This is one reason a quick, relaxed look at a color often serves you better than a hard stare, a point we get into more in train your eye for color. It also sits next to the deeper problem we wrote about in the science of color memory: even with a perfectly neutral eye, the jump from seeing a color to holding it in memory loses most of the precision. Adaptation just adds a second layer of slip on top of the first. You can see millions of colors, as we covered in how many colors can you see, but the ones you actually keep are filtered through a system that is busy recalibrating itself the entire time.

There is a neat historical loop here too. The same Ewald Hering who gave us opponent-process theory also described memory colors, the way a familiar object seems to carry its remembered hue even under odd lighting. The man who explained why you see a color that is not there also explained why you sometimes fail to see the color that is. Both are the same lesson from two directions: what reaches your awareness is a heavily processed construction, not a readout of the light.

Why we score the way we do, given all this

Adaptation and afterimages are also a quiet argument for why a fair color game cannot score guesses by raw numerical distance. Your sense of how far apart two colors are depends on the state your visual system is in and on where in the color space the two colors sit, not on the arithmetic gap between their values. Two colors a small numeric step apart can look identical in one region and clearly different in another. That is exactly why every guess on this site is judged with a perceptual difference formula built to track human ranking rather than coordinates, which we break down in what is CIEDE2000. The opponent channels are the reason perception is not linear, and a scoring system has to respect that or it punishes you for things your eyes were never built to do.

Go make a ghost on purpose

The best way to feel any of this is to trigger it deliberately and watch it happen. Stare at a strong color, look away, and you have just driven an opponent channel into adaptation and watched it rebound. Then notice that the same system you just caught misbehaving is the one you rely on every time you try to match or recall a shade. Play a single color in the daily challenge, or string a few together in solo, and pay attention to how a color you saw with perfect clarity slides out of reach the moment it is gone. The ghost on the wall and the gap in your memory are closer relatives than they look.