How we perceive - a review of the art

Natalie Angier, while reporting on a science conference, provides a fascinating state of the art summary of visual perception.

We are again reminded that we live in our heads, and that the film that plays in there has only a loose connection to what's going on around us ...

Change Blindness - Natalie Angier - New York Times

.... Visual attentiveness is born of limited resources. “The basic problem is that far more information lands on your eyes than you can possibly analyze and still end up with a reasonable sized brain,” Dr. Wolfe said. Hence, the brain has evolved mechanisms for combating data overload, allowing large rivers of data to pass along optical and cortical corridors almost entirely unassimilated, and peeling off selected data for a close, careful view. In deciding what to focus on, the brain essentially shines a spotlight from place to place, a rapid, sweeping search that takes in maybe 30 or 40 objects per second, the survey accompanied by a multitude of body movements of which we are barely aware: the darting of the eyes, the constant tiny twists of the torso and neck. We scan and sweep and perfunctorily police, until something sticks out and brings our bouncing cones to a halt.

The mechanisms that succeed in seizing our sightline fall into two basic classes: bottom up and top down. Bottom-up attentiveness originates with the stimulus, with something in our visual field that is the optical equivalent of a shout: a wildly waving hand, a bright red object against a green field. Bottom-up stimuli seem to head straight for the brainstem and are almost impossible to ignore, said Nancy Kanwisher, a vision researcher at M.I.T., and thus they are popular in Internet ads.

Top-down attentiveness, by comparison, is a volitional act, the decision by the viewer that an item, even in the absence of flapping parts or strobe lights, is nonetheless a sight to behold. When you are looking for a specific object — say, your black suitcase on a moving baggage carousel occupied largely by black suitcases — you apply a top-down approach, the bouncing searchlights configured to specific parameters, like a smallish, scuffed black suitcase with one broken wheel. Volitional attentiveness is much trickier to study than is a simple response to a stimulus, yet scientists have made progress through improved brain-scanning technology and the ability to measure the firing patterns of specific neurons or the synchronized firing of clusters of brain cells.

Recent studies with both macaques and humans indicate that attentiveness crackles through the brain along vast, multifocal, transcortical loops, leaping to life in regions at the back of the brain, in the primary visual cortex that engages with the world, proceeding forward into frontal lobes where higher cognitive analysis occurs, and then doubling back to the primary visual centers. En route, the initial signal is amplified, italicized and annotated, and so persuasively that the boosted signal seems to emanate from the object itself. The enhancer effect explains why, if you’ve ever looked at a crowd photo and had somebody point out the face of, say, a young Franklin Roosevelt or George Clooney in the throng, the celebrity’s image will leap out at you thereafter as though lighted from behind.

Whether lured into attentiveness by a bottom-up or top-down mechanism, scientists said, the results of change blindness studies and other experiments strongly suggest that the visual system can focus on only one or very few objects at a time, and that anything lying outside a given moment’s cone of interest gets short shrift. The brain, it seems, is a master at filling gaps and making do, of compiling a cohesive portrait of reality based on a flickering view.

“Our spotlight of attention is grabbing objects at such a fast rate that introspectively it feels like you’re recognizing many things at once,” Dr. Wolfe said. “But the reality is that you are only accurately representing the state of one or a few objects at any given moment.” As for the rest of our visual experience, he said, it has been aptly called “a grand illusion.” Sit back, relax and enjoy the movie called You.

This evening my son was using a Flip Video camera to record the midst of a chaotic bout of present opening. I happened to play it back about an hour after the event, so I still had some memory of what I perceived. The video showed there was much more going on than I took in, including my oldest son reading a letter included in his brother's gift.

Truly, there are vast rivers of reality going by, we live on a few sips and a lot of extrapolation. It is a miracle, given the imaginary worlds in which we live, that we are able to communicate at all.