"We don't have an algorithm for this"

[Image: Comet 67P, via ESA].

In the story of how European Space Agency researchers are scrambling to locate—and possibly move—the Philae probe, which they successfully landed on Comet 67P two days ago, there's an interesting comment about computer vision and the perception of exotic landscapes.

[Image: Comet 67P, via New Scientist].

"We're working our eyes off," one of the scientists says to New Scientist, describing how they are personally and individually poring over photographs of the comet.

"It's an entirely manual process," New Scientist continues, "because the complex and bizarre landscape of comet 67P defies any kind of automated search. 'We don't have an algorithm for this,' he says."

We don't have an algorithm for this.

[Image: The irregular terrain of Comet 67P, via ESA].

It would be interesting to develop a taxonomy of landscapes based on their recognizability to algorithms. This would tell you as much about how computers see the world as it would about the aesthetic assumptions—even the geological biases—of the people who programmed those computers.

Think, for example, of Adam Harvey's work, asking When Is An Apple No Longer An Apple? That project explored the point at which machine-learning algorithms could no longer distinguish the iconic fruit from a jumble of colorful objects.

Or take Harvey's more recent CV Dazzle experiment, which looked at how to prevent facial recognition software from identifying a face at all through the clever use of cosmetic camouflage.

However, in the case of Comet 67P and other extreme topographic environments, we would be looking at when a landscape is no longer a landscape, so to speak, at least in terms of the computer-vision algorithms programmed to analyze it.

[Image: Comet 67P, via ESA].

What other landscapes fall within this category—of spatial environments unrecognizable to machines—and what do those spaces reveal about the dimensional prejudices of the algorithm? Light and shadow; depth and range; foreground and background; geometry and complexity.

Bump Adam Harvey's investigations up to the scale of a landscape, and a million potential design projects beckon. Learning from Comet 67P.

(Earlier on BLDGBLOG: The Comet as Landscape Art).