[MySQL error: cannot connect to dbs.cs.columbia.edu:5526] CAVE | Projects: Vision through Fog and Haze
Vision through Fog and Haze

Conventional vision systems are designed to perform in clear weather. Needless to say, in any outdoor application, there is no escape from "bad" weather. Images taken in poor weather conditions suffer from severe color and contrast degradation. Furthermore, this degradation worsens exponentially with distance making it impossible to acquire meaningful images of scenes that are not near the imaging system. Thus, computer vision systems must include mechanisms that enable them to function (even if somewhat less reliably) in the presence of haze, fog, rain, hail and snow. In this project, we are studying the visual manifestations of different weather conditions. For this, we draw on what is already known about atmospheric optics, and identify effects caused by bad weather that can be turned to our advantage. Since the atmosphere modulates the information carried from a scene point to the observer, it can be viewed as a mechanism of visual information coding. We exploit two fundamental scattering models, attenuation and airlight, to describe the colors, contrasts and polarizations of scene points observed through bad weather. Then, we use these models to develop methods for recovering pertinent scene properties, such as three-dimensional structure, from one or two images taken under poor weather conditions.


  Depth of Light Sources from Attenuation:

This picture shows results of an experiment where two night images of light sources under different weather conditions are used to compute the relative depths of the sources.

  Structure from Airlight:

This picture shows results of an experiment where a single image of a scene captured on a very foggy day is used to compute three-dimensional scene structure.

  Contrast Restoration:

While airlight increases the apparent brightness of the scene with distance, attenuation decreases the actual scene radiance with distance. We take into account both airlight and attenuation to model the contrast loss in images. This

  Weather and Polarization:

The natural light scattered by atmospheric particles (airlight) is partially polarized. We exploit this fact to remove haze from images. Note that optical filtering alone cannot remove the haze effects, except in very restricted situations. This picture shows how our method uses only two images taken through a polarizer at different orientations to completely remove the effects of haze. This method works instantly, without relying on changes in weather conditions. As a by-product, the method yields a range map of the scene.



  Video Summary:

This video shows several applications of the deweathering models and algorithms we have developed.



CVPR 2003 presentation     With videos (zip file)

ECCV 2002 presentation

CVPR 2001 presentation (Removing Weather)

CVPR 2001 presentation (Instant Dehazing)

CVPR 2000 presentation

ICCV 1999 presentation

Detection and Removal of Rain

Selecting Camera Parameters for Rain Removal

Participating Media: Single Scattering Model

Participating Media: Multiple Scattering Model

Removing Image Artifacts Due to Dirty Camera Lenses
and Thin Occluders