Correlation-Based Intrinsic Image Extraction from a Single Image

Xiaoyue Jiang, Andrew Schofield, Jeremy Wyatt

Research output: Contribution to journalConference articlepeer-review


Intrinsic images represent the underlying properties of a scene such as illumination (shading) and surface reflectance. Extracting intrinsic images is a challenging, ill-posed problem. Human performance on tasks such as shadow detection and shape-from-shading is improved by adding colour and texture to surfaces. In particular, when a surface is painted with a textured pattern, correlations between local mean luminance and local luminance amplitude promote the interpretation of luminance variations as illumination changes. Based on this finding, we propose a novel feature, local luminance amplitude, to separate illumination and reflectance, and a framework to integrate this cue with hue and texture to extract intrinsic images. The algorithm uses steerable filters to separate images into frequency and orientation components and constructs shading and reflectance images from weighted combinations of these components. Weights are determined by correlations between corresponding variations in local luminance, local amplitude, colour and texture. The intrinsic images are further refined by ensuring the consistency of local texture elements. We test this method on surfaces photographed under different lighting conditions. The effectiveness of the algorithm is demonstrated by the correlation between our intrinsic images and ground truth shading and reflectance data. Luminance amplitude was found to be a useful cue. Results are also presented for natural images.
Original languageEnglish
Pages (from-to)58-71
Number of pages14
JournalLecture Notes in Computer Science
Publication statusPublished - 2010
Event11th European Conference on Computer Vision - Heraklion, Greece
Duration: 5 Sept 201011 Sept 2010


Dive into the research topics of 'Correlation-Based Intrinsic Image Extraction from a Single Image'. Together they form a unique fingerprint.

Cite this