eTRIMS - E-Training for Interpreting Images of Man-Made Scenes
 
eTRIMS
     
project results:

Probabilistic Reasoning for Context-Based Image Interpretation

Filip Korč, Wolfgang Förstner
Department of Photogrammetry
University of Bonn
June, 2008

We investigate Conditional Random Fields (CRF) which provide a principled approach for combining local discriminative classifiers that allow the use of arbitrary overlapping features, with adaptive data-dependent smoothing over the label field. We discuss the differences between a traditional Markov Random Field (MRF) formulation and the CRF model, and compare the performance of the two models and an independent sitewise classifier. Further, we present results suggesting the potential for performance enhancement by improving state of the art parameter learning methods. Eventually, we demonstrate the application feasibility on both synthetic and natural images.

Further, we investigate maximum likelihood parameter learning in Conditional Random Fields (CRF) and present an empirical study of pseudo-likelihood (PL) based approximations of the parameter likelihood gradient. We show that these parameter learning methods can be improved and evaluate the resulting performance employing different inference techniques. We show that the approximation based on penalized pseudo-likelihood (PPL) in combination with the Maximum A Posteriori (MAP) inference yields results comparable to other state of the art approaches, while providing low complexity and advantages to formulating parameter learning as a convex optimization problem. Eventually, we demonstrate applicability on the task of detecting man-made structures in natural images.


References

[1] Filip Korč, Wolfgang Förstner (2008).
Approximate Parameter Learning in Conditional Random Fields: An Empirical Investigation. 30th Annual Symposium of the German Association for Pattern Recognition (DAGM), Munich, Germany, 2008. pdf
[2] Filip Korč, Wolfgang Förstner (2008).
Interpreting Terrestrial Images of Urban Scenes Using Discriminative Random Fields. 21st Congress of the International Society for Photogrammetry and Remote Sensing (ISPRS), Beijing, China, 2008. pdf
[3] Filip Korč, Wolfgang Förstner (2008).
Finding Optimal Non-Overlapping Subset of Extracted Image Objects. 12th International Workshop on Combinatorial Image Analysis (IWCIA), Buffalo, USA, 2008. pdf