eTRIMS - E-Training for Interpreting Images of Man-Made Scenes
 
eTRIMS
     
project results:

Fully Bottom up Interpretation of Man-Made Scenes

Mohammad Jahangiri, Daniel Heesch, Robby Tan and Maria Petrou
Communication and Signal Processing Group
Imperial College London
October, 2009

A fully bottom up interpretation module for interpreting images of man-made scenes, in particular buildings is proposed. For this a three layer interpretation system was designed which in the lowest level meaningful regions which are salient in gradient are detected, using the so called blob detector algorithm. After identifying the blobs, in the second layer, higher order structures such as repeated patterns, building facade and also parts of the environment like sky and ground are segmented. A unified map was then estimated using different segmented regions so that each segment contains a meaningful part of the scene.
In the third layer, the segmented regions are labelled using a MRF based contextual classifier. This classifier was employed as the buildings and their subparts are inconsistent in the low-level features. The accuracy of the proposed scheme was evaluated using the 12-class dataset of eTRIMS.


References
[1] Jahangiri, M. & Petrou, M.
An Attention Model for Extracting Regions that Merit Identification; IEEE International Conference on Image Processing (ICIP), Cairo, Egypt, 2009
[pdf]
[2] Jahangiri, M. & Petrou, M.
Fully Bottom-Up Blob Extraction in Building Facades; 9th International Conference on Pattern Recognition and Image Analysis: New Information Technologies, Nizhni Novgord, Russia, 2008
[pdf]
[3] Heesch, D., Tan, R. & Petrou, M.
Context first; Proc Int'l Workshop on Structural and Syntactic Pattern Recognition, 2008
[pdf]
[4] Heesch, D., Petrou, M.
Markov random fields with asymmetric interactions for modelling spatial context in structured scenes; Journal of Signal Processing Systems, Springer, Vol. 10.1007/s11265-009-0349-0, 2009
[pdf]