Introduction to the Catadioptric Panoramic Vision. Introduction à la Vision Panoramique Catadioptrique

Introduction to the Catadioptric Panoramic Vision

Introduction à la Vision Panoramique Catadioptrique

El Mustapha Mouaddib

CREA – Université de Picardie Jules Verne, 7, rue du Moulin Neuf, 80000 Amiens, France

Page: 
409-417
|
Received: 
30 September 2005
| |
Accepted: 
N/A
| | Citation

OPEN ACCESS

Abstract: 

Increase the field of view of vision systems in order to obtain panoramic (omnidirectional) images is the objective of the omnidirectional vision.Many solutions have been imagined and the catadioptric approach holds a privileged place. Many applications,in particular in mobile robotics,have proved the benefits of this artificial visual perception approach. They also raised a multitude of theoretical and practical questions. After an "empirical" period for the design of these cameras,numerous works have dealt with the geometrical and optical formalization and modelling.The objective of this paper is to introduce the omnidirectional vision and to give a fast outline of the existing geometrical models and calibration methods in order to make easier the reading of the articles proposed in this journal.The papers published here will be referred,when it is necessary,to locate them in comparison with the used geometrical models.

Résumé

Augmenter le champ de vue des systèmes de vision pour le rendre panoramique,voire omnidirectionnel,tel est l’objectif de la vision omnidirectionnelle. Plusieurs solutions ont été imaginées pour y arriver parmi lesquelles l’approche catadioptrique tient une place privilégiée. Beaucoup d’applications,notamment en robotique mobile,ont prouvé l’intérêt de cette approche de la perception visuelle artificielle. Elles ont aussi soulevé une multitude de questions théoriques et pratiques. Après une période «empirique» de conception des caméras,beaucoup de travaux de recherche ont traité de la formalisation et la modélisation géométrique et optique. C’est actuellement l’aspect le plus abouti. L’objectif de ce papier est d’introduire la vision omnidirectionnelle et de donner un aperçu rapide des modèles géométriques existants et des méthodes calibrage afin de faciliter la lecture des articles de ce numéro. Les articles parus dans ce numéro spécial seront référencés,lorsqu’il y a lieu,pour les situer par rapport aux modèles géométriques utilisés. 

Keywords: 

Computer Vision,Omnidirectional,panoramic,catadioptric.

Mots clé

Vision,omnidirectionnel,panoramique,catadioptrique.

1. Généralités
2. Prodromes d’un Champ de Recherche
3. Les Caméras Catadioptriques: Aspects Théoriques et Pratiques
4. Modélisation des Caméras Catadioptriques
5. Calibrage
6. Conclusion
  References

[1] S. BAKER and S.K. NAYAR, A theory of catadioptric image formation. In ICCV 98, pages 35-42, 1998. 

[2] S. BAKER and S.K. NAYAR, A theory of single-viewpoint catadioptric image formation.  IJCV, 35(2):175-196, November 1999. 

[3] J.P. BARRETO and H. ARAUJO, Geometric properties of central catadioptric line images. In ECCV02, page IV: 237 ff., 2002. 

[4] C. BELLVER CEBREROS, E. GOMEZ GONZALEZ and M. RODRIGUEZ DANTA, Obtention of meridian caustics and catacaustics by means of stigmatic approximating surfaces. In Applied optic, volume 3, 1994. 

[5] R. BENOSMAN, T. MANIERE and J. DEVARS, Multidirectional stereovision sensor, calibration and scene reconstruction. In ICPR 96, 1996.

[6] E. BIDEAU. Système de transport à apprentissage neuronal – Application de la vision omnidirectionnelle à la localisation d'un robot mobile autonome. PhD thesis, Université de Franche-Comté,1 1995. 

[7] C. CAUCHOIS, E. BRASSART, C. PÉGARD and C. CLÉRENTIN, Technique for calibrating an omnidirectional sensor. In IEEE/RSJ int. Conf. on Int. Robots ans Systems-IROS 99, 1999. 

[8] J. FABRIZIO, J.P. TAREL and R. BENOSMAN, Calibration of panoramic catadioptric sensors made easier. In OMNIVIS02, pages 45-52, 2002. 

[9] C. GEYER and K. DANIILIDIS, Catadioptric camera calibration. In ICCV99, pages 398-404, 1999. 

[10] C. GEYER and K. DANIILIDIS, A unifying theory for central panoramic systems. In In Proc. Europ. Conf. on Computer Vision, Dublin, Ireland, 2000, 2000. 

[11] C. GEYER and K. DANIILIDIS, Catadioptric projective geometry. IJCV, 45(3):223-243, December 2001. 

[12] J. J. GONZALEZ-BARBOSA, Vision panoramique pour la robotique mobile : stéréovision et localisation par indexation d’images. PhD thesis, Université de Toulouse III- LAAS, 1 2004. 

[13] R. Andrew HICKS and Ronald K. PERLINE, Equi-areal catadioptric sensors. In Proc. of Omnivis02, pages 13-18, June 2, 2002. 

[14] J. HONG, X. TAN, B. PINETTE, R. WEISS and E.M. RISEMAN, Image-based homing. In Proceedings. of IEEE International Conference on Robotics and Automation, pages 620 -625, vol.1, 9-11 April 1991. 

[15] S.B. KANG, Catadioptric self-calibration. In CVPR00, pages I: 201207, 2000. 

[16] S.S. LIN and R. BAJCSY, True single view point cone mirror omnidirectional catadioptric system. In ICCV01, pages II: 102-107, 2001. 

[17] E. MOUADDIB and C. PEGARD, Localization using omnidirectional vision. In 7th Int. Conf. on Advanced Robotics (ICAR 95), Barcelona, volume 1, pages 133-138, 1995.

[18] V. NALWA, A true omnidirectional viewer. In Technical report, Bell Laboratories, Holmdel, NJ 07733, USA, 1996. 

[19] S.K. NAYAR, Catadioptric omnidirectional camera. In CVPR97, pages 482-488, 1997. 

[20] S.K. NAYAR and S. BAKER, Catadioptric image formation. In IUW 97, pages 1431-1437, 1997. 

[21] S.K. NAYAR and S. BAKER, Catadioptric image formation. In DARPA97, pages 1431-1438, 1997. 

[22] S. RAMALINGAM and S. K. STURM, P. and LODHA, Towards complete generic camera calibration. In Proceedings. IEEE CVPR, 2005. 

[23] D. REES, Panoramic television viewing system. In United States Patent No. 3,505,465, 1970. 

[24] P. STURM and S. RAMALINGAM, A generic concept for camera calibration. In ECCV, 2004. 

[25] T. SVOBODA, T. PAJDLA and V. HLAVAC, Central panoramic cameras. In Research Report K335/97/147, December 5, 1997. 

[26] R. SWAMINATHAN, M.D. GROSSBERG, and S.K. NAYAR. Caustics of catadioptric cameras. In Proceedings. Eighth IEEE ICCV 2001, pages 2 -9 vol.2, 2001. 

[27] P. VASSEUR and E. MOUADDIB, Central catadioptric line detection. In 15th British Machine Vision Conference, September 2004. 

[28] Y. YAGI and S. KAWATO, Panoramic scene analysis with conic projection. In IROS90, pages xx-yy, 1990. 

[29] Y. YAGI and S. KAWATO, Panoramic scene analysis with conic projection. In IEEE/RSJ International Conference on Intelligent Robots and Systems, volume 1, pages 181 - 187, 1990. 

[30] K. YAMAZAWA,Y. YAGI and M. YACHIDA, Omindirectional imaging with hyperboliodal projection. In IROS93, pages 1029-1034, 1993. 

[31] X. YING and Z. HU, Catadioptric camera calibration using geometric invariants. In ICCV03, pages 1351-1358, 2003.