Spatio-temporal metadata filtering and synchronising in video-surveillance

Spatio-temporal metadata filtering and synchronising in video-surveillance

Dana Codreanu | Vincent Oria André Peninou Florence Sèdes

IRIT, University Paul Sabatier, Toulouse, France

New Jersey Institute of Technology, Newark, NJ, USA

Corresponding Author Email: 
{dana.codreanu, andre.peninou, florence.sedes},
30 June 2016
| Citation

This paper presents an ongoing work that aims at assisting video-protection agents in the search for particular video scenes of interest in transit network. The video-protection agent inputs a query in the form of date, time, location and a visual description of the scene. The query processing starts by selecting a set of cameras likely to have filmed the scene followed by an analysis of the video content obtained from these cameras. The main contribution of this paper is the innovative framework that is composed of: 1) a spatiotemporal filtering method based on a spatio-temporal modelling of the transit network and associated cameras, and 2) a content-based retrieval based method on visual features. The presented filtering framework is to be tested on real data acquired within a French National project in partnership with the French Interior Ministry and the French National Police. The project aims at setting up public demonstrators that will be used by researchers and commercials from the video-protection community.


video-protection framework, querying, spatio-temporal filtering

1. Introduction
2. Related works
3. Data model
4. The proposed video surveillance framework
5. A posteriori validation and use-case
6. Evaluation and future trends in spatio-temporal modelling
7. Conclusions

Abascal Mena R., Lema R., Sèdes F. (2015). Detecting sociosemantic communities by applying social network analysis in tweets. In: Social Network Analysis and Mining, Springer, vol. 5, n° 1, december.

Alboody A., Inglada J., Sèdes F. (2009). Enriching The Spatial Reasoning System RCC8. ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM GIS’08), Irvine, CA, USA, vol. 1, ACM DL, The SIGSPATIAL Special

Number 1, p. 14-20, march.

Alboody A., Sèdes F., Inglada J. (2011). Enriching The Qualitative Spatial Reasoning System RCC8. Qualitative Spatio-Temporal Representation and Reasoning: Trends and Future Directions. Shyamanta M. Hazarika (Eds.), Information Science Reference, december.

Arslan Ay S., Kim S. H., Zimmermann R. (2010). Generating synthetic meta-data for georeferenced video management. In Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS’10, p. 280-289, New

York, NY, USA. ACM.

Brut M., Codreanu D., Dumitrescu S., Manzat A.-M., Sedes F. (2011). A distributed architecture for flexible multimedia management and retrieval. In Proceedings of the 22nd International Conf. on Database and Expert Systems Applications, DEXA’11, p. 249-263.

Brut M., Laborie S., Manzat A.-M., Sedes F. (2009). A generic metadata framework for the indexation and the management of distributed multimedia contents. In 3rd International Conf. on New Technologies, Mobility and Security (NTMS), p. 1-5, Dec.

Cucchiara R. (2005). Multimedia surveillance systems. In Proceedings of the Third ACM International Workshop on Video Surveillance and Sensor Networks, VSSN’05, p. 3-10. ACM.

Epshtein B., Ofek E., Wexler Y., Zhang P. (2007). Hierarchical photo organization using georelevance. In Proceedings of the 15th Annual ACM International Symposium on Advances in Geographic Information Systems, GIS’07, p. 1-7.

Goodchild Michael F. (2007). Citizens as sensors: the world of volunteered geography, GeoJournal, 69, p. 211-221, DOI 10.1007/s10708-007-9111-y.

Liu K., Li Y., He F., Xu J., Ding Z. (2012). Effective map-matching on the most simplified road network. In Proceedings of the 20th International Conference on Advances in Geographic Information Systems, p. 609-612.

Liu X., Corner M., Shenoy P. (2009). Seva: Sensor-enhanced video annotation. ACM Trans. Multimedia Comput. Commun. Appl., p. 1-26.

Merkus P., Desurmont X., Jaspers E. G. T., Wijnhoven R. G. J., Caignart O., J. Delaigle J., Favoreel W. (2004). Candela - integrated storage, analysis and distribution of video content for intelligent information systems, European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology.

Shahabi C., Banaei-Kashani F., Khoshgozaran A., Nocera, L., Xing S. (2010). Geodec: A framework to visualize and query geospatial data for decision-making. IEEE Multimedia, vol. 17, n° 3, p. 14-23.

Shen Z., Arslan Ay S., Kim S. H., Zimmermann R. (2011). Automatic tag generation and ranking for sensor-rich outdoor videos. In Proceedings of the 19th ACM International Conf. on Multimedia, MM’11, p. 93-102.