Matching slides to presentation videos using SIFT and scene background matching

Quanfu Fan, Kobus Barnard, Arnon Amir, Alon Efrat, Ming Lin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

27 Scopus citations

Abstract

We present a general approach for automatically matching electronic slides to videos of corresponding presentations for use in distance learning and video proceedings of conferences. We deal with a large variety of videos, various frame compositions and color balances, arbitrary slides sequence and with dynamic cameras switching, pan, tilt and zoom. To achieve high accuracy, we develop a two-phases process with unsupervised scene background modelling. In the first phase, scale invariant feature transform (SIFT) keypoints are applied to frame to slide matching, under constraint projective transformation (constraint homography) using a random sample consensus (RANSAC). Successful first-phase matches are then used to automatically build a scene background model. In the second phase the background model is applied to the remaining unmatched frames to boost the matching performance for difficult cases such as wide field of view camera shots where the slide shows as a small portion of the frame. We also show that color correction is helpful when color-related similarity measures are used for identifying slides. We provide detailed quantitative experimentation results characterizing the effect of each part of our approach. The results show that our approach is robust and achieves high performance on matching slides to a number of videos with different styles.

Original languageEnglish (US)
Title of host publicationProceedings of the 8th ACM Multimedia International Workshop on Multimedia Information Retrieval, MIR 2006
Pages239-248
Number of pages10
DOIs
StatePublished - Dec 1 2006
Event8th ACM Multimedia International Workshop on Multimedia Information Retrieval, MIR 2006, co-located with the 2006 ACM International Multimedia Conferenc - Santa Barbara, CA, United States
Duration: Oct 26 2006Oct 27 2006

Publication series

NameProceedings of the ACM International Multimedia Conference and Exhibition

Other

Other8th ACM Multimedia International Workshop on Multimedia Information Retrieval, MIR 2006, co-located with the 2006 ACM International Multimedia Conferenc
CountryUnited States
CitySanta Barbara, CA
Period10/26/0610/27/06

Keywords

  • Color correction
  • Electronic slides
  • Looseness +1 distance learning
  • Presentation videos
  • RANSAC
  • SIFT keypoints
  • Video indexing

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Matching slides to presentation videos using SIFT and scene background matching'. Together they form a unique fingerprint.

  • Cite this

    Fan, Q., Barnard, K., Amir, A., Efrat, A., & Lin, M. (2006). Matching slides to presentation videos using SIFT and scene background matching. In Proceedings of the 8th ACM Multimedia International Workshop on Multimedia Information Retrieval, MIR 2006 (pp. 239-248). (Proceedings of the ACM International Multimedia Conference and Exhibition). https://doi.org/10.1145/1178677.1178710