Client-side backprojection of presentation slides into educational video

Yekaterina Kharitonova, Qiyam Tung, Alexander Danehy, Alon Efrat, Jacobus J Barnard

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

A significant part of many videos of lectures is presentation slides that occupy much of the field of view. Further, for a student studying the lecture, having the slides sharply displayed is especially important, compared with the speaker, background, and audience. However, even if the original capture supports it, the bandwidth required for real time viewing is substantive, especially in the context of mobile devices. Here we propose reconstructing the video on the client side by backprojecting high resolution slide images into the video stream with the slide area blacked out. The high resolution slide deck can be sent once, and inserted into the video on the client side based on the transformation (a homography) computed in advance. We further introduce the idea that needed homography transformations can be approximated using affine transformations, which allows it to be done using built-in capabilities of HTML 5. We find that it is possible to significantly reduce bandwidth by compressing the modified video, while improving the slide area quality, but leaving the non-slide area roughly the same.

Original languageEnglish (US)
Title of host publicationMM 2012 - Proceedings of the 20th ACM International Conference on Multimedia
Pages1005-1008
Number of pages4
DOIs
StatePublished - 2012
Event20th ACM International Conference on Multimedia, MM 2012 - Nara, Japan
Duration: Oct 29 2012Nov 2 2012

Other

Other20th ACM International Conference on Multimedia, MM 2012
CountryJapan
CityNara
Period10/29/1211/2/12

Fingerprint

Bandwidth
HTML
Mobile devices
Students

Keywords

  • affine transformation
  • backprojection
  • homography
  • lecture video
  • presentation slides

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Cite this

Kharitonova, Y., Tung, Q., Danehy, A., Efrat, A., & Barnard, J. J. (2012). Client-side backprojection of presentation slides into educational video. In MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia (pp. 1005-1008) https://doi.org/10.1145/2393347.2396368

Client-side backprojection of presentation slides into educational video. / Kharitonova, Yekaterina; Tung, Qiyam; Danehy, Alexander; Efrat, Alon; Barnard, Jacobus J.

MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia. 2012. p. 1005-1008.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kharitonova, Y, Tung, Q, Danehy, A, Efrat, A & Barnard, JJ 2012, Client-side backprojection of presentation slides into educational video. in MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia. pp. 1005-1008, 20th ACM International Conference on Multimedia, MM 2012, Nara, Japan, 10/29/12. https://doi.org/10.1145/2393347.2396368
Kharitonova Y, Tung Q, Danehy A, Efrat A, Barnard JJ. Client-side backprojection of presentation slides into educational video. In MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia. 2012. p. 1005-1008 https://doi.org/10.1145/2393347.2396368
Kharitonova, Yekaterina ; Tung, Qiyam ; Danehy, Alexander ; Efrat, Alon ; Barnard, Jacobus J. / Client-side backprojection of presentation slides into educational video. MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia. 2012. pp. 1005-1008
@inproceedings{930a1810af834c1b8f0ce5ed0c63cfa0,
title = "Client-side backprojection of presentation slides into educational video",
abstract = "A significant part of many videos of lectures is presentation slides that occupy much of the field of view. Further, for a student studying the lecture, having the slides sharply displayed is especially important, compared with the speaker, background, and audience. However, even if the original capture supports it, the bandwidth required for real time viewing is substantive, especially in the context of mobile devices. Here we propose reconstructing the video on the client side by backprojecting high resolution slide images into the video stream with the slide area blacked out. The high resolution slide deck can be sent once, and inserted into the video on the client side based on the transformation (a homography) computed in advance. We further introduce the idea that needed homography transformations can be approximated using affine transformations, which allows it to be done using built-in capabilities of HTML 5. We find that it is possible to significantly reduce bandwidth by compressing the modified video, while improving the slide area quality, but leaving the non-slide area roughly the same.",
keywords = "affine transformation, backprojection, homography, lecture video, presentation slides",
author = "Yekaterina Kharitonova and Qiyam Tung and Alexander Danehy and Alon Efrat and Barnard, {Jacobus J}",
year = "2012",
doi = "10.1145/2393347.2396368",
language = "English (US)",
isbn = "9781450310895",
pages = "1005--1008",
booktitle = "MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia",

}

TY - GEN

T1 - Client-side backprojection of presentation slides into educational video

AU - Kharitonova, Yekaterina

AU - Tung, Qiyam

AU - Danehy, Alexander

AU - Efrat, Alon

AU - Barnard, Jacobus J

PY - 2012

Y1 - 2012

N2 - A significant part of many videos of lectures is presentation slides that occupy much of the field of view. Further, for a student studying the lecture, having the slides sharply displayed is especially important, compared with the speaker, background, and audience. However, even if the original capture supports it, the bandwidth required for real time viewing is substantive, especially in the context of mobile devices. Here we propose reconstructing the video on the client side by backprojecting high resolution slide images into the video stream with the slide area blacked out. The high resolution slide deck can be sent once, and inserted into the video on the client side based on the transformation (a homography) computed in advance. We further introduce the idea that needed homography transformations can be approximated using affine transformations, which allows it to be done using built-in capabilities of HTML 5. We find that it is possible to significantly reduce bandwidth by compressing the modified video, while improving the slide area quality, but leaving the non-slide area roughly the same.

AB - A significant part of many videos of lectures is presentation slides that occupy much of the field of view. Further, for a student studying the lecture, having the slides sharply displayed is especially important, compared with the speaker, background, and audience. However, even if the original capture supports it, the bandwidth required for real time viewing is substantive, especially in the context of mobile devices. Here we propose reconstructing the video on the client side by backprojecting high resolution slide images into the video stream with the slide area blacked out. The high resolution slide deck can be sent once, and inserted into the video on the client side based on the transformation (a homography) computed in advance. We further introduce the idea that needed homography transformations can be approximated using affine transformations, which allows it to be done using built-in capabilities of HTML 5. We find that it is possible to significantly reduce bandwidth by compressing the modified video, while improving the slide area quality, but leaving the non-slide area roughly the same.

KW - affine transformation

KW - backprojection

KW - homography

KW - lecture video

KW - presentation slides

UR - http://www.scopus.com/inward/record.url?scp=84871374263&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84871374263&partnerID=8YFLogxK

U2 - 10.1145/2393347.2396368

DO - 10.1145/2393347.2396368

M3 - Conference contribution

AN - SCOPUS:84871374263

SN - 9781450310895

SP - 1005

EP - 1008

BT - MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia

ER -