A natural language approach to content-based video indexing and retrieval for interactive e-Learning

Dongsong Zhang, Jay F Nunamaker

Research output: Contribution to journalArticle

35 Citations (Scopus)

Abstract

As a powerful and expressive nontextual media that can capture and present information, instructional videos are extensively used in e-Learning (Web-based distance learning). Since each video may cover many subjects, it is critical for an e-Learning environment to have content-based video searching capabilities to meet diverse individual learning needs. In this paper, we present an interactive multimedia-based e-Learning environment that enables users to interact with it to obtain knowledge in the form of logically segmented video clips. We propose a natural language approach to content-based video indexing and retrieval to identify appropriate video clips that can address users' needs. The method integrates natural language processing, named entity extraction, frame-based indexing, and information retrieval techniques to explore knowledge-on-demand in a video-based interactive e-Learning environment. A preliminary evaluation shows that precision and recall of this approach are better than those of the traditional keyword based approach.

Original languageEnglish (US)
Pages (from-to)450-458
Number of pages9
JournalIEEE Transactions on Multimedia
Volume6
Issue number3
DOIs
StatePublished - Jun 2004

Fingerprint

Distance education
Information retrieval
Processing

Keywords

  • Learning by asking
  • Natural language processing
  • Video indexing and retrieval

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

A natural language approach to content-based video indexing and retrieval for interactive e-Learning. / Zhang, Dongsong; Nunamaker, Jay F.

In: IEEE Transactions on Multimedia, Vol. 6, No. 3, 06.2004, p. 450-458.

Research output: Contribution to journalArticle

@article{52536813305a430dbf8c62df1fc54ad7,
title = "A natural language approach to content-based video indexing and retrieval for interactive e-Learning",
abstract = "As a powerful and expressive nontextual media that can capture and present information, instructional videos are extensively used in e-Learning (Web-based distance learning). Since each video may cover many subjects, it is critical for an e-Learning environment to have content-based video searching capabilities to meet diverse individual learning needs. In this paper, we present an interactive multimedia-based e-Learning environment that enables users to interact with it to obtain knowledge in the form of logically segmented video clips. We propose a natural language approach to content-based video indexing and retrieval to identify appropriate video clips that can address users' needs. The method integrates natural language processing, named entity extraction, frame-based indexing, and information retrieval techniques to explore knowledge-on-demand in a video-based interactive e-Learning environment. A preliminary evaluation shows that precision and recall of this approach are better than those of the traditional keyword based approach.",
keywords = "Learning by asking, Natural language processing, Video indexing and retrieval",
author = "Dongsong Zhang and Nunamaker, {Jay F}",
year = "2004",
month = "6",
doi = "10.1109/TMM.2004.827505",
language = "English (US)",
volume = "6",
pages = "450--458",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "3",

}

TY - JOUR

T1 - A natural language approach to content-based video indexing and retrieval for interactive e-Learning

AU - Zhang, Dongsong

AU - Nunamaker, Jay F

PY - 2004/6

Y1 - 2004/6

N2 - As a powerful and expressive nontextual media that can capture and present information, instructional videos are extensively used in e-Learning (Web-based distance learning). Since each video may cover many subjects, it is critical for an e-Learning environment to have content-based video searching capabilities to meet diverse individual learning needs. In this paper, we present an interactive multimedia-based e-Learning environment that enables users to interact with it to obtain knowledge in the form of logically segmented video clips. We propose a natural language approach to content-based video indexing and retrieval to identify appropriate video clips that can address users' needs. The method integrates natural language processing, named entity extraction, frame-based indexing, and information retrieval techniques to explore knowledge-on-demand in a video-based interactive e-Learning environment. A preliminary evaluation shows that precision and recall of this approach are better than those of the traditional keyword based approach.

AB - As a powerful and expressive nontextual media that can capture and present information, instructional videos are extensively used in e-Learning (Web-based distance learning). Since each video may cover many subjects, it is critical for an e-Learning environment to have content-based video searching capabilities to meet diverse individual learning needs. In this paper, we present an interactive multimedia-based e-Learning environment that enables users to interact with it to obtain knowledge in the form of logically segmented video clips. We propose a natural language approach to content-based video indexing and retrieval to identify appropriate video clips that can address users' needs. The method integrates natural language processing, named entity extraction, frame-based indexing, and information retrieval techniques to explore knowledge-on-demand in a video-based interactive e-Learning environment. A preliminary evaluation shows that precision and recall of this approach are better than those of the traditional keyword based approach.

KW - Learning by asking

KW - Natural language processing

KW - Video indexing and retrieval

UR - http://www.scopus.com/inward/record.url?scp=2642577417&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=2642577417&partnerID=8YFLogxK

U2 - 10.1109/TMM.2004.827505

DO - 10.1109/TMM.2004.827505

M3 - Article

AN - SCOPUS:2642577417

VL - 6

SP - 450

EP - 458

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 3

ER -