Exploiting information extraction techniques for automatic semantic video indexing with an application to Turkish news videos

Dilek Küçük, Adnan Yazici

Research output: Contribution to journalArticlepeer-review

23 Citations (Scopus)

Abstract

This paper targets at the problem of automatic semantic indexing of news videos by presenting a video annotation and retrieval system which is able to perform automatic semantic annotation of news video archives and provide access to the archives via these annotations. The presented system relies on the video texts as the information source and exploits several information extraction techniques on these texts to arrive at representative semantic information regarding the underlying videos. These techniques include named entity recognition, person entity extraction, coreference resolution, and semantic event extraction. Apart from the information extraction components, the proposed system also encompasses modules for news story segmentation, text extraction, and video retrieval along with a news video database to make it a full-fledged system to be employed in practical settings. The proposed system is a generic one employing a wide range of techniques to automate the semantic video indexing process and to bridge the semantic gap between what can be automatically extracted from videos and what people perceive as the video semantics. Based on the proposed system, a novel automatic semantic annotation and retrieval system is built for Turkish and evaluated on a broadcast news video collection, providing evidence for its feasibility and convenience for news videos with a satisfactory overall performance.

Original languageEnglish
Pages (from-to)844-857
Number of pages14
JournalKnowledge-Based Systems
Volume24
Issue number6
DOIs
Publication statusPublished - Aug 1 2011
Externally publishedYes

Keywords

  • Information extraction
  • News video retrieval
  • Semantic video annotation
  • Text mining
  • Video indexing

ASJC Scopus subject areas

  • Software
  • Management Information Systems
  • Information Systems and Management
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Exploiting information extraction techniques for automatic semantic video indexing with an application to Turkish news videos'. Together they form a unique fingerprint.

Cite this