Automatic semantic content extraction in videos using a fuzzy ontology and rule-based model

Yakup Yildirim, Adnan Yazici, Turgay Yilmaz

Research output: Contribution to journalArticle

31 Citations (Scopus)

Abstract

Recent increase in the use of video-based applications has revealed the need for extracting the content in videos. Raw data and low-level features alone are not sufficient to fulfill the user 's needs; that is, a deeper understanding of the content at the semantic level is required. Currently, manual techniques, which are inefficient, subjective and costly in time and limit the querying capabilities, are being used to bridge the gap between low-level representative features and high-level semantic content. Here, we propose a semantic content extraction system that allows the user to query and retrieve objects, events, and concepts that are extracted automatically. We introduce an ontology-based fuzzy video semantic content model that uses spatial/temporal relations in event and concept definitions. This metaontology definition provides a wide-domain applicable rule construction standard that allows the user to construct an ontology for a given domain. In addition to domain ontologies, we use additional rule definitions (without using ontology) to lower spatial relation computation cost and to be able to define some complex situations more effectively. The proposed framework has been fully implemented and tested on three different domains. We have obtained satisfactory precision and recall rates for object, event and concept extraction.

Original languageEnglish
Article number6007134
Pages (from-to)47-61
Number of pages15
JournalIEEE Transactions on Knowledge and Data Engineering
Volume25
Issue number1
DOIs
Publication statusPublished - Jan 1 2013

Fingerprint

Ontology
Semantics
Costs

Keywords

  • fuzziness
  • ontology
  • Semantic content extraction
  • video content modeling

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Computational Theory and Mathematics

Cite this

Automatic semantic content extraction in videos using a fuzzy ontology and rule-based model. / Yildirim, Yakup; Yazici, Adnan; Yilmaz, Turgay.

In: IEEE Transactions on Knowledge and Data Engineering, Vol. 25, No. 1, 6007134, 01.01.2013, p. 47-61.

Research output: Contribution to journalArticle

@article{7de48cd60c58466f837f6d534991fb46,
title = "Automatic semantic content extraction in videos using a fuzzy ontology and rule-based model",
abstract = "Recent increase in the use of video-based applications has revealed the need for extracting the content in videos. Raw data and low-level features alone are not sufficient to fulfill the user 's needs; that is, a deeper understanding of the content at the semantic level is required. Currently, manual techniques, which are inefficient, subjective and costly in time and limit the querying capabilities, are being used to bridge the gap between low-level representative features and high-level semantic content. Here, we propose a semantic content extraction system that allows the user to query and retrieve objects, events, and concepts that are extracted automatically. We introduce an ontology-based fuzzy video semantic content model that uses spatial/temporal relations in event and concept definitions. This metaontology definition provides a wide-domain applicable rule construction standard that allows the user to construct an ontology for a given domain. In addition to domain ontologies, we use additional rule definitions (without using ontology) to lower spatial relation computation cost and to be able to define some complex situations more effectively. The proposed framework has been fully implemented and tested on three different domains. We have obtained satisfactory precision and recall rates for object, event and concept extraction.",
keywords = "fuzziness, ontology, Semantic content extraction, video content modeling",
author = "Yakup Yildirim and Adnan Yazici and Turgay Yilmaz",
year = "2013",
month = "1",
day = "1",
doi = "10.1109/TKDE.2011.189",
language = "English",
volume = "25",
pages = "47--61",
journal = "IEEE Transactions on Knowledge and Data Engineering",
issn = "1041-4347",
publisher = "IEEE Computer Society",
number = "1",

}

TY - JOUR

T1 - Automatic semantic content extraction in videos using a fuzzy ontology and rule-based model

AU - Yildirim, Yakup

AU - Yazici, Adnan

AU - Yilmaz, Turgay

PY - 2013/1/1

Y1 - 2013/1/1

N2 - Recent increase in the use of video-based applications has revealed the need for extracting the content in videos. Raw data and low-level features alone are not sufficient to fulfill the user 's needs; that is, a deeper understanding of the content at the semantic level is required. Currently, manual techniques, which are inefficient, subjective and costly in time and limit the querying capabilities, are being used to bridge the gap between low-level representative features and high-level semantic content. Here, we propose a semantic content extraction system that allows the user to query and retrieve objects, events, and concepts that are extracted automatically. We introduce an ontology-based fuzzy video semantic content model that uses spatial/temporal relations in event and concept definitions. This metaontology definition provides a wide-domain applicable rule construction standard that allows the user to construct an ontology for a given domain. In addition to domain ontologies, we use additional rule definitions (without using ontology) to lower spatial relation computation cost and to be able to define some complex situations more effectively. The proposed framework has been fully implemented and tested on three different domains. We have obtained satisfactory precision and recall rates for object, event and concept extraction.

AB - Recent increase in the use of video-based applications has revealed the need for extracting the content in videos. Raw data and low-level features alone are not sufficient to fulfill the user 's needs; that is, a deeper understanding of the content at the semantic level is required. Currently, manual techniques, which are inefficient, subjective and costly in time and limit the querying capabilities, are being used to bridge the gap between low-level representative features and high-level semantic content. Here, we propose a semantic content extraction system that allows the user to query and retrieve objects, events, and concepts that are extracted automatically. We introduce an ontology-based fuzzy video semantic content model that uses spatial/temporal relations in event and concept definitions. This metaontology definition provides a wide-domain applicable rule construction standard that allows the user to construct an ontology for a given domain. In addition to domain ontologies, we use additional rule definitions (without using ontology) to lower spatial relation computation cost and to be able to define some complex situations more effectively. The proposed framework has been fully implemented and tested on three different domains. We have obtained satisfactory precision and recall rates for object, event and concept extraction.

KW - fuzziness

KW - ontology

KW - Semantic content extraction

KW - video content modeling

UR - http://www.scopus.com/inward/record.url?scp=84870423298&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870423298&partnerID=8YFLogxK

U2 - 10.1109/TKDE.2011.189

DO - 10.1109/TKDE.2011.189

M3 - Article

AN - SCOPUS:84870423298

VL - 25

SP - 47

EP - 61

JO - IEEE Transactions on Knowledge and Data Engineering

JF - IEEE Transactions on Knowledge and Data Engineering

SN - 1041-4347

IS - 1

M1 - 6007134

ER -