TY - GEN
T1 - A RELIEF-based modality weighting approach for multimodal information retrieval
AU - Yilmaz, Turgay
AU - Gulen, Elvan
AU - Yazici, Adnan
AU - Kitsuregawa, Masaru
PY - 2012
Y1 - 2012
N2 - Despite the extensive number of studies for multimodal information fusion, the issue of determining the optimal modalities has not been adequately addressed yet. In this study, a RELIEF-based multimodal feature selection approach (RELIEF-RDR) is proposed. The original RELIEF algorithm is extended for weaknesses in three major issues; multilabeled data, noise and class-specific feature selection. To overcome these weaknesses, discrimination based weighting mechanism of RELIEF is supported with two additional concepts; representation and reliability capabilities of features, without an increase in computational complexity. These capabilities of features are exploited by using the statistics on dissimilarities of training instances. The experiments conducted on TRECVID 2007 dataset validated the superiority of RELIEF-RDR over RELIEF.
AB - Despite the extensive number of studies for multimodal information fusion, the issue of determining the optimal modalities has not been adequately addressed yet. In this study, a RELIEF-based multimodal feature selection approach (RELIEF-RDR) is proposed. The original RELIEF algorithm is extended for weaknesses in three major issues; multilabeled data, noise and class-specific feature selection. To overcome these weaknesses, discrimination based weighting mechanism of RELIEF is supported with two additional concepts; representation and reliability capabilities of features, without an increase in computational complexity. These capabilities of features are exploited by using the statistics on dissimilarities of training instances. The experiments conducted on TRECVID 2007 dataset validated the superiority of RELIEF-RDR over RELIEF.
KW - Feature weighting
KW - Multimodal information fusion
KW - RELIEF
UR - http://www.scopus.com/inward/record.url?scp=84864131081&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84864131081&partnerID=8YFLogxK
U2 - 10.1145/2324796.2324858
DO - 10.1145/2324796.2324858
M3 - Conference contribution
AN - SCOPUS:84864131081
SN - 9781450313292
T3 - Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012
BT - Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012
T2 - 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012
Y2 - 5 June 2012 through 8 June 2012
ER -