Data-driven morphological analysis and disambiguation for Kazakh

Olzhas Makhambetov; Aibek Makazhanov; Islam Sabyrgaliyev; Zhandos Yessenbayev

doi:10.1007/978-3-319-18111-0_12

Data-driven morphological analysis and disambiguation for Kazakh

Olzhas Makhambetov, Aibek Makazhanov, Islam Sabyrgaliyev, Zhandos Yessenbayev

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

7 Citations (Scopus)

Abstract

We propose a method for morphological analysis and disambiguation for Kazakh language that accounts for both inflectional and derivational morphology, including not fully productive derivation. The method is data-driven and does not require manually generated rules. We leverage so called “transition chains” that help pruning false segmentations, while keeping correct ones. At the disambiguation step we use a standard HMM-based approach. Evaluating our method against open source solutions on several data sets, we show that it achieves better or on par performance. We also provide an extensive error analysis that sheds light on common problems of the morphological disambiguation of the language.

Original language	English
Title of host publication	Computational Linguistics and Intelligent Text Processing - 16th International Conference, CICLing 2015, Proceedings
Editors	Alexander Gelbukh
Publisher	Springer Verlag
Pages	151-163
Number of pages	13
ISBN (Print)	9783319181103
DOIs	https://doi.org/10.1007/978-3-319-18111-0_12
Publication status	Published - Jan 1 2015
Event	16th Annual Conference on Intelligent Text Processing and Computational Linguistics, CICLing 2015 - Cairo, Egypt Duration: Apr 14 2015 → Apr 20 2015

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9041
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	16th Annual Conference on Intelligent Text Processing and Computational Linguistics, CICLing 2015
Country	Egypt
City	Cairo
Period	4/14/15 → 4/20/15

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-319-18111-0_12

Fingerprint Dive into the research topics of 'Data-driven morphological analysis and disambiguation for Kazakh'. Together they form a unique fingerprint.

Cite this

Makhambetov, O., Makazhanov, A., Sabyrgaliyev, I., & Yessenbayev, Z. (2015). Data-driven morphological analysis and disambiguation for Kazakh. In A. Gelbukh (Ed.), Computational Linguistics and Intelligent Text Processing - 16th International Conference, CICLing 2015, Proceedings (pp. 151-163). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9041). Springer Verlag. https://doi.org/10.1007/978-3-319-18111-0_12

Data-driven morphological analysis and disambiguation for Kazakh. / Makhambetov, Olzhas; Makazhanov, Aibek; Sabyrgaliyev, Islam; Yessenbayev, Zhandos.

Computational Linguistics and Intelligent Text Processing - 16th International Conference, CICLing 2015, Proceedings. ed. / Alexander Gelbukh. Springer Verlag, 2015. p. 151-163 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9041).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Makhambetov, O, Makazhanov, A, Sabyrgaliyev, I & Yessenbayev, Z 2015, Data-driven morphological analysis and disambiguation for Kazakh. in A Gelbukh (ed.), Computational Linguistics and Intelligent Text Processing - 16th International Conference, CICLing 2015, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9041, Springer Verlag, pp. 151-163, 16th Annual Conference on Intelligent Text Processing and Computational Linguistics, CICLing 2015, Cairo, Egypt, 4/14/15. https://doi.org/10.1007/978-3-319-18111-0_12

Makhambetov O, Makazhanov A, Sabyrgaliyev I, Yessenbayev Z. Data-driven morphological analysis and disambiguation for Kazakh. In Gelbukh A, editor, Computational Linguistics and Intelligent Text Processing - 16th International Conference, CICLing 2015, Proceedings. Springer Verlag. 2015. p. 151-163. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-18111-0_12

Makhambetov, Olzhas ; Makazhanov, Aibek ; Sabyrgaliyev, Islam ; Yessenbayev, Zhandos. / Data-driven morphological analysis and disambiguation for Kazakh. Computational Linguistics and Intelligent Text Processing - 16th International Conference, CICLing 2015, Proceedings. editor / Alexander Gelbukh. Springer Verlag, 2015. pp. 151-163 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{fbc37953d9724064bccf1b7ce029af2e,

title = "Data-driven morphological analysis and disambiguation for Kazakh",

abstract = "We propose a method for morphological analysis and disambiguation for Kazakh language that accounts for both inflectional and derivational morphology, including not fully productive derivation. The method is data-driven and does not require manually generated rules. We leverage so called “transition chains” that help pruning false segmentations, while keeping correct ones. At the disambiguation step we use a standard HMM-based approach. Evaluating our method against open source solutions on several data sets, we show that it achieves better or on par performance. We also provide an extensive error analysis that sheds light on common problems of the morphological disambiguation of the language.",

author = "Olzhas Makhambetov and Aibek Makazhanov and Islam Sabyrgaliyev and Zhandos Yessenbayev",

year = "2015",

month = jan,

day = "1",

doi = "10.1007/978-3-319-18111-0_12",

language = "English",

isbn = "9783319181103",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "151--163",

editor = "Alexander Gelbukh",

booktitle = "Computational Linguistics and Intelligent Text Processing - 16th International Conference, CICLing 2015, Proceedings",

address = "Germany",

note = "16th Annual Conference on Intelligent Text Processing and Computational Linguistics, CICLing 2015 ; Conference date: 14-04-2015 Through 20-04-2015",

}

TY - GEN

T1 - Data-driven morphological analysis and disambiguation for Kazakh

AU - Makhambetov, Olzhas

AU - Makazhanov, Aibek

AU - Sabyrgaliyev, Islam

AU - Yessenbayev, Zhandos

PY - 2015/1/1

Y1 - 2015/1/1

N2 - We propose a method for morphological analysis and disambiguation for Kazakh language that accounts for both inflectional and derivational morphology, including not fully productive derivation. The method is data-driven and does not require manually generated rules. We leverage so called “transition chains” that help pruning false segmentations, while keeping correct ones. At the disambiguation step we use a standard HMM-based approach. Evaluating our method against open source solutions on several data sets, we show that it achieves better or on par performance. We also provide an extensive error analysis that sheds light on common problems of the morphological disambiguation of the language.

AB - We propose a method for morphological analysis and disambiguation for Kazakh language that accounts for both inflectional and derivational morphology, including not fully productive derivation. The method is data-driven and does not require manually generated rules. We leverage so called “transition chains” that help pruning false segmentations, while keeping correct ones. At the disambiguation step we use a standard HMM-based approach. Evaluating our method against open source solutions on several data sets, we show that it achieves better or on par performance. We also provide an extensive error analysis that sheds light on common problems of the morphological disambiguation of the language.

UR - http://www.scopus.com/inward/record.url?scp=84942574744&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84942574744&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-18111-0_12

DO - 10.1007/978-3-319-18111-0_12

M3 - Conference contribution

AN - SCOPUS:84942574744

SN - 9783319181103

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 151

EP - 163

BT - Computational Linguistics and Intelligent Text Processing - 16th International Conference, CICLing 2015, Proceedings

A2 - Gelbukh, Alexander

PB - Springer Verlag

T2 - 16th Annual Conference on Intelligent Text Processing and Computational Linguistics, CICLing 2015

Y2 - 14 April 2015 through 20 April 2015

ER -