Estimating Grammar Correctness for a Priori Estimation of Machine Translation Post-Editing Effort

Nicholas H. Kirk; Guchun Zhang; Georg Groh

Estimating Grammar Correctness for a Priori Estimation of Machine Translation Post-Editing Effort

Nicholas H. Kirk, Guchun Zhang, Georg Groh

Informatics 25 - Chair of Data Science and Engineering

Alpha Calligraphic Research Cambridge Ltd.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

We present a supervised learning pilot application for estimating Machine Translation (MT) output reusability, in view of supporting a human post-editor of MT content. We train our model on typed dependencies (labeled grammar relationships) extracted from human reference and raw MT data, to then predict grammar relationship correctness values that we aggregate to provide a binary segment-level evaluation. In view of scaling up to larger data, we provide implemented Naïve Bayes and Stochastic Gradient Descent with Support Vector Machine loss function approaches and their evaluation, and verify the correlation of predicted values with human judgement.

Original language	English
Title of host publication	EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014
Publisher	Association for Computational Linguistics (ACL)
Pages	16-21
Number of pages	6
ISBN (Electronic)	9781937284824
State	Published - 2014
Event	14th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2014 - Gothenburg, Sweden Duration: 26 Apr 2014 → 30 Apr 2014

Publication series

Name	EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014

Conference

Conference	14th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2014
Country/Territory	Sweden
City	Gothenburg
Period	26/04/14 → 30/04/14

Cite this

Kirk, N. H., Zhang, G., & Groh, G. (2014). Estimating Grammar Correctness for a Priori Estimation of Machine Translation Post-Editing Effort. In EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014 (pp. 16-21). (EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014). Association for Computational Linguistics (ACL).

Kirk, Nicholas H. ; Zhang, Guchun ; Groh, Georg. / Estimating Grammar Correctness for a Priori Estimation of Machine Translation Post-Editing Effort. EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014. Association for Computational Linguistics (ACL), 2014. pp. 16-21 (EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014).

@inproceedings{3ea7d8b40f87442583f5b9dd5327d7ee,

title = "Estimating Grammar Correctness for a Priori Estimation of Machine Translation Post-Editing Effort",

abstract = "We present a supervised learning pilot application for estimating Machine Translation (MT) output reusability, in view of supporting a human post-editor of MT content. We train our model on typed dependencies (labeled grammar relationships) extracted from human reference and raw MT data, to then predict grammar relationship correctness values that we aggregate to provide a binary segment-level evaluation. In view of scaling up to larger data, we provide implemented Na{\"i}ve Bayes and Stochastic Gradient Descent with Support Vector Machine loss function approaches and their evaluation, and verify the correlation of predicted values with human judgement.",

author = "Kirk, {Nicholas H.} and Guchun Zhang and Georg Groh",

note = "Publisher Copyright: {\textcopyright} 2014 Association for Computational Linguistics; 14th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2014 ; Conference date: 26-04-2014 Through 30-04-2014",

year = "2014",

language = "English",

series = "EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014",

publisher = "Association for Computational Linguistics (ACL)",

pages = "16--21",

booktitle = "EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014",

}

Kirk, NH, Zhang, G & Groh, G 2014, Estimating Grammar Correctness for a Priori Estimation of Machine Translation Post-Editing Effort. in EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014. EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014, Association for Computational Linguistics (ACL), pp. 16-21, 14th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2014, Gothenburg, Sweden, 26/04/14.

Estimating Grammar Correctness for a Priori Estimation of Machine Translation Post-Editing Effort. / Kirk, Nicholas H.; Zhang, Guchun; Groh, Georg.
EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014. Association for Computational Linguistics (ACL), 2014. p. 16-21 (EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Estimating Grammar Correctness for a Priori Estimation of Machine Translation Post-Editing Effort

AU - Kirk, Nicholas H.

AU - Zhang, Guchun

AU - Groh, Georg

PY - 2014

Y1 - 2014

N2 - We present a supervised learning pilot application for estimating Machine Translation (MT) output reusability, in view of supporting a human post-editor of MT content. We train our model on typed dependencies (labeled grammar relationships) extracted from human reference and raw MT data, to then predict grammar relationship correctness values that we aggregate to provide a binary segment-level evaluation. In view of scaling up to larger data, we provide implemented Naïve Bayes and Stochastic Gradient Descent with Support Vector Machine loss function approaches and their evaluation, and verify the correlation of predicted values with human judgement.

AB - We present a supervised learning pilot application for estimating Machine Translation (MT) output reusability, in view of supporting a human post-editor of MT content. We train our model on typed dependencies (labeled grammar relationships) extracted from human reference and raw MT data, to then predict grammar relationship correctness values that we aggregate to provide a binary segment-level evaluation. In view of scaling up to larger data, we provide implemented Naïve Bayes and Stochastic Gradient Descent with Support Vector Machine loss function approaches and their evaluation, and verify the correlation of predicted values with human judgement.

UR - http://www.scopus.com/inward/record.url?scp=85121780235&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85121780235

T3 - EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014

SP - 16

EP - 21

BT - EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014

PB - Association for Computational Linguistics (ACL)

T2 - 14th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2014

Y2 - 26 April 2014 through 30 April 2014

ER -

Kirk NH, Zhang G, Groh G. Estimating Grammar Correctness for a Priori Estimation of Machine Translation Post-Editing Effort. In EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014. Association for Computational Linguistics (ACL). 2014. p. 16-21. (EACL 2014 - 14th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Workshop on Humans and Computer-assisted Translation, HaCaT 2014).

Estimating Grammar Correctness for a Priori Estimation of Machine Translation Post-Editing Effort

Abstract

Publication series

Conference

Other files and links

Fingerprint

Cite this