Translation quality evaluation: Empirical evidence for a functionalist approach

Research output: Contribution to journalArticle

34 Citations (Scopus)

Abstract

Following a review of existing approaches to translation quality evaluation, this paper describes a proposal for evaluation that addresses some of the deficiencies found in these models. The proposed approach is referred to as componential because it evaluates components of quality separately, and functionalist, because evaluation is carried out relative to the function specified for the translated text. In order to obtain some empirical evidence for the functionalist/componential approach, a tool was developed and pilot-tested for inter-rater reliability. In addition, the research project sought to obtain some data on qualifications of raters/users and their performance using the tool. Forty raters were asked to use the tool to rate three translated texts. The texts selected for evaluation consisted of reader-oriented health education materials. Raters were bilinguals, professional translators and language teachers. Some basic training was provided. Data was collected by means of the tool and a questionnaire. Results indicate good inter rater reliability for the tool; teachers' and translators' ratings were more alike than those of bilinguals; bilinguals were found to rate higher and faster than the other groups. The results provide support for further research and testing of this tool and offer evidence in favour of the approach proposed.

Original languageEnglish (US)
Pages (from-to)97-134
Number of pages38
JournalTranslator
Volume14
Issue number1
StatePublished - 2008

Fingerprint

evaluation
evidence
translator
teacher
health promotion
qualification
Functionalist
Evaluation
Empirical Evidence
research project
Education
rating
Health
questionnaire
Testing
language
performance
Raters
Group
Interrater Reliability

Keywords

  • Assessment
  • Componential approach
  • Errors
  • Evaluation
  • Functionalism
  • Quality
  • Rating
  • Translation

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language
  • Communication

Cite this

Translation quality evaluation : Empirical evidence for a functionalist approach. / Colina, Sonia -.

In: Translator, Vol. 14, No. 1, 2008, p. 97-134.

Research output: Contribution to journalArticle

@article{a6f824e6448a4d5f9e006d52b2ab4cc0,
title = "Translation quality evaluation: Empirical evidence for a functionalist approach",
abstract = "Following a review of existing approaches to translation quality evaluation, this paper describes a proposal for evaluation that addresses some of the deficiencies found in these models. The proposed approach is referred to as componential because it evaluates components of quality separately, and functionalist, because evaluation is carried out relative to the function specified for the translated text. In order to obtain some empirical evidence for the functionalist/componential approach, a tool was developed and pilot-tested for inter-rater reliability. In addition, the research project sought to obtain some data on qualifications of raters/users and their performance using the tool. Forty raters were asked to use the tool to rate three translated texts. The texts selected for evaluation consisted of reader-oriented health education materials. Raters were bilinguals, professional translators and language teachers. Some basic training was provided. Data was collected by means of the tool and a questionnaire. Results indicate good inter rater reliability for the tool; teachers' and translators' ratings were more alike than those of bilinguals; bilinguals were found to rate higher and faster than the other groups. The results provide support for further research and testing of this tool and offer evidence in favour of the approach proposed.",
keywords = "Assessment, Componential approach, Errors, Evaluation, Functionalism, Quality, Rating, Translation",
author = "Colina, {Sonia -}",
year = "2008",
language = "English (US)",
volume = "14",
pages = "97--134",
journal = "Translator",
issn = "1355-6509",
publisher = "St. Jerome Publishing",
number = "1",

}

TY - JOUR

T1 - Translation quality evaluation

T2 - Empirical evidence for a functionalist approach

AU - Colina, Sonia -

PY - 2008

Y1 - 2008

N2 - Following a review of existing approaches to translation quality evaluation, this paper describes a proposal for evaluation that addresses some of the deficiencies found in these models. The proposed approach is referred to as componential because it evaluates components of quality separately, and functionalist, because evaluation is carried out relative to the function specified for the translated text. In order to obtain some empirical evidence for the functionalist/componential approach, a tool was developed and pilot-tested for inter-rater reliability. In addition, the research project sought to obtain some data on qualifications of raters/users and their performance using the tool. Forty raters were asked to use the tool to rate three translated texts. The texts selected for evaluation consisted of reader-oriented health education materials. Raters were bilinguals, professional translators and language teachers. Some basic training was provided. Data was collected by means of the tool and a questionnaire. Results indicate good inter rater reliability for the tool; teachers' and translators' ratings were more alike than those of bilinguals; bilinguals were found to rate higher and faster than the other groups. The results provide support for further research and testing of this tool and offer evidence in favour of the approach proposed.

AB - Following a review of existing approaches to translation quality evaluation, this paper describes a proposal for evaluation that addresses some of the deficiencies found in these models. The proposed approach is referred to as componential because it evaluates components of quality separately, and functionalist, because evaluation is carried out relative to the function specified for the translated text. In order to obtain some empirical evidence for the functionalist/componential approach, a tool was developed and pilot-tested for inter-rater reliability. In addition, the research project sought to obtain some data on qualifications of raters/users and their performance using the tool. Forty raters were asked to use the tool to rate three translated texts. The texts selected for evaluation consisted of reader-oriented health education materials. Raters were bilinguals, professional translators and language teachers. Some basic training was provided. Data was collected by means of the tool and a questionnaire. Results indicate good inter rater reliability for the tool; teachers' and translators' ratings were more alike than those of bilinguals; bilinguals were found to rate higher and faster than the other groups. The results provide support for further research and testing of this tool and offer evidence in favour of the approach proposed.

KW - Assessment

KW - Componential approach

KW - Errors

KW - Evaluation

KW - Functionalism

KW - Quality

KW - Rating

KW - Translation

UR - http://www.scopus.com/inward/record.url?scp=54049138838&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=54049138838&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:54049138838

VL - 14

SP - 97

EP - 134

JO - Translator

JF - Translator

SN - 1355-6509

IS - 1

ER -