See in Reader
8.4 KiB
Self-assessment of Translation Quality
The objective of this section is to describe a process by which the Church can reliably determine for themselves the quality of a translation. This following assessment is intended to suggest some of the most important techniques for checking a translation, rather than to describe every conceivable check that could be employed. Ultimately, the decision of what checks are used, when, and by whom should be made by the Church.
How to Use the Assessment
This assessment method employs two types of statements. Some are "yes/no" statements where a negative response indicates a problem that must be resolved. Other sections use an equally-weighted method that provides translation teams and checkers with statements about the translation. Each statement should be scored by the person doing the check (beginning with the translation team) on a scale of 0-2:
0 - disagree
1 - agree somewhat
2 - strongly agree
At the end of the review, the total value of all responses in a section should be added up and, if the responses accurately reflect the state of the translation, this value will provide the reviewer with an approximation of the probability that the translated chapter is of excellent quality. The rubric is designed to be simple and provide the reviewer with an objective method to assess where the work needs improvement. For example, if the translation scores relatively well in "Accuracy" but quite poorly in "Naturalness" and "Clarity," then the translation team needs to do more community checking.
The rubric is intended to be used for each chapter of translated biblical content. The translation team should do an assessment of each chapter after they finish their other checks, and then the level 2 church checkers should do it again, and then the level 3 checkers should also assess the translation with this checklist. As more detailed and extensive checking of the chapter is performed by the Church at each level, the points for the chapter should be updated from each of the first four sections (overview, naturalness, clarity, accuracy), allowing the church and community to see how the translation is improving.
The Self-Assessment
The process is divided into five parts: the overview (information about the translation itself), naturalness, clarity, accuracy, and Church approval.
1. Overview
Circle either "no" or "yes" for each statement below.
no | yes This translation is a meaning-based translation that attempts to communicate the meaning of the original text in ways that are natural, clear, and accurate in the target language.
no | yes Those involved in checking the translation are first-language speakers of the target language.
no | yes The translation of this chapter is in agreement with the Statement of Faith.
no | yes The translation of this chapter has been done in accordance with the Translation Guidelines.
2. Naturalness: "this is my language"
Circle either "0" or "1" or "2" for each statement below.
This section can be strengthened through doing more community checking. (See Language Community Check)
0 1 2 Those who speak this language and have heard this chapter agree that it is translated using the correct form of the language.
0 1 2 Those who speak this language agree that the key words used in this chapter are acceptable and correct for this culture.
0 1 2 The illustrations or stories in this chapter are easy for people who speak this language to understand.
0 1 2 Those who speak this language agree that the sentence structure and order of the text in this chapter is natural and flows correctly.
0 1 2 The review of the translation of this chapter for naturalness included community members who have not been directly involved in creating the translation of this chapter.
0 1 2 The review of the translation of this chapter for naturalness included both believers and non-believers, or at least believers who are relatively unfamiliar with the Bible so that they do not know what the text is supposed to say before they hear it.
0 1 2 The review of the translation of this chapter for naturalness included speakers of the language from many different age groups.
0 1 2 The review of the translation of this chapter for naturalness included both men and women.
3. Clarity: "the meaning is clear"
Circle either "0" or "1" or "2" for each statement below.
This section can be strengthened through doing more community checking. (See Language Community Check)
0 1 2 This chapter is translated using language that native speakers of the language agree is easy to understand.
0 1 2 Speakers of this language agree that the translations of names, places, and verb tenses are all correct in this chapter.
0 1 2 Figures of speech in this chapter make sense for people in this culture.
0 1 2 Speakers of this language agree that the way this chapter is structured does not distract from the meaning.
0 1 2 The review of the translation of this chapter for clarity included community members who have not been directly involved in creating the translation of this chapter.
0 1 2 The review of the translation of this chapter for clarity included both believers and non-believers, or at least believers who are relatively unfamiliar with the Bible so that they do not know what the text is supposed to say before they hear it.
0 1 2 The review of the translation of this chapter for clarity included speakers of the language from many different age groups.
0 1 2 The review of the translation of this chapter for clarity included both men and women.
4. Accuracy: "the translation communicates what the original source text communicated"
Circle either "0" or "1" or "2" for each statement below.
This section can be strengthened through doing more accuracy checking. (See Accuracy Check)
0 1 2 A complete list of all important words in the source text for this chapter has been used to help ensure all terms are present in the translation.
0 1 2 All important words are translated correctly in this chapter.
0 1 2 All important words are translated consistently in this chapter, as well as in other places where the important words appear.
0 1 2 Exegetical resources have been used for the entire chapter to identify and resolve potential translation challenges, including the Notes and translationWords.
0 1 2 Historical details in the source text (like names, places, and events) have been preserved in the translation.
0 1 2 The meaning of each figure of speech in the translated chapter has been compared and aligned to the intent of the original.
0 1 2 The translation has been tested with native speakers who were not involved in creating the translation and they agree that the translation accurately communicates the intended meaning of the source text.
0 1 2 The translation of this chapter has been compared against at least two source texts.
0 1 2 All questions or disagreements about any of the meaning in this chapter have been resolved.
0 1 2 The translation of this chapter has been compared against the original texts (Hebrew, Greek, Aramaic) to check for correct lexical definitions and intent of the original texts.
5. Church approval: "the naturalness, clarity, and accuracy of the translation is approved by the Church that speaks that language"
Circle either "0" or "1" or "2" for each statement below.
no | yes Church leaders who have checked this translation are native speakers of the target language, and include someone who understands well one of the languages in which the source text is available.
no | yes People from the language community, both men and women, old and young, have reviewed the translation of this chapter and agree that it is natural and clear. (Note: this addresses the first part of the community check for Level 2.)
no | yes Church leaders from at least two different church networks have reviewed the translation of this chapter and agree that it is accurate. (This addresses the final aspect of Level 2, the Church check).
no | yes The leadership or their delegates of at least two different church networks have reviewed the translation of this chapter and endorse it as a faithful translation of this chapter of the Bible in this language. (This addresses Level 3.)