1 0 0 0 OA 読解力測定としての英文和訳の信頼性・妥当性
- 著者
- 卯城 祐司 土方 裕子 清水 真紀 院南 洋 笠原 究 下田 彰子 溝下 肇 佐藤 臨太郎
- 出版者
- 全国英語教育学会
- 雑誌
- ARELE : annual review of English language education in Japan (ISSN:13448560)
- 巻号頁・発行日
- vol.16, pp.71-80, 2005-03
A translation test is one of the most common reading test methods in Japan, although its reliability and validity have been quite controversial. This study investigated the reliability and validity of translation tests as a measure of reading comprehension in Japanese university entrance examinations, with a particular focus on two research questions: (a) In terms of reliability, what types of translation materials cause difference in rating severity? (b) In terms of validity, what types of sentence can make great differences between translation and comprehension tasks? In order to examine the first research question, four experienced teachers scored English-to-Japanese translations made by 102 university students. Results showed that rating divergence is attributable to raters' different points of scoring (holistic vs. partial), and raters' leniency for inappropriate Japanese expressions or careless mistakes. The second research question was examined by administering 18 sets of translation and reading comprehension tasks to the same participants as above. Results showed that 4 out of 18 English sentences used in Japanese university entrance examinations were considered to be inappropriate as materials for translation tasks when examinees' reading comprehension was intended to be measured.
1 0 0 0 OA 筆記再生課題における検索手がかりと読解熟達度の関係
- 著者
- 卯城 祐司 土方 裕子 清水 真紀 中川 知佳子 古賀 功 大野 真澄 梅原 愛
- 出版者
- 全国英語教育学会
- 雑誌
- ARELE : annual review of English language education in Japan (ISSN:13448560)
- 巻号頁・発行日
- vol.18, pp.31-40, 2007-03
A recall test is useful in that the test score is not affected by question items; however, this test is frequently criticized as being simply a memory test that does not measure pure reading comprehension. Although retrieval cues are sometimes provided to readers in order to decrease the effects of the memory load, it is unclear how these cues are related to the ideas recalled. The aim of this study is to examine what types of retrieval cues can promote recall performance of Japanese EFL learners. In Experiment 1, we investigated the relationship between learners' L2 reading proficiency and the importance level of recalled ideas. In Experiment 2, we examined the effects of cue types on recall tests. In addition, the results of three types of recall tests - free recall, recall with main cues, and recall with detailed cues - were compared in order to elucidate the validity of cued recall tests. The results showed that retrieval cues did not promote recall performance. Moreover, we found that cued recall tests had lower correlations with L2 reading proficiency scores than free recall tests, which indicates that retrieval cues reduced the concurrent validity.
- 著者
- 卯城 祐司 中川 知佳子 森本 由子 土方 裕子 渡邊 芙裕美 甲斐 あかり
- 出版者
- 全国英語教育学会
- 雑誌
- ARELE : annual review of English language education in Japan (ISSN:13448560)
- 巻号頁・発行日
- vol.19, pp.201-210, 2008-03
There has been much research conducted to compare open-ended and multiple-choice tests from the viewpoints of construct and difficulty. However, almost no studies have examined the effects of question types in relation to test formats. Through two experiments, this study investigated how question types influence the difficulty of these two test formats. The results of Experiment 1 showed that question types affected item difficulty in open-ended tests; more specifically, thematic questions were the most difficult, followed by inference questions, and paraphrase questions were the easiest. In contrast, the result of Experiment 2, in which the same tests were conducted in the multiple-choice test format, revealed that item difficulty did not differ significantly by question type. In addition, we found that predictability of the results of the multiple-choice test was low compared to the open-ended test. Comparison of these two experiments suggested the importance of choice in the multiple-choice test. Close examination of choices indicated that overlap of words in correct choices and the text influenced the item difficulty.