LANGUAGE TESTING AND EVALUATION 10 GÁBOR SZABÓ Applying Item Response Theory in Language 197 PAGES

[LANGUAGE TESTING AND EVALUATION 10] GÁBOR SZABÓ Applying Item Response Theory in Language Test Item Bank Building 197 PAGES Language Testing and Evaluation Series editors: Rüdiger Grotjahn and Günther Sigott Volume 10 PETER LANG Frankfurt am Main • Berlin • Bern • Bruxelles • New York • Oxford • Wien Gäbor Szabö Applying Item Response Theory in Language Test Item Bank Building PETER LANG Internationaler Verlag der Wissenschaften Bibliographic Information published by the Deutsche Nationalbibliothek The Deutsche Nationalbibliothek Iists this publication in the Deutsche Nationalbibliografie; detailed bibliographic data is available in the Internet at . ISSN 1612-815X ISBN 978-3-631-56851-4 © Peter Lang GmbH Internationaler Verlag der Wissenschaften Frankfurt am Main 2008 All rights reserved. All parts of this publication are protected by copyright. Any utilisation outside the strict limits of the copyright Iaw, without the permission of the publisher, is forbidden and liable to prosecution. This applies in particular to reproductions, translations, microfilming, and storage and processing in electronic retrieval systems. Printed in Germany 1 2 3 4 5 7 www.peterlang.de To Marianna and Dalma Table of contents Acknowledgements 9 Introduction 11 1. Measurement Theory 13 1.1. General Concerns 13 1.2. Educational Measurement 15 1.3. Classical Test Theory 17 1.3.1. The True Score Model 17 1.3.2. Reliability 19 1.3.3. Validity 23 1.3.4. Traditional Item and Person Statistics 29 1.3.5. Summary 39 1.4. Item Response Theory (IRT) 40 1.4.1. Central Concepts 40 1.4.2. IRT Assumptions 44 1.4.3. IRT Models 46 1.4.3.1. The One-Parameter Logistic Model—The Rasch Model 47 1.4.3.2. The Two-Parameter Logistic Model 48 1.4.3.3. The Three-Parameter Logistic Model 49 1.4.4. Estimation of Item Difficulty and Person Ability 52 1.4.5. Model-Data Fit Statistics 53 1.4.6. Practical Applications of IRT Models 56 1.4.7. Problems with IRT 60 1.4.8. Summary 63 1.5. Applications of Measurement Theory in Language Testing 64 1.5.1. Classical Test Theory in Language Testing 65 1.5.2. Item Response Theory in Language Testing 67 2. Building a Language Testing Item Bank at UP 73 2.1. Background 73 2.2. Research Questions 74 2.3. Stages of Development 75 2.3.1. The Beginnings 75 2.3.1.1. Specifications 76 2.3.1.2. Structural Buildup 77 2.3.2. Modifications 84 2.3.3. Evaluation 86 7 2.4. Stages of Moderation 89 2.4.1. Piloting 89 2.4.2. Applying Classical Test Analysis 91 2.5. Building an Item Bank 99 2.5.1. Applying the Rasch Model 100 2.5.2. Anchoring and Item Calibration 104 2.5.3. Item and Person Fit 117 2.5.4. Data Management 132 2.5.5. Limitations 135 2.6. Taking Stock and Looking Ahead 139 2.6.1. Lessons to Learn 140 2.6.2. Into the Future 142 2.7. Using the UP Data in Further Empirical Research 145 2.7.1. Stating the problem 145 2.7.2. Research design 147 2.7.3. Results 149 2.7.4. Implications 154 2.7.5. Conclusion 156 Conclusions 159 References 161 Index 173 List of figures and tables 179 Appendices 181 8 Acknowledgements I would like to thank Marianne Nikolov and Jözsef Horväth, my colleagues for their support and invaluable comments an earlier drafts of this book. Their contribution is greatly appreciated. I also wish to thank Charles Al...

Buy now to view the complete solution

Attachment

• [LANGUAGE TESTING AND EVALUATION 10] GÁBOR SZABÓ Applying Item Response Theory in Language Test Item Bank Building.pdf (10 MB)