Schedule: 2009-09-11 (18:15 - 19:00)
Parallel Session 2 (Room A-34)

Title: On-line diagnostic language tests: testing design scenarios
Authors: Georgios Ypsilandis, Jozef Colpaert
Abstract: Electronic language testing has always been a considerable part of CALL from early WIDA to the more recent HOT POTATOES. In line with this, Chappelle and Douglas (2006) report that only in the years 1998-1999 most major publishing houses made at least one electronic test available. Although the majority of electronic tests offered today are designed to measure some type of student achievement or proficiency in language learning, recent publications are of the diagnostic type aiming to support the learning process itself rather than merely evaluating accomplishment, following the current general tendency in language pedagogy to focus on the learner and his/her needs.

This study aims to shed light on the mode of operation of diagnostic language tests that appear on the internet today and offer insights from a pilot study of an on-line diagnostic test designed for five languages. In particular, we look at design, structure, aims, typology of items, feedback provided, adaptive routine and final results of different tests located on the internet using key words such as ʽon-line diagnostic testsʼ on google.com. Based on this experience a new diagnostic scenario was created and a new diagnostic test was prepared and piloted.

Results are categorised in three major areas: a) those related to the scenario procedure, b) the test and screen design, c) the number of items selected for the test, d) usefulness of the feedback provided. More specifically, although subjects generally found the test useful, the scenario to be clear, user friendly and easy to follow, they indicated that the number of questions related to each screen and text (read or listened to) and the overall number of questions for the final result was too large to maintain high concentration throughout the test. Subsequently, from those reactions, amendments have been input and a final on-line diagnostic test has been designed to be tested in full length.
Keywords: Language testing, diagnostic language tests, on-line testing and assessment

Main topic: Assessment, testing, feedback and guidance in CALL

Biodata: Georgios Ypsilandis holds a BA in English Language and Literature from the Aristotle University of Thessaloniki and a Master's Degree and a Ph.D.in Applied Linguistics from the University of North Wales, Bangor and the Aristole Univeristy of Thessaloniki respectively.lectures at the Department of Italian Language and Literature at the Aristotle University of Thessaloniki (Greece). Jozef Colpaert is professor in eLearning, Instructional Design and CALL at the Institute for Education and Information Sciences at the University of Antwerp (Belgium), and director of the LINGUAPOLIS Language Institute. He is editor of the CALL Journal and organiser of the Antwerp CALL Research conferences.
Type of presentation Paper presentation

Paper category Research & Development

Target educational sector Higher education

Language of delivery English

EU-funded project No

Schedule:	2009-09-11 (18:15 - 19:00) Parallel Session 2 (Room A-34)
Title:	On-line diagnostic language tests: testing design scenarios
Authors:	Georgios Ypsilandis, Jozef Colpaert
Abstract:	Electronic language testing has always been a considerable part of CALL from early WIDA to the more recent HOT POTATOES. In line with this, Chappelle and Douglas (2006) report that only in the years 1998-1999 most major publishing houses made at least one electronic test available. Although the majority of electronic tests offered today are designed to measure some type of student achievement or proficiency in language learning, recent publications are of the diagnostic type aiming to support the learning process itself rather than merely evaluating accomplishment, following the current general tendency in language pedagogy to focus on the learner and his/her needs. This study aims to shed light on the mode of operation of diagnostic language tests that appear on the internet today and offer insights from a pilot study of an on-line diagnostic test designed for five languages. In particular, we look at design, structure, aims, typology of items, feedback provided, adaptive routine and final results of different tests located on the internet using key words such as ʽon-line diagnostic testsʼ on google.com. Based on this experience a new diagnostic scenario was created and a new diagnostic test was prepared and piloted. Results are categorised in three major areas: a) those related to the scenario procedure, b) the test and screen design, c) the number of items selected for the test, d) usefulness of the feedback provided. More specifically, although subjects generally found the test useful, the scenario to be clear, user friendly and easy to follow, they indicated that the number of questions related to each screen and text (read or listened to) and the overall number of questions for the final result was too large to maintain high concentration throughout the test. Subsequently, from those reactions, amendments have been input and a final on-line diagnostic test has been designed to be tested in full length.
Keywords:	Language testing, diagnostic language tests, on-line testing and assessment
Main topic:	Assessment, testing, feedback and guidance in CALL
Biodata:	Georgios Ypsilandis holds a BA in English Language and Literature from the Aristotle University of Thessaloniki and a Master's Degree and a Ph.D.in Applied Linguistics from the University of North Wales, Bangor and the Aristole Univeristy of Thessaloniki respectively.lectures at the Department of Italian Language and Literature at the Aristotle University of Thessaloniki (Greece). Jozef Colpaert is professor in eLearning, Instructional Design and CALL at the Institute for Education and Information Sciences at the University of Antwerp (Belgium), and director of the LINGUAPOLIS Language Institute. He is editor of the CALL Journal and organiser of the Antwerp CALL Research conferences.
Type of presentation	Paper presentation
Paper category	Research & Development
Target educational sector	Higher education
Language of delivery	English
EU-funded project	No