Universität Wien

120004 SE MEd 03: SE Applied Research Seminar (2025S)

Language test development and validation: research perspectives

4.00 ECTS (2.00 SWS), SPL 12 - Anglistik
Continuous assessment of course work
Moodle
Th 26.06. 18:15-19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13

Registration/Deregistration

Note: The time of your registration within the registration period has no effect on the allocation of places (no first come, first served).

Details

max. 20 participants
Language: English

Lecturers

Classes (iCal) - next class is marked with N

  • Thursday 06.03. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13
  • Thursday 13.03. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13
  • Thursday 20.03. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13
  • Thursday 27.03. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13
  • Thursday 03.04. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13
  • Thursday 10.04. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13
  • Thursday 08.05. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13
  • Thursday 15.05. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13
  • Thursday 22.05. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13
  • Thursday 05.06. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13
  • Thursday 12.06. 18:15 - 19:45 Raum 3 Anglistik UniCampus Hof 8 3E-EG-13

Information

Aims, contents and method of the course

Aims and contents of the course:
Well-designed classroom tests (e.g., Schularbeiten) are essential for teachers to accurately measure student achievement and progress, as well as to make informed decisions about teaching and learning. This course is designed to familiarize students with models of language test development covering, for example, test development, construction, administration, marking, score reporting and reviewing. At each phase in the cycle, different methods of research can be implemented to ensure test usefulness (validity, reliability, impact and practicality). In the empirical part of the course, students will work with different types of data (e.g. response, performance, rating data) and explore, to varying degrees, aspects of quantitative analysis (e.g. classical test theory, reliability, item response theory) and qualitative or mixed-method analysis (e.g. content analysis, introspection, discourse analytical methods).

The major aims are to
• develop an understanding of different approaches to test development and validation
• become acquainted with some research methods associated with language test development and validation
• learn to think carefully about research design and data collection/analysis
• help students develop and pursue their own research questions in the field

Methods:
Individual/pair/group work, discussion of readings, mini lectures/input, group presentations, critical reflection on and evaluation of data and pertinent literature

Assessment and permitted materials

Assessment will be based on continuous assessment (classwork/homework), individual graded assignments and a group presentation.

Minimum requirements and assessment criteria

Regular attendance (max. 2 absences)

1. Participation, synchronous and asynchronous tasks in Moodle - 20%
2. Individual graded assignments - 40%
3. Mini research project, presentation and discussion, report - 40%
Two of the three parts as well as the overall score must be positive.

Grading scale: 1 (sehr gut) 100-90%; 2 (gut) 89-80%; 3 (befriedigend), 79-70%; 4 (genügend) 69-60%; 5 (nicht genügend) 59-0%.

Examination topics

Continuous assessment based on what is covered in the course (see Ziele, Inhalte und Methode/course schedule). Details on assignments given in class and on Moodle.

Reading list

Handouts and reading texts will be made available on Moodle. In addition to the reading recommended in the course, students are expected to do their own literature searches on specific topics.

Bachman, Lyle F.; Palmer, Adrian S. 2010. Language assessment in practice. Oxford: Oxford University Press.
Carr, Nathan T. 2011. Designing and analysing language tests. Oxford: Oxford University Press.
Green, Rita. 2013. Statistical analyses for language testers. Houndsmills: Palgrave Macmillan.
Moeller, Aleidine J.; Creswell, John W.; Saville, Nick (eds.). 2016. Second language assessment and mixed methods research. Cambridge: Cambridge University Press.

Association in the course directory

Studium: MEd 046/507
Code/Modul: MEd 03
Lehrinhalt: 12-4830

Last modified: Mo 03.03.2025 09:06