«NOV DEC MAR » 8 2017 2018 2019 4 captures 6 Oct 18 - 9 Mar 19

Close Help

Patricia Martinkova

• Welcome
• Research
• Teaching
• Publications
• CV
• Office address
  Pod Vodarenskou vezi 2
  182 07, Praha 8, Czech Republic
  phone: +420 26605 3400
  e-mail: martinkova@cs.cas.cz

NMST 570 Selected topics in psychometrics
(Vybraná témata z psychometrie)

Tuesday 3:40PM - 5:10PM, room K4, Faculty of Mathematics and Physics, Charles University, Sokolovská 83, Praha 2.
Course description in English.
Anotace předmětu v češtině.
Course goals
This is ARCHIVE. Go to pages of current semester.

News
(Jan 18, 2018) Course has been concluded for winter semester 2017/2018.
(Nov 11, 2017) There will be no class on Dec 5. Makeup class will take place on Dec 12 in K4.
(Oct 16, 2017) Room has been changed to K4.
(Oct 10, 2017) Welcome to NMST570!

Lesson 1 (Tue Oct 10, 2017): Introduction

• Slides (In Czech)
• Exercises html, pdf (In Czech)
  
• Suggested reading:
  [1] Martinková P, Drabinová A, Houdek J. ShinyItemAnalysis: Analýza přijímacích a jiných znalostních či psychologických testů (ShinyItemAnalysis: Analyzing admission and other educational and psychological tests. In Czech.) Testfórum, no. 9, pp.16-35, 2017.
  [2] Martinková P, Štěpánek L, et al. Semi-real-time analyses of item characteristics for medical school admission tests. Proceedings of FedCSIS 2017, pages 189–194, 2017.
  

Lesson 2 (Tue Oct 24, 2017): Development and validation of assessments

• Slides (In Czech)
• Reading assignment html, pdf (In Czech)
  Suggested reading:
  [1] McFarland JL, Price RM, Wenderoth MP, Martinková P, et al. Development and validation of the Homeostasis Concept Inventory. CBE Life Sciences Education, Vol. 16 no. 2 ar35, 2017.
  [2] McFarland JL, Wenderoth MP, et al. A conceptual framework for homeostasis: development and validation. Advances in Physiology Education, Vol. 40 no. 2, pp. 213-222, 2016.
  Extra reading:
  [3] Rasova K, Martinkova P, et al. Assessment set for evaluation of clinical outcomes in multiple sclerosis: psychometric properties. Patient Related Outcome Measures, Vol. 3, pp. 59-70, 2012.
  [4] Michael J, Martinková P, et al. Validating a conceptual framework for the core concept of “cell-cell communications”. Advances in Physiology Education, Vol. 41 no. 2, pp. 260-265, 2017.
  
• Exercises html, pdf
  Data HCI_ABCD.csv, HCI_key.csv, HCI_group.csv,
  R code HCI_RcodeSupplement.R
  Data dataHCI.RData, dataGrads.RData, dataPrePost.RData, dataTestretest.RData
  

Lesson 3 (Tue Nov 7, 2017): From traditional item analysis to IRT models

• Slides
• Concepts: see ShinyItemAnalysis application, sections Item Analysis, Regression, IRT models
• Exercises (cont. of Lesson 2) html, pdf
• Assignment (DUE: Nov 19): send your report (see Excercises, part 9) using either your own data or HCI data
• Suggested reading:
  [1] Martinková P, Drabinová A, Houdek J. ShinyItemAnalysis: Analýza přijímacích a jiných znalostních či psychologických testů (ShinyItemAnalysis: Analyzing admission and other educational and psychological tests. In Czech.) Testfórum, no. 9, pp.16-35, 2017.
  [2] McFarland JL, Price RM, Wenderoth MP, Martinková P, et al. Development and validation of the Homeostasis Concept Inventory. CBE Life Sciences Education, Vol. 16 no. 2 ar35, 2017.
  

Lesson 4 (Tue Nov 21, 2017): IRT models for binary response data

• Slides
• Exercises: html
• Suggested reading:
  [1] Harris, D. (1989). Comparison- of 1-, 2-, and 3-Parameter IKT Models.
  

Lesson 5 (Tue Dec 12, 2017): Differential item functioning

• Slides
• Exercises html, pdf
  
• Suggested reading:
  [1] Martinková P, Drabinová A, Liaw Y-L, Sanders EA, McFarland JL, Price RM. Checking equity: Why DIF analysis should be a routine part of developing conceptual assessments. CBE Life Sciences Education, vol. 16 no. 2 rm2, 2017.
  [2] Drabinová A, Martinková P. Detection of Differential Item Functioning with Non-Linear Regression: Non-IRT Approach Accounting for Guessing. Journal of Educational Measurement, 54(4), pp. 498-517, 2017.

Lesson 6 (Tue Dec 19, 2017): Reliability

• Slides
• Suggested reading:
  [1] Martinková P, Vlčková K. Hodnocení reliability znalostních a psychologických testů. (Estimation of Reliability of Educational and Psychological Measurements. In Czech.) Informační bulletin České statistické společnosti, 4, pp. 1-15, 2014.
  Accompanying R code
  [2] Martinková P, Zvára K. Reliability in the Rasch Model. Kybernetika, 43(3), pp. 315-26, 2007.
  [3] Martinková P, Goldhaber D. Improving Teacher Selection: The Effect of Inter-Rater Reliability in the Screening Process. CEDR Working Paper 2015-7. University of Washington, Seattle, WA.

Lesson 7 (Tue Jan 9, 2017): Computerized Adaptive Testing

• Slides
• Exercises
• Suggested reading:
  [1] Magis D, & Raichle G. (2012). Random Generation of Response Patterns under Computerized Adaptive Testing with the R Package catR. Journal of Statistical Software, 48, pp. 1-31. https://www.jstatsoft.org/article/view/v048i08
  [2] Chalmers P. (2016). Generating Adaptive and Non-Adaptive Test Interfaces for Multidimensional Item Response Theory Applications. Journal of Statistical Software, 71, pp. 1-38. https://www.jstatsoft.org/article/view/v071i05
  

Software

• R
• Psychometric libraries in R
• Martinková P, Drabinová A, et al. ShinyItemAnalysis: Test and Item Analysis via Shiny (online application). ShinyItemAnalysis R package version 1.2.3.

© 2015 Patrícia Martinková / Template design adapted from Andreas Viklund