(controlled by PSELECT=, ISELECT=, PSUBTOTAL=)

 

AGREEFILE= reports the paired-person information underlying Table 35. Use PSELECT= and ISELECT= to choose subsets to compare for agreement. Sub-samples (groups of persons) can be specified with PSUBTOTAL=. Only pairs in the same groups are shown if AGREEGROUP=Yes.

 

AGREEFILE=? opens a Browse window.

 

When AGREEFILE= is launched from the Output Files menu, the AGREEFILE= dialog box displays.

 

Contents of AGREEFILE=

 

 

; AGREEMENT FILE FOR An MCQ Test: administration was Computer-Adaptive ISELECT=* PSELECT=* AGREEGROUP=Y

  TWOOBS TWOSAME TWOSCOR ONEHIGH TWOHIGH  ONELOW  TWOLOW ONEMISS TWOMISS MEASURE MEASURE AVERAGE T35.1 T35.2 T35.3 T35.4 T35.5 STUDEN1 STUDEN2 P-LABEL P-LABEL2

       9       7       8       5       4       5       3      60      33     .40     .44     .42  77.8  88.9  80.0  60.0  55.0       1       7 IM  CAT IH  JAN

       9       7       7       6       4       5       3      60      24     .40    -.96    -.28  77.8  77.8  66.7  60.0  40.0       1       8 IM  CAT IL  ROB

       7       3       4       5       2       5       1      62      35     .40    -.05     .18  42.9  57.1  40.0  20.0  56.5       1      14 IM  CAT IL  TAK

 

 

Field

Columns

Description

TWOOBS

1-8

count of items for which both persons have non-missing observations

TWOSAME

9-16

count of items for which both persons have the same non-missing observations

TWOSCORE

17-24

count of items for which both persons have non-missing observations scored the same

ONEHIGH

25-32

count of items for which one or both persons have non-missing observations scored in the highest (correct) category

TWOHIGH

33-40

count of items for which both persons have the same non-missing observations scored in the highest (correct) category

ONELOW

41-48

count of items for which one or both persons have non-missing observations scored in the lowest (wrong) category

TWOLOW

49-56

count of items for which both persons have the same non-missing observations scored in the lowest (wrong) category

ONEMISS

57-64

count of items for which one or both persons have a missing observation

TWOMISS

65-72

count of items for which both persons have missing observations

MEASURE(1)

73-80

person ability measure for first person

MEASURE(2)

81-88

person ability measure for second person

AVERAGE

89-96

average person ability of the two persons: Table 35 x-axis measure

T35.1

97-102

Table 35.1 y-axis percent = % Same (Paired Kid) Observed Responses

T35.2

103-108

Table 35.2 y-axis percent = % Same (Paired Kid) Scored Responses

T35.3

109-114

Table 35.3 y-axis percent = % Same (Paired Kid) Observed Highest (Right) Responses

T35.4

115-120

Table 35.4 y-axis percent = % Same (Paired Kid) Observed Lowest (Wrong) Responses

T35.5

121-126

Table 35.5 y-axis percent = % Same (Paired Kid) Missing Responses when either person has a Missing Response

PERSON(1)

127-134

person entry number for first person

PERSON(2)

135-142

person entry number for second person

P-LABEL(1)

143-....(length of longest person label)

person label for first person

P-LABEL(2)

(one blank, then) ...-....

person label for second person

 

Example 1: an MCQ test with 60 questions, scored 1, 0. One person answered questions 1-40 and the other answered 10-50. They were scored 1-1  on 10 items, 1-0 on 8 items, 0-1 on 5 items, 0-0 on 8 items = 31 items.

 

TWOOBS: both students must be observed on the item. They were both observed on items 10-40, so that 31 will appear here.

 

TWOSAME: counts of items to which both students made the same response. There was only one correct response to each item, so SAME = 10 (1-1) correct answers + 2 (out of 8 0-0) incorrect same choice of distractors = 12.

 

TWOSCORE: the count of items on which they scored the same (for a dichotomy, both correct or both incorrect). They made the SAME score on 10 (1-1) + 8 (0-0) = 18.

 

ONEHIGH: one or both persons scored in the highest category, "1", in 10+8+5 = 23 items. The "highest" category is the highest score possible on each item, for dichotomies usually scored 1. For Likert rating scales, the high category is usually scored 5.

 

TWOHIGH: 10 pairs of responses are in the highest category (1-1).

 

ONELOW: one or both persons score in the lowest category, "0", in 8+5+8 = 21 items. The "lowest" category is the lowest score possible on each item, for dichotomies usually scored 0. For Likert rating scales, the low category is usually scored 1.

 

TWOLOW: 8 pairs of responses are in the lowest category (0-0).

 

ONEMISS: there are 60 questions, the both responded to 31, so one or other or both students had missing data on ONEMISS = 60 - 31 = 29 items.

 

TWOMISS: items 51-60 were missing for both students. TWOMISS = 10.


Help for Winsteps Rasch Measurement Software: www.winsteps.com. Author: John Michael Linacre

For more information, contact info@winsteps.com or use the Contact Form
 

Facets Rasch measurement software. Buy for $149. & site licenses. Freeware student/evaluation download
Winsteps Rasch measurement software. Buy for $149. & site licenses. Freeware student/evaluation download

State-of-the-art : single-user and site licenses : free student/evaluation versions : download immediately : instructional PDFs : user forum : assistance by email : bugs fixed fast : free update eligibility : backwards compatible : money back if not satisfied
 
Rasch, Winsteps, Facets online Tutorials

 

Forum Rasch Measurement Forum to discuss any Rasch-related topic

Click here to add your email address to the Winsteps and Facets email list for notifications.

Click here to ask a question or make a suggestion about Winsteps and Facets software.

Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement with Raters and Rating Scales: Rasch Models for Rater-Mediated Assessments, George Engelhard, Jr. & Stefanie Wind Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez
Winsteps Tutorials Facets Tutorials Rasch Discussion Groups

 


 

 
Coming Rasch-related Events
Jan. 5 - Feb. 2, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 10-16, 2018, Wed.-Tues. In-person workshop: Advanced Course in Rasch Measurement Theory and the application of RUMM2030, Perth, Australia (D. Andrich), Announcement
Jan. 17-19, 2018, Wed.-Fri. Rasch Conference: Seventh International Conference on Probabilistic Models for Measurement, Matilda Bay Club, Perth, Australia, Website
Jan. 22-24, 2018, Mon-Wed. In-person workshop: Rasch Measurement for Everybody en español (A. Tristan, Winsteps), San Luis Potosi, Mexico. www.ieia.com.mx
April 10-12, 2018, Tues.-Thurs. Rasch Conference: IOMW, New York, NY, www.iomw.org
April 13-17, 2018, Fri.-Tues. AERA, New York, NY, www.aera.net
May 22 - 24, 2018, Tues.-Thur. EALTA 2018 pre-conference workshop (Introduction to Rasch measurement using WINSTEPS and FACETS, Thomas Eckes & Frank Weiss-Motz), https://ealta2018.testdaf.de
May 25 - June 22, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 27 - 29, 2018, Wed.-Fri. Measurement at the Crossroads: History, philosophy and sociology of measurement, Paris, France., https://measurement2018.sciencesconf.org
June 29 - July 27, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
July 25 - July 27, 2018, Wed.-Fri. Pacific-Rim Objective Measurement Symposium (PROMS), (Preconference workshops July 23-24, 2018) Fudan University, Shanghai, China "Applying Rasch Measurement in Language Assessment and across the Human Sciences" www.promsociety.org
Aug. 10 - Sept. 7, 2018, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Sept. 3 - 6, 2018, Mon.-Thurs. IMEKO World Congress, Belfast, Northern Ireland www.imeko2018.org
Oct. 12 - Nov. 9, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com

 

 

Our current URL is www.winsteps.com

Winsteps® is a registered trademark
 


 
Concerned about aches, pains, youthfulness? Mike and Jenny suggest Liquid Biocell