Example 14: Multiple rescorings for response structures with differing response widths |
Introductory example: A test has 30 multiple choice question (keyed A, B, C, D) and 5 essay questions, each has its own rating scale definition (scored 0, 1, or 2), i.e., they accord with the partial credit model. ISGROUPS= is used to identify the partial credit items. IREFER= and IVALUE= are used for scoring the questions
; This control file is EXAM14.TXT
TITLE = "AN EXAMPLE OF MULTIPLE ITEM TYPES"
; THIS PART DEFINES THE ANALYTICAL MODEL
; MCQ ARE ONE GROUPING, WHICH WE WILL CALL "M" - PARTIAL CREDIT ITEMS ARE GROUPED AS "0"
; "0" MEANS EACH ITEM IS IN A GROUPING BY ITSELF, i.e., partial credit
ISGROUPS = MMMMMMMMMMMMMMMMMMMMMMMMMMMMMM00000
; THIS PART DEFINES THE RESPONSE SCORING
; The MCQ key is: ABCAAACBAAABABABBAAABABBAAABAB
IREFER = ABCAAACBAAABABABBAAABABBAAABAB00000 ; REFERENCE THE MCQ ITEMS BY THEIR SCORING KEY
CODES = ABCD012; ALL VALID CODES IN THE DATA FILE
IVALUE0= 0000012; THESE ARE THE ESSAY ITEMS
IVALUEA= 1000000 ; MCQ ITEMS WITH A AS THE CORRECT ANSWER
IVALUEB= 0100000 ; B IS CORRECT
IVALUEC= 0010000 ; C IS CORRECT
IVALUED= 0001000 ; D IS CORRECT
MISSING-VALUES-SCORED = 0 ; SO ALL 9'S (OR ANYTHING ELSE NOT IN CODES=) ARE SCORED 0
ITEM1 = 1 ; START OF ITEM STRING
NI = 35 ; NUMBER OF ITEM RESPONSES
NAME1 = 37 ; START OF PERSON IDENTIFICATION
&END
; ITEM LABELS HERE
END LABELS
Example 14: A test comprises multiple-choice questions (MCQ), true-false, and two different response structure formats. These are combined in one data file. The MCQ scoring key, and also the True-False scoring key are used as item cluster references in the IREFER= and IVALUE= specifications to simplify key checking.
EXAM14DT.TXT data format is: |
|
Cols 1-5 |
Person id. |
Cols 6-10 |
5 MCQ items (A,B,C,D, # = missing, wrong. Some items may be miskeyed |
Cols 11-15 |
5 True-False items, responses (S, N). For some of these S="True" is correct, for others "N"=False is correct |
Cols 16-25 |
10 Rating scale items (N=0,P=1,M=2,S=3). Some items may be reversed. |
Cols 26-29 |
2 Evaluation items (0-12). - (See exam14b.txt) - second analysis only. |
First analysis: all responses one column wide
The control file, EXAM14.TXT, is:
; This file is EXAM14.TXT
TITLE="Multiple Response Formats, Same Response Width"
DATA=exam14dt.txt
;EXAM14DT.TXT data format is
;Cols 1-5 Person id.
;Cols 6-10 5 MCQ items (A,B,C,D, # = missing, wrong)
; Some items may be miskeyed
;Cols 11-15 5 True-False items, responses (S, N)
; For some of these S="True" is correct, for others "N"=False is correct
;Cols 16-25 10 Rating scale items (N=0,P=1,M=2,S=3)
; Some items may be reversed.
;Cols 26-29 2 Evaluation items (0-12). - (See exam14b.con)
NAME1=1
ITEM1=6
NI=20
; THESE CODES LINE UP WITH THE ITEM COLUMNS
; 0 1 2
; 12345678901234567890
; TO DEFINE RESPONSE STRUCTURE CLUSTERS
ISGROUPS = 11111222223333333333
; TO DEFINE RESCORING CLUSTERS
IREFER = BACDCSNSNSRRRRRRRRRR
; IREFER = X MATCHES IVALUEX=
; IVALUE?= MATCHES WITH CODES=
CODES = ABCD#SNPM ; CODES IN ORIGINAL DATA FILE
IVALUEA = 10000**** ; MCQ RESPONSE A IS CORRECT
IVALUEB = 01000**** ; MCQ RESPONSE B IS CORRECT
IVALUEC = 00100**** ; MCQ RESPONSE C IS CORRECT
IVALUED = 00010**** ; MCQ RESPONSE D IS CORRECT
IVALUES = *****10** ; "S" IS THE CORRECT ANSWER
IVALUEN = *****01** ; "N" IS THE CORRECT ANSWER
IVALUER = *****3012 ; "NPMS" RATING SCALE
STKEEP=YES ; KEEP UNUSED INTERMEDIATE CATEGORIES IN RATING SCALES
INUMBER=YES ; NO ITEM INFORMATION AVAILABLE
&END
Second analysis: responses one and two columns wide
Including the last two items with long numeric response structures and 2-column format, the control file becomes EXAM14B.TXT. Since some responses are in 2 column format, XWIDE=2. FORMAT= is used to transform all responses into XWIDE=2 format.
EXAM14B.TXT is:
&INST
TITLE="Multiple Response Formats, Same Response Width"
DATA=EXAM14DT.TXT
;EXAM14DT.TXT data format is
;Cols 1-5 Person id.
;Cols 6-10 5 MCQ items (A,B,C,D, # = missing, wrong)
; Some items may be miskeyed
;Cols 11-15 5 True-False items, responses (S, N)
; For some of these S="True" is correct, for others "N"=False is correct
;Cols 16-25 10 Rating scale items (N=0,P=1,M=2,S=3)
; Some items may be reversed.
;Cols 26-29 2 Evaluation items (0-12)
NAME1=1
ITEM1=6
NI=22 ;20-1 COLUMN + 2 2-COLUMN ITEMS
XWIDE=2 ;XWIDE FOR WIDEST FIELD
FORMAT=(5A1, 20A1,2A2) ; PERSON LABEL & FIRST 20 ITEMS 1 CHARACTER COLUMNS
; ; LAST 2 ITEMS ARE 2 CHARACTER COLUMNS
; THESE ARE SET UP FOR XWIDE=2
; FOR RESPONSE STRUCTURE DEFINITIONS
; TO DEFINE RATING SCALE CLUSTERS
ISGROUPS = 1111122222333333333344
IREFER = BACDCSNSNSRRRRRRRRRREE
; IREFER = X MATCHES IVALUEX=
; IVALUE?= MATCHES WITH CODES=
; CODES ARE 2 CHARACTERS WIDE
CODES = "A B C D # S N P M 121110 9 8 7 6 5 4 3 2 1 0"; CODES IN DATA
IVALUEA = "1 0 0 0 0 * * * * * * * * * * * * * * * * *"; MCQ A IS CORRECT
IVALUEB = "0 1 0 0 0 * * * * * * * * * * * * * * * * *"; MCQ B IS CORRECT
IVALUEC = "0 0 1 0 0 * * * * * * * * * * * * * * * * *"; MCQ C IS CORRECT
IVALUED = "0 0 0 1 0 * * * * * * * * * * * * * * * * *"; MCQ D IS CORRECT
IVALUES = "* * * * * 1 0 * * * * * * * * * * * * * * *"; "S" IS CORRECT
IVALUEN = "* * * * * 0 1 * * * * * * * * * * * * * * *"; "N" IS CORRECT
IVALUER = "* * * * * 3 0 1 2 * * * * * * * * * * * * *"; "NPMS" RATING SCALE
IVALUEE = "* * * * * * * * * 121110 9 8 7 6 5 4 3 2 1 0"; 0-12 RATING SCALE
STKEEP=YES ; KEEP UNUSED INTERMEDIATE CATEGORIES IN RATING SCALES
INUMBER=YES ; NO ITEM INFORMATION AVAILABLE
&END
This can also be done with MFORMS=
EXAM14C.TXT is:
; This file is EXAM14C.TXT
&INST
TITLE="Multiple Response Formats, Same Response Width"
;EXAM14DT.TXT data format is
;Cols 1-5 Person id.
;Cols 6-10 5 MCQ items (A,B,C,D, # = missing, wrong)
; Some items may be miskeyed
;Cols 11-15 5 True-False items, responses (S, N)
; For some of these S="True" is correct, for others "N"=False is correct
;Cols 16-25 10 Rating scale items (N=0,P=1,M=2,S=3)
; Some items may be reversed.
;Cols 26-29 2 Evaluation items (0-12)
; Reformatted data record is:
;Cols 1-5 Person id
;Cols 6-7 Item 1 = original Col. 6
;Cols 8-9 Item 2 = original Col. 7
;.....
;Cols 48-49 Item 22
NAME1=1
ITEM1=6
NI=22 ;20-1 COLUMN + 2 2-COLUMN ITEMS
XWIDE=2 ;XWIDE FOR WIDEST FIELD
mforms=*
data=exam14dt.txt ; the name of an input data file
L = 1 ; the are 2 lines in input data file for each data record
P1-5 = 1 ; person label characters 1 through 5 start in column 1
; in the following "C" is used because "I" uses XWIDE=2
C6 = 6 ; original item 1 in column 6 goes in column 6
C8 = 7 ; original item 2 in column 7 goes in column 8
C10 = 8
C12 = 9
C14 = 10
C16 = 11
C18 = 12
C20 = 13
C22 = 14
C24 = 15
C26 = 16
C28 = 17
C30 = 18
C32 = 19
C34 = 20
C36 = 21
C38 = 22
C40 = 23
C42 = 24
C44 = 25 ; original item 20 in column 25 goes in column 44-45
I21-22 = 26 ; two-character items 21 and 22 start in column 26
* ; end of mforms= command
; THESE ARE SET UP FOR XWIDE=2 FOR RESPONSE STRUCTURE DEFINITIONS
; TO DEFINE RATING SCALE CLUSTERS
ISGROUPS = 1111122222333333333344
IREFER = BACDCSNSNSRRRRRRRRRREE
; IREFER = X MATCHES IVALUEX=
; IVALUE?= MATCHES WITH CODES=
; CODES ARE 2 CHARACTERS WIDE
CODES = "A B C D # S N P M 121110 9 8 7 6 5 4 3 2 1 0"; CODES IN DATA
IVALUEA = "1 0 0 0 0 * * * * * * * * * * * * * * * * *"; MCQ A IS CORRECT
IVALUEB = "0 1 0 0 0 * * * * * * * * * * * * * * * * *"; MCQ B IS CORRECT
IVALUEC = "0 0 1 0 0 * * * * * * * * * * * * * * * * *"; MCQ C IS CORRECT
IVALUED = "0 0 0 1 0 * * * * * * * * * * * * * * * * *"; MCQ D IS CORRECT
IVALUES = "* * * * * 1 0 * * * * * * * * * * * * * * *"; "S" IS CORRECT
IVALUEN = "* * * * * 0 1 * * * * * * * * * * * * * * *"; "N" IS CORRECT
IVALUER = "* * * * * 3 0 1 2 * * * * * * * * * * * * *"; "NPMS" RATING SCALE
IVALUEE = "* * * * * * * * * 121110 9 8 7 6 5 4 3 2 1 0"; 0-12 RATING SCALE
STKEEP=YES ; KEEP UNUSED INTERMEDIATE CATEGORIES IN RATING SCALES
INUMBER=YES ; NO ITEM INFORMATION AVAILABLE
&END
Help for Winsteps Rasch Measurement and Rasch Analysis Software: www.winsteps.com. Author: John Michael Linacre
Facets Rasch measurement software.
Buy for $149. & site licenses.
Freeware student/evaluation Minifac download Winsteps Rasch measurement software. Buy for $149. & site licenses. Freeware student/evaluation Ministep download |
---|
Forum: | Rasch Measurement Forum to discuss any Rasch-related topic |
---|
Questions, Suggestions? Want to update Winsteps or Facets? Please email Mike Linacre, author of Winsteps mike@winsteps.com |
---|
State-of-the-art : single-user and site licenses : free student/evaluation versions : download immediately : instructional PDFs : user forum : assistance by email : bugs fixed fast : free update eligibility : backwards compatible : money back if not satisfied Rasch, Winsteps, Facets online Tutorials |
---|
Coming Rasch-related Events | |
---|---|
May 17 - June 21, 2024, Fri.-Fri. | On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
June 12 - 14, 2024, Wed.-Fri. | 1st Scandinavian Applied Measurement Conference, Kristianstad University, Kristianstad, Sweden http://www.hkr.se/samc2024 |
June 21 - July 19, 2024, Fri.-Fri. | On-line workshop: Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com |
Aug. 5 - Aug. 7, 2024, Mon.-Wed. | 2024 Inaugural Conference of the Society for the Study of Measurement (Berkeley, CA), Call for Proposals |
Aug. 9 - Sept. 6, 2024, Fri.-Fri. | On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com |
Oct. 4 - Nov. 8, 2024, Fri.-Fri. | On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
Jan. 17 - Feb. 21, 2025, Fri.-Fri. | On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
May 16 - June 20, 2025, Fri.-Fri. | On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
June 20 - July 18, 2025, Fri.-Fri. | On-line workshop: Rasch Measurement - Further Topics (E. Smith, Facets), www.statistics.com |
Oct. 3 - Nov. 7, 2025, Fri.-Fri. | On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
Our current URL is www.winsteps.com
Winsteps® is a registered trademark