Three-facet rating scale: Creativity (with Excel input data file)

Top Up Down  A A

In a study commissioned by the US Navy (J.P. Guilford, 1954, Psychometric Methods, 2nd Ed., New York: McGraw-Hill, p.282, and MFRM Chapter 10), three senior scientists rated seven junior scientists on five traits of creativity. Ratings ranged from 1 to 9, with 9 meaning most creative.

 

Facets specifications and data (in file Guilford.txt):

 

Title = Ratings of Scientists (Psychometric Methods p.282 Guilford 1954)

; measurement model

Facets = 3  ; three facets: judges, examinees, items

Non-centered = 1 ; examinees and items are centered on 0, judges are allowed to float

Positive = 2  ; the examinees have greater creativity with greater score

Model = ?B,?B,?,Creativity ; judges, examinees and items produce ratings on "Creativity".

; A bias/interaction analysis, ?B,?B,?, will report interactions between facets 1,

; senior scientists (judges,) and 2, junior scientists (examinees).

; log(Pnijk/Pnijk-1) = Bn - Di - Cj - Fk

; Bn = ability n, Di = difficulty i, Cj = Severity j, Fk = Challenge k,

; Pnijk = probability that child n on item i is rated by judge j with score of k.

Rating (or partial credit) scale = Creativity,R9 ;Creativity is a rating scale with possible categories 0 to 9

1 = lowest ; name of lowest observed category

5 = middle ; no need to list unnamed categories

9 = highest ; name of highest observed category

*

; for Table 4: unexpected observations

Unexpected = 2 ; report ratings if standardized residual >=|2|

Usort = (1,2,3),(3,1,2),(Z,3) ; sort and report unexpected ratings several ways (1,2,3) is Senior, Junior, Trait

 

; for Table 6: map of elements

Vertical = 2N,3A,2*,1L,1A ;define rulers to display and position facet elements

 

; for Table 7: table of measures

Arrange = m,2N,0f ; arrange tables by measure-descending for all facets,

  ; 2N = element number-ascending for facet 2,

  ; and 0f = t-statistic-descending for facet 0 (bias interactions)

Inter-rater = 1 ; facet 1 is the rater facet

 

; for Table 13: bias/interaction report

Zscore = 1,2  ;report biases greater in size than 1 logit or with z>2

 

; Output files

Score file = GUILFORD.SC ; score files .SC.1.txt, SC.2.txt and .SC.3.txt produced

 

; facet and element identification

Labels =

1, Senior scientists ; name of first (judge) facet

1 = Avogadro ; names of elements within senior scientist facet

2 = Brahe

3 = Cavendish

*

2,Junior Scientists ; name of second (examinee) facet

7=George  ; element order does not matter

1=Anne

2=Betty

3=Chris

4=David

5=Edward

6=Fred

*

3,Traits ; name of third (item) facet

1=Attack

2=Basis

3=Clarity

4=Daring

5=Enthusiasm

*

 

Data=

1,1,1-5,5,5,3,5,3

1,2,1-5,9,7,5,8,5

1,3,1-5,3,3,3,7,1

1,4,1-5,7,3,1,3,3

1,5,1-5,9,7,7,8,5

1,6,1-5,3,5,3,5,1

1,7,1-5,7,7,5,5,5

2,1,1-5,6,5,4,6,3

2,2,1-5,8,7,5,7,2

2,3,1-5,4,5,3,6,6

2,4,1-5,5,6,4,5,5

2,5,1-5,2,4,3,2,3

2,6,1-5,4,4,6,4,2

2,7,1-5,3,3,5,5,4

3,1,1-5,5,5,5,7,3

3,2,1-5,7,7,5,7,5

3,3,1-5,3,5,5,5,5

3,4,1-5,5,3,3,3,1

3,5,1-5,9,7,7,7,7

3,6,1-5,3,3,3,5,3

3,7,1-5,7,7,7,5,7 ; last line of data, and end of file

 

or:

Dvalues = 3, 1-5 ; place 1-5 in data facet 3 location

Data=

1,1,5,5,3,5,3

|

3,7,7,7,7,5,7

 

or:

Data = Creativity.txt ; Text data file

or:

Data = Creativity.xls ; Excel data file

or:

Data = Creativity.sav ; SPSS data file


Help for Facets Rasch Measurement Software: www.winsteps.com.