Correlations: point-biserial, point-measure, residual

Top Up Down  A A

In Rasch analysis, we use item correlations as an immediate check that the response-level scoring makes sense. If the observed correlation is negative, something may have gone wrong (MCQ miskey, reversed survey item, etc.)

In general, correlations are much too difficult to interpret, so we switch over to using mean-squares. The "expected correlation" indicates when conventional rules such as eliminate items with point-biserials less than 0.2 are misleading.

Item correlations are difficult to interpret because they are influenced by:

1. predictability of the data

2. targeting of the item on the person sample

3. distribution of the person sample

In Rasch analysis, we are chiefly concerned about the predictability of the data when assessing item quality, so we examine the predictability directly using the mean-square statistics, rather than indirectly through the correlations.

 


 

All correlations are computed as Pearson product-moment correlation coefficients. If you wish to compute other correlations, the required data are in XFILE= IPMATRIX=, IFILE= or PFILE=. The Biserial correlation can be computed from the point-biserial.

 

In Table 14.1 and other measure Tables:

 

Point-Biserial Correlations (for dichtomies, and Point-Polyserial for polytomies)

 

when PTBISERIAL=Yes

PTBSE is the point-biserial correlation between the responses to this item by each person and the total marginal score by each person (omitting the response to this item). This is the "point-biserial corrected for spuriousness". Henrysson, S. (1963). Correction for item-total correlations in item analysis. Psychometrika, 28, 211-218.

 

when PTBISERIAL=All

PTBSA is the point-biserial correlation between the responses to this item by each person and the total marginal score by each person (including the response to this item). This is the conventional point-biserial.

 

In Table 14.3 and other or distractor Tables:

when PTBISERIAL=Yes or PTBISERIAL=All

PTBSD is the distractor point-biserial correlation between the indicated response to this item (scored 1 and other responses scored 0) by each person and the total marginal score by each person.

 

There is a closer match between Table 14.1 and Table 14.3 when PTBISERIAL=All

 

PTBIS=Y or E (indicated by PTBSE): The point-biserial correlation rpbis for item i (when i=1,L for persons n=1,N) is the correlation between the observation for each person on item i and the total score for each person on all the items excluding item i (and similarly for the point-biserial for each person):

 

 

PTBIS=All (indicated by PTBSA): All the observations are included in the total score:

 

 

where X1,..,XN are the responses, and Y1,..,YN are the total scores. The range of the correlation is -1 to +1.

 

Under classical (raw-score) test theory conventions, point-biserial correlations should be 0.3, 0.4 or better. Under Rasch conditions, point-biserial (or point-measure) correlations should be positive, so that the item-level scoring accords with the latent variable, but the size of a positive correlation is of less importance than the fit of the responses to the Rasch model, indicated by the mean-square fit statistics.

 

Point-Measure Correlations

 

PTBIS=No (indicated by PTMEA): The correlation between the observations and the Rasch measures:

 

 

where X1,..,XN are the responses by the persons (or on the items), and Y1,..,YN are the person measures (or the item easinesses = - item difficulties). The range of the correlation is -1 to +1.

 

Jaspen, N. (1946) "Serial Correlation", Psychometrika, 11, 23-30.

Olsson, U., Drasgow, F. and Dorans, N.J. (1982) "The Polyserial Correlation Coefficient", Psychometrika, 47, 337-347.

 


 

The Expected Value of a Correlation

 

Interpreting an observed value is made easier if we can compare it with its expected value. Is is much higher than expected or much lower than expected?

 

The general formula for a Pearson correlation coefficient is shown above. Suppose that Xn is Xni the observation of person n on item i. Yn is Bn the ability of person n, then the point-measure correlation is:

 

 

According to the Rasch model, the expected value of Xni is Eni and its model variance around the expectation is Wni where Sum(Eni) = Sum(Xni) for n=1,N. Thus an estimate of the expected value of the point-measure correlation is given by the Rasch model proposition that: Xni = Eni ±Wni. Other variance terms are much smaller.

 

 

±Wni is a random residual with mean 0 and variance Wni. Its value for any observation is known: Wni = Eni(1-Eni) for dichotomies. Its cross-product with any other variable is modeled to be zero. Thus, simplifying,

 

 

and similarly for the point-biserial correlations. Here is an example with an Excel spreadsheet:

 

Figure courtesy of Peter Karaffa

 

Disattenuated correlation coefficients

 

"Attenuated" means "reduced". "Disattenuation" means "remove the attenuation".

The observed correlation between two variables is attenuated (reduced toward zero) because the variables are measured with error. So, when we remove the measurement error (by a statistical operation), the resulting correlation is disattenuated. Disattenuated correlations are always further from zero.

Algebraically:

{A} and {B} are the "true" values of two variables. Their true (disattenuated) correlation is

Disattenuated ("true") correlation = r(A,B)

But the observed values of the variables are measured with error {A±a}, {B±b}, so the observed correlation is

observed correlation = r(A,B) * (var(A)*var(B))/((var(A)+a²)*(var(B)+b²)).

"Disattenuation" reverses this process.

 

If the reliability of {A} is RA, and the reliability of {B} is RB, then the disattenuated correlation between {A} and {B} is:

disattenuated r(A,B) = r(A,B) / (RA*RB).

 

 


Help for Winsteps Rasch Measurement Software: www.winsteps.com.

Facets Rasch measurement software $149.
Winsteps Rasch measurement software $149.

State-of-the-art : single-user and site licenses : free student/evaluation versions : download immediately : instructional PDFs : user forum : assistance by email : bugs fixed fast : free update eligibility : backwards compatible : money back if not satisfied
 
Rasch, Winsteps, Facets online Tutorials

ForumRasch Measurement Forum to discuss any Rasch-related topic

To receive the monthly News Email about Winsteps and Facets,
enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Winsteps.com
www.winsteps.com welcomes your comments:

Your email address (if you want us to reply):

 

Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch
Applying the Rasch Model 2nd. Ed., Bond & Fox (Winsteps) Best Test Design, Wright & Stone Rating Scale Analysis, Wright & Masters
Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes (Facets) Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. (Facets)
Statistical Analyses for Language Testers, Rita Green (Winsteps, Facets) Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement
Winsteps Tutorials Facets Tutorials Rasch Discussion Groups

Coming Rasch-related Events
Apr. 25-26, 2013, Thurs.-Fri. In-person workshop: Introduction to Rasch Measurement (R. Smith, N. Bezruczko), San Francisco CA, www.jampress.org
April 27 - May 1, 2013, Sat.-Wed. AERA Annual Meeting, San Francisco, CA, www.aera.net
May 3, 2013, Fri. ORVOMS: Ohio River Valley Objective Measurement Seminar, Lexington, Kentucky, Announcement
May 15-17, 2013, Wed.-Fri. In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
May 20-22, 2013, Mon.-Wed. In-person workshop: Intermediate Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
May 31 - June 28, 2013, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 7, 2013, Fri. SPHERE workshop: Response-Shift and subjective measures in health science, Nantes, France, www.sphere-nantes.fr/
June 19-21, 2013, Wed.-Fri. SIS 2013 Conference on Advances in Latent Variables: Methods, Models and Applications, Brescia, Italy, meetings.sis-statistica.org/index.php/sis2013/ALV
July 1 - Nov. 30, 2013, Mon.-Sun. Online Course: Introduction to Rasch Measurement Theory (D. Andrich, RUMM), uwa.edu.au
July 5 - Aug. 2, 2013, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug.1-5, 2013, Thur.-Mon. TERA-PROMS Annual Meeting, Kaohsiung, Taiwan, tera.education.nsysu.edu.tw
Aug. 9 - Sept. 6, 2013, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Aug. 22, 2013, Thursday. Symposium in honor of Svend Kreiner, Copenhagen, Denmark, biostat.ku.dk/kreinersymposium
Sept. 4-6, 2013, Wed.-Fri. IMEKO TC1-TC7-TC13 Symposium: Measurement Across Physical and Behavioural Sciences, Genoa, Italy, www.imeko-genoa-2013.it
Sept. 13 - Oct. 11, 2013, Fri.-Fri. On-line workshop: Rasch Applications in Clinical Assessment, Survey Research, and Educational Measurement (W.P. Fisher), www.statistics.com
Sept. 18-20, 2013, Wed.-Fri. In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
Sept. 23-25, 2013, Mon.-Wed. In-person workshop: Intermediate Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
Sept. 26-27, 2013, Thurs.-Fri. In-person workshop: Advanced Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
Oct. 18 - Nov. 15, 2013, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Oct. 20 - Oct. 25, 2013, Sun.-Fri. International Association for Educational Assessment (IAEA) 39th Annual Conference, Tel Aviv, Israel, www.iaea-2013.com
Dec. 11-13, 2013, Wed.-Fri. In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
March 12-14, 2014, Wed.-Fri. In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
May 14-16, 2014, Wed.-Fri. In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
May 19-21, 2013, Mon.-Wed. In-person workshop: Intermediate Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
July 4 - Aug. 1, 2014, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 8 - Sept. 5, 2014, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Sept. 10-12, 2014, Wed.-Fri. In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
Sept. 12 - Oct. 10, 2014, Fri.-Fri. On-line workshop: Rasch Applications in Clinical Assessment, Survey Research, and Educational Measurement (W.P. Fisher), www.statistics.com
Sept. 15-17, 2014, Mon.-Wed. In-person workshop: Intermediate Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
Sept. 18-19, 2014, Thurs.-Fri. In-person workshop: Advanced Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric
The javascript to add "Coming Rasch-related Events" to your webpage is:
<script type="text/javascript" src="http://www.rasch.org/events.txt"></script>