|
Sign In to gain access to subscriptions and/or personal tools.
|
Reliability of assessment tools in rehabilitation: an illustration of appropriate statistical analyses
Gabrielle Rankin
Maria Stokes
Royal Hospital for Neuro-disability, London
Objective: To provide a practical guide to appropriate statistical analysis of a reliability study using real-time ultrasound for measuring muscle size as an example.
Design: Inter-rater and intra-rater (between-scans and between-days) reliability.
Subjects: Ten normal subjects (five male) aged 22–58 years.
Method: The cross-sectional area (CSA) of the anterior tibial muscle group was measured using real-time ultrasonography.
Main outcome measures: Intraclass correlation coefficients (ICCs) and the 95% confidence interval (CI) for the ICCs, and Bland and Altman method for assessing agreement, which includes calculation of the mean difference between measures (d), the 95% CI for d, the standard deviation of the differences (SD diff), the 95% limits of agreement and a reliability coefficient.
Results: Inter-rater reliability was high, ICC (3,1) was 0.92 with a 95% CI of 0.72  0.98. There was reasonable agreement between measures on the Bland and Altman test, as  was -0.63 cm2, the 95% CI for was -1.4 0.14 cm2, the SDdiff was 1.08 cm2, the 95% limits of agreement -2.73 1.53 cm2 and the reliability coefficient was 2.4. Between-scans repeatability was high, ICCs (1,1) were 0.94 and 0.93 with 95% CIs of 0.8 0.99 and 0.75 0.98, for days 1 and 2 respectively. Measures showed good agreement on the Bland and Altman test: d for day 1 was 0.15 cm2 and for day 2 it was -0.32 cm2, the 95% CIs for were -0.51 0.81 cm2 for day 1 and -0.98 0.34 cm2 for day 2; SDdiff was 0.93 cm2 for both days, the 95% limits of agreement were -1.71 2.01 cm2 for day 1 and -2.18 1.54 cm2for day 2; the reliability coefficient was 1.80 for day 1 and 1.88 for day 2. The between-days ICC (1,2) was 0.92 and the 95% CI 0.69 0.98. The was -0.98 cm2, the SDdiff was 1.25 cm2 with 95% limits of agreement of -3.48 1.52 cm2 and the reliability coefficient 2.8. The 95% CI for (-1.88 -0.08 cm2) and the distribution graph showed a bias towards a larger measurement on day 2.
Conclusions: The ICC and Bland and Altman tests are appropriate for analysis of reliability studies of similar design to that described, but neither test alone provides sufficient information and it is recommended that both are used.
Clinical Rehabilitation, Vol. 12, No. 3,
187-199 (1998)
DOI: 10.1191/026921598672178340
 CiteULike  Complore  Connotea  Del.icio.us  Digg  Reddit  Technorati  Twitter What's this?
This article has been cited by other articles:
|
|
|
|
 
P. Bagley, M. Hudson, J. Green, A. Forster, and J. Young
Do physiotherapy staff record treatment time accurately? An observational study
Clinical Rehabilitation,
September 1, 2009;
23(9):
841 - 845.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. Rand, J. J. Eng, P.-F. Tang, J.-S. Jeng, and C. Hung
How Active Are People With Stroke?: Use of Accelerometers to Assess Physical Activity
Stroke,
January 1, 2009;
40(1):
163 - 168.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
J. M Wagner, J. A Rhodes, and C. Patten
Reproducibility and Minimal Detectable Change of Three-Dimensional Kinematic Analysis of Reaching Tasks in People With Hemiparesis After Stroke
Physical Therapy,
May 1, 2008;
88(5):
652 - 663.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
J. F. Signorile, D. Sandler, L. Kempner, D. Stanziano, F. Ma, and B. A. Roos
The Ramp Power Test: A Power Assessment During a Functional Task for Older Individuals
J. Gerontol. A Biol. Sci. Med. Sci.,
November 1, 2007;
62(11):
1266 - 1273.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. Conradsson, L. Lundin-Olsson, N. Lindelof, H. Littbrand, L. Malmqvist, Y. Gustafson, and E. Rosendahl
Berg Balance Scale: Intrarater Test-Retest Reliability Among Older People Dependent in Activities of Daily Living and Living in Residential Care Facilities
Physical Therapy,
September 1, 2007;
87(9):
1155 - 1163.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
H.-M. Chen, C.-L. Hsieh, Sing Kai Lo, L.-J. Liaw, S.-M. Chen, and J.-H. Lin
The Test-Retest Reliability of 2 Mobility Performance Tests in Patients With Chronic Stroke
Neurorehabil Neural Repair,
July 1, 2007;
21(4):
347 - 352.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. El-Ansary, G. Waddington, and R. Adams
Measurement of Non-Physiological Movement in Sternal Instability by Ultrasound
Ann. Thorac. Surg.,
April 1, 2007;
83(4):
1513 - 1516.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
P M Grant, C G Ryan, W W Tigbe, and M H Granat
The validation of a novel activity monitor in the measurement of posture and motion during everyday activities
Br. J. Sports Med.,
December 1, 2006;
40(12):
992 - 997.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
R. J. Smeets, H. J. Hijdra, A. D. Kester, M. W. Hitters, and J A. Knottnerus
The usability of six physical performance tasks in a rehabilitation population with chronic low back pain
Clinical Rehabilitation,
November 1, 2006;
20(11):
989 - 997.
[Abstract]
[PDF]
|
|
|
|
|
|
|
G. Verheyden, G. Nuyens, A. Nieuwboer, P. Van Asch, P. Ketelaer, and W. De Weerdt
Reliability and Validity of Trunk Assessment for People With Multiple Sclerosis
Physical Therapy,
January 1, 2006;
86(1):
66 - 76.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
C. M Sackley, H. J Hill, K. Pound, and A. Foxall
The intra-rater reliability of the Balance Performance Monitor when measuring sitting symmetry and weight-shift activity after stroke in a community setting
Clinical Rehabilitation,
July 1, 2005;
19(7):
746 - 750.
[Abstract]
[PDF]
|
|
|
|
|
|
|
A B. Deathe and W. C Miller
The L Test of Functional Mobility: Measurement Properties of a Modified Version of the Timed "Up & Go" Test Designed for People With Lower-Limb Amputations
Physical Therapy,
July 1, 2005;
85(7):
626 - 635.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
U.-B. Flansbjer, A. M. Holmback, D. Downham, and J. Lexell
What change in isokinetic knee muscle strength can be detected in men and women with hemiparesis after stroke?
Clinical Rehabilitation,
May 1, 2005;
19(5):
514 - 522.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D Kos, E Kerckhofs, I Carrea, R Verza, M Ramos, and J Jansa
Evaluation of the Modified Fatigue Impact Scale in four different European countries
Multiple Sclerosis,
February 1, 2005;
11(1):
76 - 80.
[Abstract]
[PDF]
|
|
|
|
|
|
|
T. B. Symons, A. A. Vandervoort, C. L. Rice, T. J. Overend, and G. D. Marsh
Reliability of a Single-Session Isokinetic and Isometric Strength Measurement Protocol in Older Men
J. Gerontol. A Biol. Sci. Med. Sci.,
January 1, 2005;
60(1):
114 - 119.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
W C Miller, A B Deathe, and J Harris
Measurement properties of the Frenchay Activities Index among individuals with a lower limb amputation
Clinical Rehabilitation,
April 1, 2004;
18(4):
414 - 422.
[Abstract]
[PDF]
|
|
|
|
|
|
|
K A P M Lemmink, M T Elferink-Gemser, and C Visscher
Evaluation of the reliability of two field hockey specific sprint and dribble tests in young field hockey players
Br. J. Sports Med.,
April 1, 2004;
38(2):
138 - 142.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
E. Eek and M. Engardt
Assessment of the perceptual threshold of touch (PTT) with high-frequency transcutaneous electric nerve stimulation (Hf/TENS) in elderly patients with stroke: a reliability study
Clinical Rehabilitation,
August 1, 2003;
17(8):
825 - 834.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. M Simpson, J. Valentine, and C. Worsfold
The Standardized Three-metre Walking Test for elderly people (WALK3m): repeatability and real change
Clinical Rehabilitation,
August 1, 2002;
16(8):
843 - 850.
[Abstract]
[PDF]
|
|
|
|
|
|
|
F. A Arnall, G. A Koumantakis, J. A Oldham, and R. G Cooper
Between-days reliability of electromyographic measures of paraspinal muscle fatigue at 40, 50 and 60% levels of maximal voluntary contractile force
Clinical Rehabilitation,
July 1, 2002;
16(7):
761 - 771.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. Green, A. Forster, and J. Young
Reliability of gait speed measured by a timed walking test in patients one year after stroke
Clinical Rehabilitation,
March 1, 2002;
16(3):
306 - 314.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M A J E Biemans, J Dekker, and L H V van der Woude
The internal consistency and validity of the Self-assessment Parkinson's Disease Disability Scale
Clinical Rehabilitation,
February 1, 2001;
15(2):
221 - 228.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. P Buckley, R. G Eston, and J. Sim
Ratings of perceived exertion in braille: validity and reliability in production mode
Br. J. Sports Med.,
August 1, 2000;
34(4):
297 - 302.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
J. M Spyers-Ashby and M. J Stokes
Reliability of tremor measurements using a multidimensional electromagnetic sensor system
Clinical Rehabilitation,
April 1, 2000;
14(4):
425 - 432.
[Abstract]
[PDF]
|
|
|
|
|
