Document Detail

Reliability of a Simple Physical Therapist Screening Tool to Assess Errors during Resistance Exercises for Musculoskeletal Pain.
Jump to Full Text
MedLine Citation:
PMID:  24738079     Owner:  NLM     Status:  In-Data-Review    
The main objective was to investigate the intra- and intertester reliability of a simple screening tool assessing errors in exercise execution by visual observation. 38 participants with no previous resistance exercise experience practiced for two weeks four typical upper limb exercises using elastic tubing. At 2-week follow-up, the participants were invited for a test-retest assessment on errors in technical execution. The assessment was based on ordinal deviation of joint position from neutral of the shoulder, elbow, and wrist in a single plane by visual observation. Moderate intratester reliability weighted kappa (wΚ) score ranging from 0.50 (0.21-0.71) to 0.57 (0.24-0.82) for observer 1 and a fair to moderate intratester reliability wΚ score ranging from 0.27 (0.09-0.43) to 0.52 (0.15-0.86) for observer 2 across the four exercises was observed. For intertester reliability moderate to substantial mean wΚ scores were found between the two observers, slightly improving from round one to round two ranging from 0.40 (0.20-0.59) to 0.68 (0.45-0.91) in round one to 0.52 (0.20-0.80) to 0.69 (0.39-0.86) in round two. The exercise error assessment demonstrated fair to substantial intratester and intertester reliability, which is congruent with previously published studies. Hence the simplicity of defining a neutral joint position for each of the involved joints in the exercise and categorizing the deviation in "some deviation" and "substantial deviation" to either side in a single plane is a viable and inexpensive solution when assessing for errors during exercise.
Kenneth Jay; Emil Sundstrup; Lars L Andersen
Related Documents :
15831059 - The science of cycling: physiology and training - part 1.
19756709 - Physiological factors to predict on traditional rowing performance.
10527319 - Physiological responses to upper body exercise on an arm and a modified leg ergometer.
24452819 - Advantages of exercise in rehabilitation, treatment and prevention of altered morpholog...
11322469 - Physical capacity and race performance of handcycle users.
7788209 - Physical and physiological profiles of malaysian dragon boat rowers.
21283289 - Do sports enthusiasts need to take extra iron?
24713459 - Improved exercise performance and quality of life after percutaneous pulmonary valve im...
16258919 - Positive effects of moderate exercise on glycosaminoglycan content in knee cartilage: a...
Publication Detail:
Type:  Journal Article     Date:  2014-03-13
Journal Detail:
Title:  BioMed research international     Volume:  2014     ISSN:  2314-6141     ISO Abbreviation:  Biomed Res Int     Publication Date:  2014  
Date Detail:
Created Date:  2014-04-16     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  101600173     Medline TA:  Biomed Res Int     Country:  United States    
Other Details:
Languages:  eng     Pagination:  961748     Citation Subset:  IM    
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine

Full Text
Journal Information
Journal ID (nlm-ta): Biomed Res Int
Journal ID (iso-abbrev): Biomed Res Int
Journal ID (publisher-id): BMRI
ISSN: 2314-6133
ISSN: 2314-6141
Publisher: Hindawi Publishing Corporation
Article Information
Download PDF
Copyright © 2014 Kenneth Jay et al.
Received Day: 19 Month: 11 Year: 2013
Revision Received Day: 15 Month: 1 Year: 2014
Accepted Day: 19 Month: 1 Year: 2014
Print publication date: Year: 2014
Electronic publication date: Day: 13 Month: 3 Year: 2014
Volume: 2014E-location ID: 961748
PubMed Id: 24738079
ID: 3971509
DOI: 10.1155/2014/961748

Reliability of a Simple Physical Therapist Screening Tool to Assess Errors during Resistance Exercises for Musculoskeletal Pain
Kenneth Jay123*
Emil Sundstrup13
Lars L. Andersen1
1National Research Centre for the Working Environment, Lersø Parkalle 105, 2100 Copenhagen Ø, Denmark
2Electronics and Computer Science, Faculty of Physical and Applied Sciences, University of Southampton, Southampton SO17 1BJ, UK
3Institute of Sports Science and Clinical Biomechanics, University of Southern Denmark, Campusvej 55, 5230 Odense, Denmark
Correspondence: *Kenneth Jay:
[other] Academic Editor: Brad J. Schoenfeld

1. Introduction

With an estimated cost between 0.5% and 2% of the Gross National Product [1] musculoskeletal disorders comprise one of the most common and costly public health problems in Europe today [2]. In particular, the occurrence of neck and shoulder pain has been progressively increasing through the past 10–20 years [3] and is now only surpassed by low back pain, which still is the most common reported multifactorial musculoskeletal disorder [4, 5]. In occupations characterized by repetitive movement tasks and sustained low force muscular contractions, such as computer and laboratory work, neck and shoulder pain is of substantial concern [6, 7] as pain not only decreases wellbeing at work [1, 810] but could also affect productivity and accuracy, something of utmost importance in the work of laboratory technicians [11], while potentially leading to an increased sense of stress [12]. Indeed, the socioeconomic consequences of musculoskeletal pain and discomfort are considerable.

Possible intervention strategies for reducing the adverse effects of monotonous repetitive work include strengthening exercises of the painful muscles and a substantial number of studies within the past 10 years provide ample evidence for the effectiveness and the clinical relevance of physical activity in the form of resistance training modalities to manage musculoskeletal discomfort and pain [1, 1316]. In accordance with this, our lab has previously shown strong effects on neck and shoulder pain with resistance exercise using elastic tubing, dumbbells and kettlebells [15, 1725] among office workers and lab technicians with substantial and clinically relevant pain reduction. However, one possible concern with integrated resistance exercise as an intervention strategy in the working environment is the potential harmful effects of incorrectly executed exercises. Although, to own knowledge, no cause and effect studies provide evidence that wrongly executed strengthening exercises musculoskeletal problems it may be speculated that improper exercise form potentially increases the risk of sprains, strains, tendonitis, bursitis, or impingement of joints and ligaments as well as muscle contusions and general overuse injuries [26, 27]. For instance, the impingement of the subacromial bursa lying between the coracoacromial ligament and the supraspinatus muscle [28] is a relatively common problem in rehabilitation of athletes and it may occur with overuse and/or lack of scapulae-humeral rhythm during shoulder abduction movements as seen in swimmers [2932].

To minimize mistakes potentially leading to overuse injuries, physical therapists and physical trainers may benefit from a consensus about the correct technical execution of the exercise by utilizing an assessment tool. Additionally, no standardized assessment tools exist at present, whereas the main objective of this study was to develop and investigate the intra- and intertester reliability of a simplistic assessment tool to assess errors in exercise execution to help clinicians evaluate technical errors in exercise execution. Four commonly used elastic tubing exercises for upper limb musculoskeletal pain were included.

2. Methods
2.1. Study Design

We recruited 38 participants (laboratory technicians and office workers) from a pool of approximately 200 people at a large pharmaceutical company in Copenhagen, Denmark, in the fall of 2012. Inclusion criteria were (1) a history of neck or shoulder pain, (2) female aged 18–67 years, and (3) no prior experience exercising with elastic tubing. Exclusion criteria were (1) resting blood pressure higher than 160/100, (2) pregnancy, and (3) life-threatening disease or other adverse health conditions and contraindications towards resistance exercise. The participants were recruited based on their answers to a recruitment-screening questionnaire sent out by email. Participants meeting the inclusion criteria were allocated to either a personal + video instruction group or a video-based instruction group as part of a randomized controlled trial that will be published in a separate article. Following two weeks of practicing four different elastic tubing exercises targeting the shoulder, arm, and hand musculature, all participants were invited to participate in intra- and intertester reliability examination of the assessment tool for errors made during exercise execution.

2.2. Ethical Approval and Trial Registration

All participants (n = 38) were informed about the main objective and content of the project and gave written informed consent to participate in the study, which conformed to the Declaration of Helsinki. The study was approved by the Local Ethical Committee (H-3-2010-062). Table 1 shows baseline demographics.

2.3. Exercise Error Assessment

Together with two physical therapists we developed a simple standardized operating procedure for assessing the number of errors in four common shoulder, arm, and hand exercises using elastic tubing. The four exercises were (1) bilateral raise, (2) unilateral external shoulder rotation, (3) unilateral wrist extension, and (4) bilateral scapular retraction (Figures 1(a)1(d)). Each exercise was described by joint (wrist, elbow, and shoulder) and ordinal deviation from the neutral position in a single plane, by visual observation. For each joint the examiners had to evaluate by how much the position of the joint deviated from neutral, as well as to what side from neutral, during exercise execution each joint deviation was chosen based on best practice and instructional experience with these exercises. The possible deviations were denoted as “no deviation,” “some deviation,” or “substantial deviation.” The assessment score “no deviation” was given the value “0,” the score “some deviation” was given the value either “+1” or “−1” depending on which direction the deviation had and “substantial deviation” was given the value “+2” or “−2” again depending on the direction of the deviation equaling five different possible scores (−2, −1, 0, 1, and 2) with “0” being neutral or the defined ideal for each of the exercise specific subdomains. Figure 2 shows an example of the elbow position in the shoulder external rotation exercise for the right side. Table 2 lists the subdomains for each exercise. Figures 1(a)1(d) show the four exercises with the ideal defined technique (no deviation) in the start and end position and video instructional material can be seen online here:

2.4. Procedure

For the reliability assessment each participant was invited in for assessment on two separate occasions with at least one day in between, by two trained physical therapists. They were asked to perform 2 × 10 repetitions of each exercise in a slow and controlled manner taking approximately 1-2 sec. for the concentric portion of the lift and 1-2 sec for the eccentric portion. For the unilateral exercises (unilateral shoulder external rotation and unilateral wrist extension) the participant used the dominant arm. One set of each exercise was demonstrated facing the examiners and one set was demonstrated in a side-view profile. The two examiners conducting the assessment were positioned in the room in such a way that they could not see what the other examiner was noting. The examiners were instructed to not talk about the exercise execution during or after the assessment. Furthermore, the examiners were instructed to not provide any feedback to the participant on the execution of each exercise. Finally a standard operating procedure was followed to make sure each assessor evaluated the appropriate technical aspects of each exercise.

2.5. Dropouts

Approximately 200 people received information email about the study. 49 people agreed to answer a baseline-screening questionnaire and 38 were invited to participate in the study. One person was excluded due to lack of answering the screening questionnaire and four people did not show up for the second assessment by the examiners due to sickness unrelated to the study. Thus, 37 people completed the first assessment and 33 people completed the second assessment.

2.6. Statistics

Dropouts from the two-week familiarization training were invited to participate in the test-retest assessment to avoid selection bias. Intra- and intertester reliabilities were determined by weighted Kappa (wΚ) analysis of the SAS statistical software (SAS institute, Cary, NC, version 9.2). Landis and Koch have previously defined wΚ > 0.80 as almost perfect, 0.60 ≤ wΚ < 0.80 as substantial, 0.40 ≤ wΚ < 0.60 as moderate, 0.21 ≤ wΚ < 0.40 as fair, and wΚ < 0.20 as slight agreement [33]. Further, we calculated an intraclass correlation coefficient (ICC) between the two examiners and two rounds from the mean error assessment scores of each exercise.

3. Results

In general, we found a moderate intratester reliability mean wΚ score ranging from 0.50 (0.21–0.71) to 0.57 (0.24–0.82) for observer 1 and a fair to moderate intratester reliability mean wΚ score ranging from 0.27 (0.09–0.43) to 0.52 (0.15–0.86) for observer 2 across the four exercises. Similarly, a moderate to substantial intertester reliability mean wΚ was found between the two observers, slightly improving from round one to round two ranging from 0.40 (0.20–0.59) to 0.68 (0.45–0.91) in round one to 0.52 (0.20–0.80) to 0.69 (0.39–0.86) in round two. Table 2 summarizes the intra- and intertester reliability wΚ scores in each of the observed subdomains of the four different exercises (Figures 1(a)1(d)) and Table 3 summarizes ICC for the four exercises.

4. Discussion

This study shows fair to substantial intra- and intertester reliability of a very simple design assessment protocol of errors performed during commonly used elastic tubing exercises for musculoskeletal pain of the neck/shoulder, arm, and hand. The results show that physical therapists and physical trainers, with little practice, are able to spot errors in trainee exercise execution in a reliable way once a consensus about correct technical execution has been formed. Our results compliment previous findings in intertester reliability of movement assessments with similar results. For instance, the Melbourne Assessment of Unilateral Upper Limb Function for children with neurological impairments was found to have moderate to high interrater reliability by visual observation [34] and similarly; the Movement Assessment Battery for Chinese preschool children (Movement ABC) has also shown good intertester reliability [35]. Movement assessments targeted at the healthy adult population, like the Functional Movement Screen (FMS), have shown equally good intratester and intertester reliability [32, 36, 37] indicating that assessing movement by visual observation, between testers as well for the same tester, is a usable tool when physical trainers, physical therapists, and movement coaches correct technical exercise execution.

Overall our study shows a moderate reliability of the assessment tool. Noteworthy is the increase in intertester reliability from round 1 to round 2 in three of the four exercises indicating that examiners increase their accuracy in error spotting, which can be construed as a basic visual discrimination task. That kind of perceptual learning has been shown to improve with practice and can be viewed as local (in a retinotopic sense), as well as specific to the orientation of the visual target [38, 39], arguably the case in our study.

The one exercise not showing an improvement in intertester reliability between rounds is the bilateral scapulae retraction exercise. Investigating the subdomains indicates that the wrist and elbow position assessment decreases between the two examiners, that is, intertester reliability, from round 1 to round 2. It could be speculated that, because the majority of movement happens around the shoulder joint in the Bilateral raise, examiners might unintentionally pay more attention to that, because of the dynamic movement happening in that joint (shoulder) compared to the smaller joints (wrist and elbow), which primarily hold a static position throughout the movement. Directing attention towards the major moving part of the body could be an indication of momentary attentional drift of the examiner [40], but it still remains unclear why there is a drop in wΚ intertester reliability score in this particular exercise from round 1 to round 2. The intratester reliability of the two examiners in this study was fair to moderate with observer two showing poorer reproducibility of the assessment, especially when assessing unilateral shoulder external rotation. The lack of consistency between rounds for examiner 2 is difficult, if not impossible, to explain but again may be related to an attentional drift of the mind resulting in momentary inattentiveness.

Strengths of the present study include the number of participants being assessed and the simple assessment design. A further strength is that we assessed both intra- and intertester reliabilities, which gives information about reproducibility over time as well as between different assessors. Limitations to the present study include the lack of objective assessment measures, for example, joint angle kinematics and the constrained exercises demonstration of each participant limited to 2 sets of 10 repetitions. Had the exercise performance of each participant been recorded and the examiners allowed to see the video multiple times as well as having the option of slowing and freeze framing the video sequences the reliability scores might have been higher. Furthermore, having video footage of the examiners performing the assessments would have allowed our lab to analyze behaviour and state of attention. However, in most settings where time and equipment are limited such options are not viable, and simple screening tools are needed. Finally, it could be argued that the study is limited by only testing the reliability between two assessors. Theoretically, these reviewers could have been of above average visual assessment ability, which could provide a skewed result of inter- and intrarater reliability.

In conclusion the exercise error assessment demonstrated fair to substantial intratester and intertester reliability, which is congruent with previously published studies on movement assessment reliability, hence the simplicity of defining a neutral joint position for each of the involved joints in the exercise and categorizing the deviation in “some deviation” and “substantial deviation” to either side in a single plane is a viable solution when assessing simple exercises for errors during execution.


The authors thank physical therapists Teis Finsen and Tine Thomsen for valuable practical help during the project.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

1. Kilbom S,Armstrong T,Buckle P,et al. Musculoskeletal disorders: work-related risk factors and preventionInternational Journal of Occupational and Environmental HealthYear: 1996232392469933878
2. Punnett L,Wegman DH. Work-related musculoskeletal disorders: the epidemiologic evidence and the debateJournal of Electromyography and KinesiologyYear: 2004141132314759746
3. Hakala P,Rimpelä A,Salminen JJ,Virtanen SM,Rimpelä M. Back, neck, and shoulder pain in Finnish adolescents: national cross sectional surveysBritish Medical JournalYear: 200232573677437452-s2.0-003702717812364301
4. Ihlebaek C,Brage S,Eriksen HR. Health complaints and sickness absence in Norway, 1996–2003Occupational MedicineYear: 200757143492-s2.0-3384608687917046991
5. Ferrari R,Russell AS. Neck painBest Practice and Research Clinical RheumatologyYear: 2003171577012659821
6. Côté P,Cassidy JD,Carroll LJ,Kristman V. The annual incidence and course of neck pain in the general population: a population-based cohort studyPainYear: 200411232672732-s2.0-924423600215561381
7. Côté P,van der Velde G,Cassidy JD,et al. The burden and determinants of neck pain in workers. Results of the bone and joint decade 2000–2010 task force on neck pain and its associated disordersJournal of Manipulative and Physiological TherapeuticsYear: 2009322S70S862-s2.0-6154911016019251078
8. Gureje O,von Korff M,Simon GE,Gater R. Persistent pain and well-being: a World Health Organization study in primary careJournal of the American Medical AssociationYear: 199828021471512-s2.0-00324969039669787
9. Stewart A,Ware JE. Measuring Functioning and Well-BeingDuke University Press 1992,
10. Mannion AF,Elfering A,Staerkle R,et al. Outcome assessment in low back pain: how low can you go?European Spine JournalYear: 20051410101410262-s2.0-2914446332915937673
11. Plebani M,Carraro P. Mistakes in a stat laboratory: types and frequencyClinical ChemistryYear: 1997438134813512-s2.0-00307971249267312
12. Arena JG,Sherman RA,Bruno GM,Smith JD. The relationship between situational stress and phantom limb pain: cross-lagged correlational data from six month pain logsJournal of Psychosomatic ResearchYear: 199034171772-s2.0-00252166902313614
13. Hagberg M,Harms-Ringdahl K,Nisell R,Wigaeus Hjelm E. Rehabilitation of neck-shoulder pain in women industrial workers: a randomized trial comparing isometric shoulder endurance training with isometric shoulder strength trainingArchives of Physical Medicine and RehabilitationYear: 2000818105110582-s2.0-003386497510943754
14. Zebis MK,Andersen LL,Pedersen MT,et al. Implementation of neck/shoulder exercises for pain relief among industrial workers: a randomized controlled trialBMC Musculoskeletal DisordersYear: 201112, article 2052-s2.0-80053172971
15. Andersen LL,Saervoll CA,Mortensen OS,Poulsen OM,Hannerz H,Zebis MK. Effectiveness of small daily amounts of progressive resistance training for frequent neck/shoulder pain: randomised controlled trialPainYear: 201115224404462-s2.0-7865151805521177034
16. Viljanen M,Malmivaara A,Uitti J,Rinne M,Palmroos P,Laippala P. Effectiveness of dynamic muscle training, relaxation training, or ordinary activity for chronic neck pain: randomised controlled trialBritish Medical JournalYear: 200332774134754772-s2.0-004135224412946968
17. Jay K,Schraefel M,Andersen CH,et al. Effect of brief daily resistance training on rapid force development in painful neck and shoulder muscles: randomized controlled trialClinical Physiology and Functional ImagingYear: 201333538639223758661
18. Jay K,Jakobsen MD,Sundstrup E,et al. Effects of kettlebell training on postural coordination and jump performance: a randomized controlled trialJournal of Strength and Conditioning ResearchYear: 20132751202120922843044
19. Jay K,Frisch D,Hansen K,et al. Kettlebell training for musculoskeletal and cardiovascular health: a randomized controlled trialScandinavian Journal of Work, Environment and HealthYear: 20113731962032-s2.0-79957658138
20. Andersen LL,Zebis MK,Pedersen MT,et al. Protocol for work place adjusted intelligent physical exercise reducing musculoskeletal pain in Shoulder and neck (VIMS): a cluster randomized controlled trialBMC Musculoskeletal DisordersYear: 201011, article 1732-s2.0-77955193107
21. Andersen LL,Hansen K,Mortensen OS,Zebis MK. Prevalence and anatomical location of muscle tenderness in adults with nonspecific neck/shoulder painBMC Musculoskeletal DisordersYear: 201112, article 1692-s2.0-79960556833
22. Andersen CH,Andersen LL,Mortensen OS,Zebis MK,Sjøgaard G. Protocol for Shoulder function training reducing musculoskeletal pain in shoulder and neck: a randomized controlled trialBMC Musculoskeletal DisordersYear: 201112, article 142-s2.0-78651356372
23. Andersen LL,Jørgensen MB,Blangsted AK,Pedersen MT,Hansen EA,Sjøgaard G. A randomized controlled intervention trial to relieve and prevent neck/shoulder painMedicine and Science in Sports and ExerciseYear: 200840698399018461010
24. Andersen LL,Andersen JL,Suetta C,Kjaer M,Søgaard K,Sjøgaard G. Effect of contrasting physical exercise interventions on rapid force capacity of chronically painful musclesJournal of Applied PhysiologyYear: 200910751413141919762523
25. Andersen LL,Kjaer M,Søgaard K,Hansen L,Kryger AI,Sjøgaard G. Effect of two contrasting types of physical exercise on chronic neck muscle painArthritis Care and ResearchYear: 2008591849118163419
26. Wilson JJ,Best TM. Common overuse tendon problems: a review and recommendations for treatmentThe American Family PhysicianYear: 20057258118182-s2.0-24344436694
27. Almekinders L. Tendinitis and other chronic tendinopathiesJournal of the American Academy of Orthopaedic SurgeonsYear: 1998631571649682077
28. Salata M J,Nho S J,Chahal J,et al. Arthroscopic anatomy of the subdeltoid spaceOrthopedic ReviewsYear: 201353, article e25
29. Paine R,Voight ML. The role of the scapulaInternational Journal of Sports Physical TherapyYear: 20138561762924175141
30. King D. student writing contest winner: glenohumeral joint impingement in swimmersJournal of Athletic TrainingYear: 199530433333716558358
31. Rupp S,Berninger K,Hopf T. Shoulder problems in high level swimmers: impingement, anterior instability, muscular imbalance?International Journal of Sports MedicineYear: 19951685575622-s2.0-00296230778776212
32. Shultz R,Anderson SC,Matheson GO,Marcello B,Besier T. Test-retest and interrater reliability of the functional movement screenJournal of Athletic TrainingYear: 201348333133623675792
33. Landis JR,Koch GG. The measurement of observer agreement for categorical dataBiometricsYear: 19773311591742-s2.0-0017360990843571
34. Randall M,Carlin JB,Chondros P,Reddihough D. Reliability of the melbourne assessment of unilateral upper limb functionDevelopmental Medicine and Child NeurologyYear: 200143117617672-s2.0-003515712011730151
35. Chow SMK,Henderson SE. Interrater and test-retest reliability of the Movement Assessment Battery for Chinese preschool childrenThe American Journal of Occupational TherapyYear: 20035755745772-s2.0-064227486214527121
36. Smith CA,Chimera NJ,Wright NJ,Warren M. Interrater and intrarater reliability of the functional movement screenJournal of Strength and Conditioning ResearchYear: 201327498298722692121
37. Elias JE. The inter-rater reliability of the functional movement screen within an athletic population using untrained ratersJournal of Strength and Conditioning ResearchYear: 2013
38. Karni A,Sagi D. Where practice makes perfect in texture discrimination: evidence for primary visual cortex plasticityProceedings of the National Academy of Sciences of the United States of AmericaYear: 19918811496649702-s2.0-00259078422052578
39. Wallis G,Rolls ET. . Invariant face and object recognition in the visual systemProgress in NeurobiologyYear: 19975121671949247963
40. Wardak C,Denève S,Ben Hamed S. Focused visual attention distorts distance perception away from the attentional locusNeuropsychologiaYear: 20114935355452-s2.0-7955148039921147135

Article Categories:
  • Research Article

Previous Document:  Disturbances of Sperm Maturation and Minipuberty: Is There a Connection?
Next Document:  Automatic Detection and Quantification of Acute Cerebral Infarct by Fuzzy Clustering and Histographi...