Skip to main content
  • Other Publications
  • Subscribe
  • Contact Us
Advertisement
JCORE Reference
this is the JCORE Reference site slogan
  • Home
  • Most Read
  • About Us
    • About Us
    • Editorial Board
  • More
    • Advertising
    • Alerts
    • Feedback
    • Folders
    • Help
  • Patients
  • Reference Site Links
    • View Regions
  • Archive

Test-Retest Reliability of Dual-Task Outcome Measures in People With Parkinson Disease

Carolien Strouwen, Esther A.L.M. Molenaar, Samyra H.J. Keus, Liesbeth Münks, Bastiaan R. Bloem, Alice Nieuwboer
DOI: 10.2522/ptj.20150244 Published 1 August 2016
Carolien Strouwen
C. Strouwen, PT, PhD, Department of Rehabilitation Sciences, Faculty of Kinesiology and Rehabilitation, KU Leuven, Leuven, Belgium.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Esther A.L.M. Molenaar
E.A.L.M. Molenaar, PT, MSc, Department of Neurology, Nijmegen Centre for Evidence Based Practice, Radboud University Medical Center, Nijmegen, the Netherlands.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Samyra H.J. Keus
S.H.J. Keus, PT, PhD, Department of Neurology, Nijmegen Centre for Evidence Based Practice, Radboud University Medical Center.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Liesbeth Münks
L. Münks, PT, MSc, Department of Rehabilitation Sciences, Faculty of Kinesiology and Rehabilitation, KU Leuven.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bastiaan R. Bloem
B.R. Bloem, PhD, MD, Cognition and Behaviour, Department of Neurology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alice Nieuwboer
A. Nieuwboer, PT, PhD, Department of Rehabilitation Sciences, Faculty of Kinesiology and Rehabilitation, KU Leuven, Tervuursevest 101 Bus 1501, 3001 Leuven, Belgium.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Abstract

Background Dual-task (DT) training is gaining ground as a physical therapy intervention in people with Parkinson disease (PD). Future studies evaluating the effect of such interventions need reliable outcome measures. To date, the test-retest reliability of DT measures in patients with PD remains largely unknown.

Objective The purpose of this study was to assess the reliability of DT outcome measures in patients with PD.

Design A repeated-measures design was used.

Methods Patients with PD (“on” medication, Mini-Mental State Examination score ≥24) performed 2 cognitive tasks (ie, backward digit span task and auditory Stroop task) and 1 functional task (ie, mobile phone task) in combination with walking. Tasks were assessed at 2 time points (same hour) with an interval of 6 weeks. Test-retest reliability was assessed for gait while performing each secondary task (DT gait) for both cognitive tasks while walking (DT cognitive) and for the functional task while walking (DT functional).

Results Sixty-two patients with PD (age=39–89 years, Hoehn and Yahr stages II–III) were included in the study. Intraclass correlation coefficients (ICCs) showed excellent reliability for DT gait measures, ranging between .86 and .95 when combined with the digit span task, between .86 and .95 when combined with the auditory Stroop task, and between .72 and .90 when combined with the mobile phone task. The standard error of measurements for DT gait speed varied between 0.06 and 0.08 m/s, leading to minimal detectable changes between 0.16 and 0.22 m/s. With regard to DT cognitive measures, reaction times showed good-to-excellent reliability (digit span task: ICC=.75; auditory Stroop task: ICC=.82).

Limitations The results cannot be generalized to patients with advanced disease or to other DT measures.

Conclusions In people with PD, DT measures proved to be reliable for use in clinical studies and look promising for use in clinical practice to assess improvements after DT training. Large effects, however, are needed to obtain meaningful effect sizes.

Dual tasking, defined as the simultaneous performance of 2 tasks with distinct goals,1 has been found to lead to decreased motor and cognitive performance in patients with Parkinson disease (PD).2–5 Both gait parameters and cognitive task performance deteriorate when walking while dual tasking in people with PD.2,3,6 Gait characteristics that represent postural control are especially vulnerable to dual-task (DT) interference.7 However, in people with early PD, it was shown that DT interference was very similar to that of controls,7 illustrating the complexity of DT behavior. Not only disease severity1,5 but also age-related changes in brain mass affect the degree of attention allocated to combine 2 or more tasks.8 Experience with and the difficulty level of the tasks, in combination with the environment in which the tasks are performed, further contribute to variable DT responses.5,9 In people with PD, the extent of the loss of movement automaticity5,10 and the effectiveness of medication11 play additional roles. Finally, the priority assigned to each of the tasks is of crucial importance.12 In general, people with PD use a “posture second” strategy in which they deprioritize gait or balance performance.9,13 However, they are able to change their focus when instructed to do so.14 Given the multitude of factors that influence DT performance and the consequential large variation in DT responses between and within people, it is plausible to assume that reliability of DT measures may be compromised and needs to be examined thoroughly before using them in clinical studies.

In PD, the reliability of DT gait outcomes is currently unknown, but that of single-task (ST) walking speed was demonstrated for comfortable and fast 10-m walks (intraclass correlation coefficient [ICC]=.98 and .99, respectively)15,16 within the same day, across multiple days, and in the home environment.17 In healthy elderly people, good reliability was found for DT walking in combination with a forward digit span task (ICC=.83),18 and almost perfect reliability was found for DT walking in combination with counting backward.19 Also, in people with frontotemporal degeneration,19 those prone to falling,20 and those with mild cognitive impairment,21 stroke,22 and multiple sclerosis,23 DT walking tests proved to be reliable.

Dual tasking will not only interfere with gait but also interfere with cognitive performance. In a study of healthy elderly people,18 reliable results were found on the DT digit span with a test interval of a maximum of 1 week. Other studies in healthy older adults20,24 demonstrated that speed and accuracy for various DT cognitive tests showed poor-to-good reliability, with ICC values ranging from −.16 to .83. The reliability of DT cognitive tests in PD is currently not known.

Recently, some preliminary training studies assessed the potential benefit of DT training in PD.25–27 In addition, a systematic review of DT postural training in older adults suggested positive effects, although firm conclusions were hampered by the heterogeneity of the outcome measures.28 Reliable outcome measures for DT interventions, therefore, are needed for people with PD and for older adults to address this lacuna. Training studies often include interventions that last several weeks. It is plausible to assume that the factors that influence DT performance will become less stable and less well controlled with increasing time intervals. Hence, the reliability over longer time spans needs to be established to be able to interpret the actual significance of training effects. Given this overview, the aim of the present study was to assess the reliability of DT gait and cognitive measures in people with PD and calculate minimal detectable change (MDC) scores over a period of 6 weeks, a common duration of training in PD studies.

Gait requires dynamic balance and coordinated movements, and its multidimensional nature currently can be captured in different outcomes.29 As various gait outcomes previously showed different DT interference,7 we addressed DT reliability separately for 5 different gait domains: pace, rhythm, postural control, asymmetry, and variability.30 These domains also may have a different contribution to various clinical phenomena. For instance, variability outcomes were found to be more sensitive than other domains for predicting falling.31 However, unlike spatiotemporal measures,32 the reliability of variability measures ranged from poor to excellent (ICC=.04–.86) and improved only by increasing the number of steps analyzed.15,18,19

In this study, cognition was assessed with 3 different tasks: an auditory Stroop task, a backward digit span task, and a mobile phone task. The auditory Stroop task addresses set shifting ability and incongruent response inhibition.33,34 The backward digit span task tests the working memory component of executive function.34 Given the importance of inducing transfer of training to daily life dual tasking, we also studied the reliability of a functional DT. For this purpose, we devised a mobile phone task consisting of fine motor, memory, and executive components.25 We hypothesized that the reliability of DT measures would be more compromised than that of ST measures, as dual tasking introduces both motor and cognitive sources of variability. We also expected that interference measures would be less reliable than absolute DT measures and that the variability domain of gait would be the least stable over time. Furthermore, we predicted that reliability would be worse in the mobile phone task, given the complexity of this task.

Method

Participants

Participants were recruited as part of the DUALITY study.25 The Belgian subsample of this study, consisting of 62 people with PD, was used to assess test-retest reliability. Inclusion criteria for recruitment were: (1) diagnosis of PD according to the UK Brain Bank criteria,35 (2) Hoehn and Yahr (H&Y) stage ≤3 in the subjective best “on” phase of the medication cycle,36 (3) able to walk for 10 minutes continuously, (4) presence of DT interference as established by a structured checklist,25 (5) score of ≥24 on the Mini-Mental State Examination (MMSE),37 (6) stable medication over the previous 3 months, (7) no hearing or visual problems that interfere with testing or training, and (8) stable deep brain stimulator (DBS) settings over the previous year.

Testing

The first 2 baseline assessments, as described in the protocol of the DUALITY trial,25 were used to assess test-retest reliability. A clinical test battery was performed, assessing several descriptive, disease, and cognitive characteristics of the participants.25 Assessments were performed in the “on” phase at a standardized moment after medication intake. In both test sessions, the same person (C.S.), who has a physical therapy background, conducted the tests. The DT assessments consisted of 3 different tests: (1) walking while performing the backward digit span task, (2) walking while performing the auditory Stroop task, and (3) walking while performing the mobile phone task. These tasks also were assessed in a sitting position. In addition, walking was assessed without these tasks (ST gait).

During the auditory Stroop task, patients were asked to verbally respond to the words “high” and “low” pronounced with congruent and incongruent high and low tones delivered via headphones. Stimuli were presented with a variable interval (1.5–2 seconds) to control for cueing effects. During the digit span task, participants were asked to repeat an array of numbers in reverse order, the length of which was adapted to the level of the individual determined in a sitting position.7 The optimal sequence length for each individual was determined with the subscale item “digit span backward” as part of the Scales for Outcomes in Parkinson's Disease–Cognition (SCOPA-Cog),38 of which the arrays were not included in the actual ST and DT assessments. Cognitive task performance during the digit span and auditory Stroop tasks was recorded via a wireless headset system (t-bone DS16T transmitter and t-bone IEM100R receiver, Beyerdynamic Inc, Farmingdale, New York). The mobile phone task made use of a large-button mobile phone (Emporia Talk Premium, Linz, Austria). For this task, participants had to type the test date (8 numbers) using the phone's keyboard. Participants were instructed to hold the phone in one hand and to type with the other hand. They were free to choose which hand they used for typing. For the digit span and auditory Stroop tasks, there were 3 different versions that were repeated twice in the ST and DT conditions. For the digit span task, in each version, different numbers were presented to the participant. For the auditory Stroop task, in each version, different stimuli were presented. The mobile phone task consisted of one version that was repeated twice in both conditions.

Gait data were collected with the GAITRite Walkway System (GAITRite Platinum software version 4.0, CIR Systems Inc, Peekskill, New York), which has excellent reliability.32,39 Data were sampled at a frequency of 120 Hz over an active length of 792 cm. Participants walked at their preferred walking speed and started and ended walking 1 m before and after the mat to exclude acceleration and deceleration. The ST and DT conditions were randomized, but the order of testing was kept the same for each individual across test sessions. Participants were asked to concentrate on both tasks during dual tasking and were instructed as follows: “Walk over the GAITRite mat in the same way as you would normally walk while performing a concurrent task.” Instructions were given by the same tester before the start of the assessment and repeated with each new task. Specific instructions for the backward digit span task were: “You will hear an array of numbers through the headphones. After this array has finished, please repeat the numbers in a reverse order, starting with the last number you have heard.” Specific instructions for the auditory Stroop task were: “Through the headphones, you will hear the words ‘high’ and ‘low,’ pronounced in a high or low pitch. Please indicate whether the pitch that you've heard was high or low, regardless of the word you have heard.” For the mobile phone task, the following instructions were provided to the patient: “We will now give you this mobile phone. Please type the date of today into the device.” Before actual assessment, the tester checked whether participants had understood these instructions. In the rare case of freezing or voluntary stops, the trial was stopped and repeated to obtain valid data.

Descriptors

We collected information on age, height, weight, disease duration, H&Y stage,36 medication intake, physical therapy, freezing of gait, falls, MMSE,37 Montreal Cognitive Assessment (MoCA),40 Frontal Assessment Battery (FAB),41 and Movement Disorder Society–Unified Parkinson's Disease Rating Scale (MDS-UPDRS) total score.42 Tests that were performed in both sessions to document disease and cognitive status over time were: Unified Parkinson's Disease Rating Scale–part III (UPDRS-III)42; Freezing of Gait Questionnaire43; Activities-specific Balance Confidence scale44; and, as a general cognitive scale, the SCOPA-Cog.38 We also included 2 executive function tests, the Alternating Names Test and the Alternating Intakes Test,45 which required the verbal listing of alternating boys' and girls' names and food and drink products, respectively.

ST and DT Gait Outcomes

We analyzed reliability in the 5 domains of gait30 as follows: (1) gait speed and stride length (pace); (2) cadence, stride time, and swing percentage (rhythm); (3) stride width (postural control); (4) step length asymmetry (asymmetry); and (5) within-patient standard deviations of stride length and stride time (variability). We also calculated the proportional DT interference using the following formula: (ST performance − DT performance)/ST performance. Dual-task interference was determined for gait speed, cadence, stride length, stride time, and stride width.

ST and DT Cognitive Outcomes

To assess ST and DT cognitive outcomes, we calculated reaction times (for the digit span and auditory Stroop tasks), response times (for the digit span task), and errors (for the digit span, auditory Stroop, and mobile phone tasks). Verbal responses were recorded and analyzed with the Audacity 1.3 Beta program (Free Software Foundation, Boston, Massachusetts) and Matlab (R2011b) (The Mathworks Inc, Natick, Massachusetts). For the digit span task, reaction times were determined as the time between the end of the sound fragment and the beginning of the response of the patient. Response time was defined as the time it took to reproduce the span divided by the total duration of the span recorded on tape to account for differences in span levels among the participants. For the auditory Stroop task, reaction time was calculated as the time between the beginning of the stimulus and the beginning of the response of the patient. Interference was calculated for DT cognitive measures in the same manner as described for gait.

Data Analysis

To meet the minimum number of steps needed to calculate reliable DT gait outcomes with the GAITRite system,15,21,46 we averaged the results of all trials in each test session. Therefore, calculations were based on between 65 and 125 steps for each patient for the digit span and auditory Stroop tasks and between 21 and 77 steps for the mobile phone task. Data were analyzed using IBM SPSS Statistics for Windows version 22 (IBM Corp, Armonk, New York).47 Normality of the data was assessed with the Kolmogorov-Smirnov test, QQ-plots, and histograms. Mean and standard deviation are provided for normally distributed data. Median and interquartile range are given for non-normally distributed data. We used t tests and the calculation of Cohen d effect sizes to look for systematic differences between tests 1 and 2. To assess reliability, ICC values were calculated with a 2-way random-effects model with absolute agreement.48,49 We used ICC values for averaged measurements and applied Shrout and Fleiss' cutoffs of <.40 as poor, .40 to .75 as fair to good, and >.75 as excellent.48 For data that were normally distributed, we calculated the standard error of measurement (SEM=SDpooled × √[1−ICC]) and the MDC (MDC=SEM × 1.96 × √[2]).49 The SEM provides an absolute index for reliability, largely independent from the population from which it was determined.49 The MDC is used to determine whether a change in score can be considered without measurement error.49 As SEM and MDC could not be calculated for abnormally distributed data, we used Wilcoxon signed rank tests to assess systematic differences between test sessions and Spearman correlation coefficients to indicate reliability, using Landis and Koch's50 cutoffs of >.80 as almost perfect and between .61 and .80 as substantial. We used Bland and Altman plots51 to visualize the mean difference between the 2 tests for DT gait speed.

Role of the Funding Source

This work was funded by the Jacques and Gloria Gossweiler Foundation.

Results

Descriptive Data

Descriptive data of the participants are presented in Table 1. Of the 62 patients with PD included in this study, 71.0% were male and 29.0% female. The majority of participants were in H&Y stage 2 (61.0%) or 3 (36.0%). More than half (56.5%) of the participants indicated that they had fallen in the year previous to the first assessment, and 54.8% had freezing of gait. Although all participants had an MMSE score ≥24, 16 participants scored lower than 24 on the MoCA. Four participants had an FAB score lower than 13, the cutoff for frontal cognitive impairment.52 The average number of digits that participants could repeat backwards was 4.21 (SD=1.16).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1.

Participants' Descriptive Data (N=62)a

Table 2 summarizes participants' evolution over the 6-week follow-up period for a number of disease characteristics, showing that they remained largely stable. During the second test, one participant changed from H&Y stage 3 to stage 2. All other participants were ranked in the same way. Medication dose changed for 8 participants in the period between test 1 and test 2, but average dose did not differ in the 6-week period. Two participants had a higher levodopa equivalent dose in test 2, 2 participants had a lower levodopa equivalent dose in test 2, and 4 participants had a change in DBS parameters. The t tests revealed significantly better scores in test 2 for UPDRS-III and SCOPA-Cog. Effect sizes for these differences ranged from small to medium (0.17, −0.34, and −0.19 milliseconds, respectively). All other measures were constant.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2.

Test-Retest Scores for General Disease Characteristics During the Study Perioda

Reliability of ST and DT Gait Parameters

Bland and Altman plots are presented in the Figure. Points were equally distributed around zero, showing no bias in the results and a similar pattern for ST and DT gait speed. In all DT conditions, overall scores fell within the limits of agreement, around 0.20 m/s for the digit span and auditory Stroop tasks. The limits of agreement were larger for the mobile phone task (around 0.30 m/s), indicating more variability than in the digit span and auditory Stroop gait measures. The ST gait parameters showed excellent reliability, with ICC values ranging from .77 to .94 (eTab. 1).

Figure.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure.

Bland and Altman plots for single-task (ST) and dual-task (DT) gait speed: (A) ST gait speed, (B) DT digit span task gait speed, (C) DT auditory Stroop task gait speed, and (D) DT mobile phone task gait speed. The plots represent the difference between test 1 and test 2 (y-axis) plotted against the average of test 1 and test 2 (x-axis). The average difference between test 1 and test 2 is presented as a horizontal line on the plot (middle line), and the upper and lower lines represent the 95% upper and lower limits of these differences between the 2 tests.

The ICC values for DT digit span task gait ranged from .87 to .95, also indicating excellent reliability (Tab. 3). Spearman correlation coefficients for variability and asymmetry parameters, which did not allow calculation of ICCs, were moderate to substantial (.44–.74). When analyzing the results in more detail, Table 3 reveals that a significantly better performance in test 2 was found in the gait domains of rhythm (cadence and stride time), postural control (stride width), and variability (stride length and stride time). Effect sizes, however, were small (−0.19 to 0.28). In addition, these changes were not correlated with changes in MDS-UPDRS scores (cadence: r=−.16, P=.23) or SCOPA-Cog scores (cadence: r=−.11, P=.41). The ICC values for the digit span interference measures, calculated as a percentage of the ST measure, ranged from .47 to .72, indicating fair-to-good reliability (eTab. 2). Here, a systematically lower DT interference in test 2 was shown for speed, cadence, and stride time. The SEM for DT digit span task gait speed was 0.06 m/s, leading to an MDC score of 0.16 m/s.

View this table:
  • View inline
  • View popup
Table 3.

Test-Retest Scores for Dual-Task Gait Parametersa

A similar pattern of results emerged from walking while performing the auditory Stroop task (Tab. 3). Absolute values for DT auditory Stroop task gait showed excellent reliability (.89–.94), whereas interference measures showed poor-to-good reliability (.19–.81). Parameters belonging to the variability and asymmetry domains showed moderate-to-substantial correlations (.52–.77). Interestingly, no systematic differences were found between test 1 and test 2 for the DT auditory Stroop task gait outcomes. The SEM for DT auditory Stroop task gait speed was 0.06 m/s, and the MDC score was 0.16 m/s.

Good-to-excellent reliability (ICC=.72–.89) was found for performing the mobile phone task during gait. For the auditory Stroop and digit span tasks, a moderate correlation was seen for the variability and asymmetry domains (rs=.48–.58). Reliability of the DT interference measures for the mobile phone task was good (ICCs=.64–.74). However, interference measures for speed, cadence, and stride time were systematically lower during test 2, albeit with small effect sizes (−0.29 to 0.27). The SEM for gait speed during the mobile phone task was 0.08 m/s, and the MDC score was 0.22 m/s.

Reliability of ST and DT Cognitive Parameters

Table 4 illustrates that DT cognitive task outcomes were less stable than DT gait outcomes. Reliability measures were fair to good for the DT backward digit span task (reaction time: ICC=.75; response time: ICC=.69), but not for interference measures (interference reaction time: ICC=.41; interference response time: rs=.09) (eTab. 3). Significantly fewer errors were made on the digit span task during test 2 compared with test 1. The SEM values were 266.31 milliseconds for DT digit span task reaction time and 184.12 milliseconds for DT digit span task response time, leading to an MDC score of 738.16 milliseconds and 510.35 milliseconds, respectively.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 4.

Test-Retest Scores for DT Cognitive Task Measuresa

For the auditory Stroop task, excellent values were found for absolute measures of reaction time (ICC=.82), but values were lower for interference measures (rs=.59). Errors during dual tasking did not appear to correlate well between the 2 test sessions (rs=.41), although no systematic difference was seen (median=0). The SEM for DT Stroop reaction time was 86.31 milliseconds, resulting in an MDC score of 239.24 milliseconds. Dual-task errors while performing the mobile phone task were not correlated between tests (rs=.21).

Discussion

In line with previous studies in the elderly population and in people with neurological disorders,18–23 we found that DT gait measures in people with PD showed excellent reliability over a period of 6 weeks using standard tests of executive function (auditory Stroop and digit span tasks) as DT measures. The functional task, the manipulation of a mobile phone during gait, showed slightly worse reliability, probably as a result of greater task complexity. Overall, DT gait reliability was comparable to that of ST gait. Furthermore, DT cognitive performance, expressed as absolute values of reaction times, showed good-to-excellent reliability. These results support the use of DT gait and DT cognitive outcomes to assess patients' evolution over time in longitudinal studies and in clinical practice.

Proportional interference values, expressed as a percentage of ST performance, had lower reliability than absolute values for both gait and cognitive performance. We expected interference measures to have more compromised reliability, as variability inherent to ST and DT performance may play a role. In addition, when assessing effects of DT training, there may be an effect on both ST and DT performance. Therefore, interference measures may be less suitable as primary outcomes in studies with multiple assessments in the same population. However, they can be relevant when comparing 2 different populations in a single test session or when comparing the DT cost of different secondary tasks.

Repeatability in different domains of gait30 was assessed to obtain a better understanding of DT effects in PD. Dual-task gait measures representing pace, rhythm, and postural control had excellent test-retest reliability over a period of 6 weeks. In contrast, variability and asymmetry showed moderate-to-substantial reliability. Variability reflects the stride-to-stride fluctuations within one individual. It was found to be higher in patients with PD and interpreted as reflecting decreased automaticity and higher input of cognition required for motor control.53 In this sample, variability and asymmetry were found to have a skewed distribution, showing greater variation in people with PD than in healthy elderly people. This finding is in line with earlier work,15,46 which showed that more than 30 to 100 steps are needed to assess variability during ST in a reliable way. The number of steps per task in this study varied between 65 and 125 for the digit span and auditory Stroop tasks and between 21 and 77 for the mobile phone task. Although these numbers are considered sufficient for ST gait,46 they might have been insufficient to assess DT gait. For other gait domains, however, the number of steps included in this study seemed adequate. Future study is needed to address the number of steps that are minimally needed to achieve stable DT variability measurements.

This is the first study, to our knowledge, to evaluate the reliability of DT cognitive measures in PD. We found that cognitive performance showed lower reliability than gait in ST and DT conditions (eTab. 3 and eTab. 4). Several factors, such as a good night's sleep prior to testing, attention, and emotional state, may influence cognitive performance to a greater extent than gait performance.54 The degree of cognitive challenge and the high level of executive dysfunction55 also might have affected test-retest stability. Sixteen participants (25.8%) had scores lower than 24 on the MoCA, and 4 (6.5%) had low FAB scores. Also, learning effects from one test to the other may be greater for cognitive tasks than for gait tasks, as gait is habitual behavior and cognitive tests require more goal-directed control.56 To counteract this possible learning effect, a washout period may be recommended when assessing cognitive tasks repeatedly. We found that the backward digit span task in particular was subject to learning effects, despite the fact that we individualized the length of the digit span.7 We found no correlation between DT digit span task improvements and better UPDRS-III and SCOPA-Cog scores at test 2 compared with test 1. Therefore, the learning effects are unlikely due to patients' generally better disease and cognitive state at test 2. In contrast to the Stroop task, which was performed without any errors in test 1, the backward digit span task did show baseline errors. This finding points to a possible ceiling effect for the auditory Stroop task, which might have masked learning effects. Finally, the nature of the digit span task might have stimulated patients to practice, whereas for the auditory Stroop task, this was not possible. Cognitive performance was measured by reaction times and error scores. As the error scores showed very low reliability, we recommend that error scores not be used as a DT cognitive outcome measure.

Reliability was assessed for 3 different DT measures, each representing different domains of executive function. This study demonstrated that the digit span and auditory Stroop tasks had comparable reliability levels, whereas the ICC values for the mobile phone task were somewhat lower. Both the digit span and auditory Stroop tasks are purely cognitive tasks relying on executive function, albeit in different domains. The mobile phone task, however, represents a functional task, relying on visual and motor control of the display functions and remembering the date. The greater complexity of this task and the fact that it induced more interference may explain the somewhat lower reliability. These findings are in contrast to those of Muhaidat et al,20 who compared 8 different tests but did not find lower reliability for the more complex tasks. However, as reliability of the mobile phone task could still be considered as very good, this task may be particularly suitable to assess DT problems in clinical practice. Using a mobile phone is not only relevant for daily life but also user-friendly, as most patients and clinicians have this tool at their disposal.

The MDC values found in this study, indicating clinically relevant DT changes, were comparable to previous findings on test-retest reliability of ST measures. Reference MDC values of ST gait speed16,57 were found to range between 0.09 and 0.18 m/s. Monticone et al23 reported MDC values for gait speed of 0.13 m/s for a motor-motor DT measure and of 0.19 m/s for a motor-cognitive DT measure in people with multiple sclerosis. In the current study, MDC values for DT gait speed were 0.16 m/s for the digit span task, 0.16 m/s for the auditory Stroop task, and 0.22 m/s for the mobile phone task. These findings imply that in order to achieve an effect of DT training, which is beyond measurement error, patients with PD should improve their gait speed with large effect sizes. Calculated as a percentage of the current baseline DT gait speed, this would amount to 17% for the digit span task, 17% for the auditory Stroop task, and 26% for the mobile phone task.

The current study assessed DT reliability in a large group of people with PD, giving sufficient power to the results. Limitations of the study are that MDC values could not be provided for all parameters assessed, due to skewed distributions. The results cannot be generalized to tasks other than those used in this study or to late-stage PD. We also recommend that future DT reliability studies address other possible sources of variability, such as age, cognitive impairment, and the presence of freezing of gait. Eight patients in this study had a change in prescribed medication dose. As this is a common problem in clinical studies, future sensitivity analyses comparing groups with and without changes in medication could be conducted to determine how this factor affects reliability of DT outcomes.

In conclusion, this study showed that DT gait can be measured reliably in people with PD when repeating assessments over a 6-week period. However, large effect sizes are needed to induce clinically relevant changes, extending beyond the MDC values. We found that absolute values of DT performance are more reliable than proportional values and that cognitive DT performance, expressed as reaction time but not as error rates, can be ascertained reliably. Although a higher variation was found in the mobile phone task, this task proved to be a reliable functional dual-task test, which is suitable for use in clinical practice.

Footnotes

  • Dr Keus and Professor Nieuwboer provided concept/idea/research design. Dr Strouwen and Professor Nieuwboer undertook the writing. Dr Strouwen, Mrs Molenaar, Dr Keus, Mrs Münks, and Professor Bloem were responsible for data collection. Dr Strouwen and Professor Nieuwboer performed data analysis. Professor Nieuwboer, Mrs Molenaar, Dr Keus, and Professor Bloem provided project management. Mrs Molenaar, Mrs Münks, Dr Keus, and Professor Bloem provided consultation (including review of manuscript before submission). The authors thank all patients who participated in the study.

  • Ethical approval for the study was obtained (CME KU Leuven–B322201213165/S53419).

  • This work was funded by the Jacques and Gloria Gossweiler Foundation.

  • The DUALITY trial was registered on ClinicalTrials.gov (NCT01375413).

  • Received May 19, 2015.
  • Accepted January 25, 2016.
  • © 2016 American Physical Therapy Association

References

  1. ↵
    1. McIsaac TL,
    2. Benjapalakorn B
    . Allocation of attention and dual-task effects on upper and lower limb task performance in healthy young adults. Exp Brain Res. 2015;233:2607–2617.
    OpenUrlCrossRefPubMed
  2. ↵
    1. O'Shea S,
    2. Morris ME,
    3. Iansek R
    . Dual task interference during gait in people with Parkinson disease: effects of motor versus cognitive secondary tasks. Phys Ther. 2002;82:888–897.
    OpenUrlAbstract/FREE Full Text
  3. ↵
    1. Wild LB,
    2. de Lima DB,
    3. Balardin JB,
    4. et al
    . Characterization of cognitive and motor performance during dual-tasking in healthy older adults and patients with Parkinson's disease. J Neurol. 2013;260:580–589.
    OpenUrlCrossRefPubMedWeb of Science
  4. ↵
    1. Fuller RL,
    2. Van Winkle EP,
    3. Anderson KE,
    4. et al
    . Dual task performance in Parkinson's disease: a sensitive predictor of impairment and disability. Parkinsonism Relat Disord. 2013;19:325–328.
    OpenUrlCrossRefPubMed
  5. ↵
    1. Kelly VE,
    2. Eusterbrock AJ,
    3. Shumway-Cook A
    . A review of dual-task walking deficits in people with Parkinson's disease: motor and cognitive contributions, mechanisms, and clinical implications. Parkinsons Dis. 2012;2012:918719.
    OpenUrlPubMed
  6. ↵
    1. Yogev G,
    2. Giladi N,
    3. Peretz C,
    4. et al
    . Dual tasking, gait rhythmicity, and Parkinson's disease: which aspects of gait are attention demanding? Eur J Neurosci. 2005;22:1248–1256.
    OpenUrlCrossRefPubMedWeb of Science
  7. ↵
    1. Rochester L,
    2. Galna B,
    3. Lord S,
    4. Burn D
    . The nature of dual-task interference during gait in incident Parkinson's disease. Neuroscience. 2014;265:83–94.
    OpenUrlCrossRefPubMed
  8. ↵
    1. Gratwicke J,
    2. Jahanshahi M,
    3. Foltynie T
    . Parkinson's disease dementia: a neural networks perspective. Brain. 2015;138:1454–1476.
    OpenUrlAbstract/FREE Full Text
  9. ↵
    1. Yogev-Seligmann G,
    2. Hausdorff JM,
    3. Giladi N
    . Do we always prioritize balance when walking? Towards an integrated model of task prioritization. Mov Disord. 2012;27:765–770.
    OpenUrlCrossRefPubMed
  10. ↵
    1. Wu T,
    2. Hallett M
    . A functional MRI study of automatic movements in patients with Parkinson's disease. Brain. 2005;128:2250–2259.
    OpenUrlAbstract/FREE Full Text
  11. ↵
    1. Bryant MS,
    2. Rintala DH,
    3. Hou JG,
    4. et al
    . Effects of levodopa on forward and backward gait patterns in persons with Parkinson's disease. NeuroRehabilitation. 2011;29:247–252.
    OpenUrlPubMed
  12. ↵
    1. Amboni M,
    2. Barone P,
    3. Hausdorff JM
    . Cognitive contributions to gait and falls: Evidence and implications. Mov Disord. 2013;28:1520–1533.
    OpenUrlCrossRefPubMed
  13. ↵
    1. Bloem BR,
    2. Grimbergen YA,
    3. van Dijk JG,
    4. Munneke M
    . The “posture second” strategy: a review of wrong priorities in Parkinson's disease. J Neurol Sci. 2006;248:196–204.
    OpenUrlCrossRefPubMedWeb of Science
  14. ↵
    1. Kelly VE,
    2. Shumway-Cook A
    . The ability of people with Parkinson's disease to modify dual-task performance in response to instructions during simple and complex walking tasks. Exp Brain Res. 2014;232:263–271.
    OpenUrlCrossRefPubMedWeb of Science
  15. ↵
    1. Galna B,
    2. Lord S,
    3. Rochester L
    . Is gait variability reliable in older adults and Parkinson's disease? Towards an optimal testing protocol. Gait Posture. 2013;37:580–585.
    OpenUrlCrossRefPubMedWeb of Science
  16. ↵
    1. Combs SA,
    2. Diehl MD,
    3. Filip J,
    4. Long E
    . Short-distance walking speed tests in people with Parkinson disease: Reliability, responsiveness, and validity. Gait Posture. 2014;39:784–788.
    OpenUrlCrossRefPubMed
  17. ↵
    1. Lim LI,
    2. van Wegen EE,
    3. de Goede CJ,
    4. et al
    . Measuring gait and gait-related activities in Parkinson's patients own home environment: a reliability, responsiveness and feasibility study. Parkinsonism Relat Disord. 2005;11:19–24.
    OpenUrlCrossRefPubMedWeb of Science
  18. ↵
    1. McCulloch KL,
    2. Mercer V,
    3. Giuliani C,
    4. Marshall S
    . Development of a clinical measure of dual-task performance in walking: reliability and preliminary validity of the Walking and Remembering Test. J Geriatr Phys Ther. 2009;32:2–9.
    OpenUrlPubMed
  19. ↵
    1. Beauchet O,
    2. Freiberger E,
    3. Annweiler C,
    4. et al
    . Test-retest reliability of stride time variability while dual tasking in healthy and demented adults with frontotemporal degeneration. J Neuroeng Rehabil. 2011;8:37.
    OpenUrlCrossRefPubMed
  20. ↵
    1. Muhaidat J,
    2. Kerr A,
    3. Evans JJ,
    4. Skelton DA
    . The test-retest reliability of gait-related dual task performance in community-dwelling fallers and non-fallers. Gait Posture. 2013;38:43–50.
    OpenUrlCrossRefPubMed
  21. ↵
    1. Montero-Odasso M,
    2. Casas A,
    3. Hansen KT,
    4. et al
    . Quantitative gait analysis under dual-task in older people with mild cognitive impairment: a reliability study. J Neuroeng Rehabil. 2009;6:35.
    OpenUrlCrossRefPubMed
  22. ↵
    1. Cho KH,
    2. Lee HJ,
    3. Lee WH
    . Test-retest reliability of the GAITRite walkway system for the spatio-temporal gait parameters while dual-tasking in post-stroke patients. Disabil Rehabil. 2015;37:512–516.
    OpenUrlCrossRefPubMed
  23. ↵
    1. Monticone M,
    2. Ambrosini E,
    3. Fiorentini R,
    4. et al
    . Reliability of spatial-temporal gait parameters during dual-task interference in people with multiple sclerosis: a cross-sectional study. Gait Posture. 2014;40:715–718.
    OpenUrlCrossRefPubMed
  24. ↵
    1. Szturm T,
    2. Sakhalkar V,
    3. Boreskie S,
    4. et al
    . Integrated testing of standing balance and cognition: test-retest reliability and construct validity. Gait Posture. 2015;41:146–152.
    OpenUrlCrossRefPubMed
  25. ↵
    1. Strouwen C,
    2. Molenaar EA,
    3. Keus SH,
    4. et al
    . Protocol for a randomized comparison of integrated versus consecutive dual task practice in Parkinson's disease: the DUALITY trial. BMC Neurol. 2014;14:61.
    OpenUrlCrossRefPubMed
  26. ↵
    1. Mirelman A,
    2. Maidan I,
    3. Herman T,
    4. et al
    . Virtual reality for gait training: can it induce motor learning to enhance complex walking and reduce fall risk in patients with Parkinson's disease? J Gerontol A Biol Sci Med Sci. 2011;66:234–240.
    OpenUrlPubMedWeb of Science
  27. ↵
    1. Brauer SG,
    2. Woollacott MH,
    3. Lamont R,
    4. et al
    . Single and dual task gait training in people with Parkinson's disease: a protocol for a randomised controlled trial. BMC Neurol. 2011;11:90.
    OpenUrlCrossRefPubMed
  28. ↵
    1. Agmon M,
    2. Belza B,
    3. Nguyen HQ,
    4. et al
    . A systematic review of interventions conducted in clinical or community settings to improve dual-task postural control in older adults. Clin Interv Aging. 2014;9:477–492.
    OpenUrlPubMed
  29. ↵
    1. Hobert MA,
    2. Maetzler W,
    3. Aminian K,
    4. Chiari L
    . Technical and clinical view on ambulatory assessment in Parkinson's disease. Acta Neurol Scand. 2014;130:139–147.
    OpenUrlCrossRefPubMedWeb of Science
  30. ↵
    1. Lord S,
    2. Galna B,
    3. Verghese J,
    4. et al
    . Independent domains of gait in older adults and associated motor and nonmotor attributes: validation of a factor analysis approach. J Gerontol A Biol Sci Med Sci. 2013;68:820–827.
    OpenUrlAbstract/FREE Full Text
  31. ↵
    1. Hausdorff JM
    . Gait dynamics in Parkinson's disease: common and distinct behavior among stride length, gait variability, and fractal-like scaling. Chaos. 2009;19:026113.
  32. ↵
    1. Menz HB,
    2. Latt MD,
    3. Tiedemann A,
    4. et al
    . Reliability of the GAITRite® walkway system for the quantification of temporo-spatial parameters of gait in young and older people. Gait Posture. 2004;20:20–25.
    OpenUrlCrossRefPubMedWeb of Science
  33. ↵
    1. Plotnik M,
    2. Dagan Y,
    3. Gurevich T,
    4. et al
    . Effects of cognitive function on gait and dual tasking abilities in patients with Parkinson's disease suffering from motor response fluctuations. Exp Brain Res. 2011;208:169–179.
    OpenUrlCrossRefPubMedWeb of Science
  34. ↵
    1. Al-Yahya E,
    2. Dawes H,
    3. Smith L,
    4. et al
    . Cognitive motor interference while walking: a systematic review and meta-analysis. Neurosci Biobehav Rev. 2011;35:715–728.
    OpenUrlCrossRefPubMed
  35. ↵
    1. Hughes AJ,
    2. Daniel SE,
    3. Kilford L,
    4. Lees AJ
    . Accuracy of clinical diagnosis of idiopathic Parkinson's disease: a clinico-pathological study of 100 cases. J Neurol Neurosurg Psychiatry. 1992;55:181–184.
    OpenUrlAbstract/FREE Full Text
  36. ↵
    1. Hoehn MM,
    2. Yahr MD
    . Parkinsonism: onset, progression and mortality. Neurology. 1967;17:427–442.
    OpenUrlCrossRefPubMed
  37. ↵
    1. Tombaugh TN,
    2. McIntyre NJ
    . The Mini-Mental State Examination: a comprehensive review. J Am Geriatr Soc. 1992;40:922–935.
    OpenUrlCrossRefPubMedWeb of Science
  38. ↵
    1. Kulisevsky J,
    2. Pagonabarraga J
    . Cognitive impairment in Parkinson's disease: tools for diagnosis and assessment. Mov Disord. 2009;24:1103–1110.
    OpenUrlCrossRefPubMedWeb of Science
  39. ↵
    1. Nelson AJ,
    2. Zwick D,
    3. Brody S,
    4. et al
    . The validity of the GaitRite and the Functional Ambulation Performance Scoring System in the analysis of Parkinson gait. NeuroRehabilitation. 2002;17:255–262.
    OpenUrlPubMedWeb of Science
  40. ↵
    1. Dalrymple-Alford JC,
    2. MacAskill MR,
    3. Nakas CT,
    4. et al
    . The MoCA: well-suited screen for cognitive impairment in Parkinson disease. Neurology. 2010;75:1717–1725.
    OpenUrlCrossRefPubMed
  41. ↵
    1. Cohen OS,
    2. Vakil E,
    3. Tanne D,
    4. et al
    . The frontal assessment battery as a tool for evaluation of frontal lobe dysfunction in patients with Parkinson disease. J Geriatr Psychiatry Neurol. 2012;25:71–77.
    OpenUrlAbstract/FREE Full Text
  42. ↵
    1. Siderowf A,
    2. McDermott M,
    3. Kieburtz K,
    4. et al
    . Test-retest reliability of the unified Parkinson's disease rating scale in patients with early Parkinson's disease: results from a multicenter clinical trial. Mov Disord. 2002;17:758–763.
    OpenUrlCrossRefPubMedWeb of Science
  43. ↵
    1. Nieuwboer A,
    2. Rochester L,
    3. Herman T,
    4. et al
    . Reliability of the new freezing of gait questionnaire: agreement between patients with Parkinson's disease and their carers. Gait Posture. 2009;30:459–463.
    OpenUrlCrossRefPubMedWeb of Science
  44. ↵
    1. Dal Bello-Haas V,
    2. Klassen L,
    3. Sheppard MS,
    4. Metcalfe A
    . Psychometric properties of activity, self-efficacy, and quality-of-life measures in individuals with Parkinson disease. Physiother Can. 2011;63:47–57.
    OpenUrlCrossRefPubMed
  45. ↵
    1. Hyde T,
    2. Fritsch T
    . Assessing executive function in Parkinson disease: the alternating names test, part I: reliability, validity, and normative data. Parkinsonism Relat Disord. 2011;17:100–105.
    OpenUrlCrossRefPubMed
  46. ↵
    1. Hollman JH,
    2. Childs KB,
    3. McNeil ML,
    4. et al
    . Number of strides required for reliable measurements of pace, rhythm and variability parameters of gait during normal and dual task walking in older individuals. Gait Posture. 2010;32:23–28.
    OpenUrlCrossRefPubMedWeb of Science
  47. ↵
    1. Portney L,
    2. Watkins M
    . Foundations of Clinical Research: Application to Practice. 3rd ed. Upper Saddle River, NJ: Pearson-Prentice Hall; 2009.
  48. ↵
    1. Shrout PE,
    2. Fleiss JL
    . Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–428.
    OpenUrlCrossRefPubMedWeb of Science
  49. ↵
    1. Weir JP
    . Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19:231–240.
    OpenUrlCrossRefPubMedWeb of Science
  50. ↵
    1. Landis JR,
    2. Koch GG
    . The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174.
    OpenUrlCrossRefPubMedWeb of Science
  51. ↵
    1. Bland JM,
    2. Altman DG
    . Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–310.
    OpenUrlCrossRefPubMedWeb of Science
  52. ↵
    1. Appollonio I,
    2. Leone M,
    3. Isella V,
    4. et al
    . The Frontal Assessment Battery (FAB): normative values in an Italian population sample. Neurol Sci. 2005;26:108–116.
    OpenUrlCrossRefPubMed
  53. ↵
    1. Hausdorff JM
    . Gait variability: methods, modeling and meaning. J Neuroeng Rehabil. 2005;2:19.
    OpenUrlCrossRefPubMed
  54. ↵
    1. Marras C,
    2. Troster AI,
    3. Kulisevsky J,
    4. Stebbins GT
    . The tools of the trade: a state of the art “How to Assess Cognition” in the patient with Parkinson's disease. Mov Disord. 2014;29:584–596.
    OpenUrlCrossRefPubMed
  55. ↵
    1. Kudlicka A,
    2. Clare L,
    3. Hindle JV
    . Executive functions in Parkinson's disease: systematic review and meta-analysis. Mov Disord. 2011;26:2305–2315.
    OpenUrlCrossRefPubMed
  56. ↵
    1. Redgrave P,
    2. Rodriguez M,
    3. Smith Y,
    4. et al
    . Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease. Nat Rev Neurosci. 2010;11:760–772.
    OpenUrlCrossRefPubMedWeb of Science
  57. ↵
    1. Steffen T,
    2. Seney M
    . Test-retest reliability and minimal detectable change on balance and ambulation tests, the 36-Item Short-Form Health Survey, and the Unified Parkinson Disease Rating Scale in people with parkinsonism [erratum in: Phys Ther. 2010:462]. Phys Ther. 2008;88:733–746.
    OpenUrlAbstract/FREE Full Text
View Abstract
PreviousNext
Back to top
Vol 96 Issue 8 Table of Contents
Physical Therapy: 96 (8)

Issue highlights

  • Role of Physical Therapists in Reducing Hospital Readmissions: Optimizing Outcomes for Older Adults During Care Transitions From Hospital to Community
  • Prevalence of Wheelchair and Scooter Use Among Community-Dwelling Canadians
  • Metatarsophalangeal Hyperextension Movement Pattern Related to Diabetic Forefoot Deformity
  • Coordination and Symmetry Patterns During the Drop Vertical Jump in People With Chronic Ankle Instability and Lateral Ankle Sprain Copers
  • Critical and Theoretical Perspective on Scapular Stabilization: What Does It Really Mean, and Are We on the Right Track?
  • Effects of Pilates-Based Core Stability Training in Ambulant People With Multiple Sclerosis: Multicenter, Assessor-Blinded, Randomized Controlled Trial
  • Adding Psychosocial Factors Does Not Improve Predictive Models for People With Spinal Pain Enough to Warrant Extensive Screening for Them at Baseline
  • Cervico-ocular Reflex Is Increased in People With Nonspecific Neck Pain
  • Expanded Distribution of Pain as a Sign of Central Sensitization in Individuals With Symptomatic Knee Osteoarthritis
  • Obstacle Crossing During Gait in Children With Cerebral Palsy: Cross-Sectional Study With Kinematic Analysis of Dynamic Balance and Trunk Control
  • Medial Longitudinal Arch Development of Children Aged 7 to 9 Years: Longitudinal Investigation
  • Limitations in the Activity of Mobility at Age 6 Years After Difficult Birth at Term: Prospective Cohort Study
  • From Persuasion to Coercion: Responding to the Reluctant Patient in Rehabilitation
  • “Crawling Out of the Cocoon”: Patients' Experiences of a Physical Therapy Exercise Intervention in the Treatment of Major Depression
  • Preliminary Evaluation of a Modified STarT Back Screening Tool Across Different Musculoskeletal Pain Conditions
  • Validation of the Comprehensive ICF Core Set for Vocational Rehabilitation From the Perspective of Physical Therapists: International Delphi Survey
  • Test-Retest Reliability of Dual-Task Outcome Measures in People With Parkinson Disease
  • Development of a Feasible Implementation Fidelity Protocol Within a Complex Physical Therapy–Led Self-Management Intervention
Email

Thank you for your interest in spreading the word on JCORE Reference.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Test-Retest Reliability of Dual-Task Outcome Measures in People With Parkinson Disease
(Your Name) has sent you a message from JCORE Reference
(Your Name) thought you would like to see the JCORE Reference web site.
Print
Test-Retest Reliability of Dual-Task Outcome Measures in People With Parkinson Disease
Carolien Strouwen, Esther A.L.M. Molenaar, Samyra H.J. Keus, Liesbeth Münks, Bastiaan R. Bloem, Alice Nieuwboer
Physical Therapy Aug 2016, 96 (8) 1276-1286; DOI: 10.2522/ptj.20150244

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Download Powerpoint
Save to my folders

Share
Test-Retest Reliability of Dual-Task Outcome Measures in People With Parkinson Disease
Carolien Strouwen, Esther A.L.M. Molenaar, Samyra H.J. Keus, Liesbeth Münks, Bastiaan R. Bloem, Alice Nieuwboer
Physical Therapy Aug 2016, 96 (8) 1276-1286; DOI: 10.2522/ptj.20150244
del.icio.us logo Digg logo Reddit logo Technorati logo Twitter logo CiteULike logo Connotea logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
  • Article
    • Abstract
    • Method
    • Results
    • Discussion
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • PDF

Related Articles

Cited By...

More in this TOC Section

  • Reliability and Validity of Force Platform Measures of Balance Impairment in Individuals With Parkinson Disease
  • Predictors of Reduced Frequency of Physical Activity 3 Months After Injury: Findings From the Prospective Outcomes of Injury Study
  • Effects of Locomotor Exercise Intensity on Gait Performance in Individuals With Incomplete Spinal Cord Injury
Show more Measurement

Subjects

  • Examination/Evaluation
    • Tests and Measurements
  • Neurology/Neuromuscular System
    • Parkinson Disease and Parkinsonian Disorders
  • Outcomes Measurement

Footer Menu 1

  • menu 1 item 1
  • menu 1 item 2
  • menu 1 item 3
  • menu 1 item 4

Footer Menu 2

  • menu 2 item 1
  • menu 2 item 2
  • menu 2 item 3
  • menu 2 item 4

Footer Menu 3

  • menu 3 item 1
  • menu 3 item 2
  • menu 3 item 3
  • menu 3 item 4

Footer Menu 4

  • menu 4 item 1
  • menu 4 item 2
  • menu 4 item 3
  • menu 4 item 4
footer second
footer first
Copyright © 2013 The HighWire JCore Reference Site | Print ISSN: 0123-4567 | Online ISSN: 1123-4567
advertisement bottom
Advertisement Top