breaking it down is better haptic decomposition of complex movements aids in robot- assisted motor...
TRANSCRIPT
![Page 1: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/1.jpg)
Breaking It Down Is Better
Haptic Decomposition of Complex Movements Aids in Robot-Assisted Motor Learning
J. Klein, S. Spencer, & D. Reinkensmeyer
IEEE Transactions on Neural Systems and Rehabilitation Engineering
May 2012
![Page 2: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/2.jpg)
Motivation – Klein et al.
• sports training• rehab from neurologic injury
– stroke– spinal-cord injury
![Page 3: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/3.jpg)
Motivation – CHARM
• stroke rehab (Michele, Mike)• needle-steering training (Ann)• robot-assisted surgery (Ilana)
![Page 4: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/4.jpg)
Background
HAPTIC GUIDANCE• of questionable effectiveness• to date, been used almost
exclusively to demonstrate entire movements
“PART-WHOLE” TRANSFER• sequential vs. continuous tasks• effectiveness correlated with
coordination requirements
shoulder rotation
elbow flexion/extension
desired trajectory
![Page 5: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/5.jpg)
Hypothesis
“Decomposing” a movement into fewer-DOF components is more effective than training the movement as a whole. Moreover, the degree of effectiveness is dependent on the form of the decomposition.
![Page 6: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/6.jpg)
Methods
4 DOFs1. shoulder abduction/adduction2. should flexion/extension3. shoulder int./ext. rotation4. elbow flexion/extension
EULER
![Page 7: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/7.jpg)
Methods
2 Motions1. “main” (θ) ≈ tennis backhand2. transfer (θ’) ≈ front crawl swim
![Page 8: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/8.jpg)
Reflection…
What if the task had been framed as a goal-directed movement?
That is, what if subjects had been told: “pretend
you are swinging a tennis racket”?
![Page 9: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/9.jpg)
Methods
Experimental Protocol1. Baseline2. Baseline Transfer3. Training4. Assessment5. Assessment Transfer6. Retention7. Retention Transfer
4 Training Groups1. “Whole” (control)2. Euler3. Anatomical4. Visual
![Page 10: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/10.jpg)
Reflection…
Klein et al. randomized the presentation order
of the joint components during Training. How necessary was this
control? Is component presentation order an area for further study?
rand{}
![Page 11: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/11.jpg)
Methods
Assessment
“GLOBAL”
lower score = better learning
“LOCAL”
* accounting for time delay d
![Page 12: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/12.jpg)
Reflection…
Why is it necessary to fit the shift parameter d? Shouldn’t d simply be the time between the
assessment start signal and movement onset? ...
![Page 13: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/13.jpg)
Reflection…
… Are we assuming that subjects are “playing catch up” with the virtual arm? What if, instead of being
shown a virtual arm, subjects were given binary feedback (e.g., GREEN vs.
RED) based on their current performance?
![Page 14: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/14.jpg)
Results“MAIN” TRANSFER
![Page 15: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/15.jpg)
Results
• no Baseline differences between decomposition groups
• all groups significantly improved with Training• Anatomical decomposition exhibited greatest
improvement during all assessments– Training – no significant difference compared to “Whole”
– Short-Term – significant compared to all other groups
– Long-Term – only (weakly) significant compared to Visual
![Page 16: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/16.jpg)
Reflection…
Why would there be greater learning at long-
term retention (vs. short-term retention) for
“Whole”, Euler, and Visual decompositions*?
Given enough time, would all groups
equalize?
* Anatomical was approximately the same
![Page 17: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/17.jpg)
Results
• “global” performance correlated with
1. “local” performance2. proximity of training joint positions to those
required by whole motion
• no improvement for transfer motion haptic guidance training IS task specific
![Page 18: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/18.jpg)
Discussion
“Part-Whole” Learning
• counterintuitive• success of Anatomical (vs.
Visual) decomposition suggests that spatiotemporal summation mechanism operates in joint (vs. visual coordinates)
* see (Kakei et al., 2001)
• NOT generalizable• more spatial than temporal
![Page 19: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/19.jpg)
Reflection…
I am unconvinced by Klein et al.’s theory for why
(anatomical) movement decomposition aids in
learning a target motion more than practicing the motion itself. What other
explanations can we propose?
“One possibility is that the motor system has trouble determining where the problems lie in making, accurate, complex movements; breaking the movements down may allow better identification and then more focused practice on key problems.”
![Page 20: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/20.jpg)
Discussion
“Part-Whole” Learning
• counterintuitive• success of Anatomical (vs.
Visual) decomposition suggests that spatiotemporal summation mechanism operates in joint (vs. visual coordinates)
* see (Kakei et al., 2001)
• NOT generalizable• more spatial than temporal
Robotic Movement Training
• opens the door for simpler robotic devices in rehab
• BUT, benefits of movement decomposition might only exist with haptic guidance
![Page 21: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/21.jpg)
Reflection…
What does this mean for stroke rehabilitation? Is
there a “whole-part” mechanism that could
help decouple patients’ abnormal muscle
synergies?
shoulder rotation
elbow flexion/extension
desired trajectory
![Page 22: Breaking It Down Is Better Haptic Decomposition of Complex Movements Aids in Robot- Assisted Motor Learning J. Klein, S. Spencer, & D. Reinkensmeyer IEEE](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfaf1a28abf838c9d347/html5/thumbnails/22.jpg)
“Breakthrough” or just another addition to the pool of inconclusive
literature on haptic guidance?