I have held off somewhat commenting on this research while I watched a number of other blog posts and forum threads on it. As I have stated many times, it is intriguing how so many who are not experienced in the reading, interpretation and critical appraisal of research actually read, interpret and appraise research, especially if it contradicts their world view. This is one more example of that. The response to the research below has been a textbook example of cherry picking, wishful thinking and confirmation bias.
The research in question is this paper:
Foot Bone Marrow Edema after 10-week Transition to Minimalist Running Shoes.
Ridge ST, Johnson AW, Mitchell UH, Hunter I, Robinson E, Rich BS, Brown SD.
Med Sci Sports Exerc. 2013 Feb 22.
Minimalist running shoes are becoming a more popular choice for runners in the past few years. However, there is little conclusive evidence about the advantages or disadvantages of running in these shoes. While performance benefits may exist, injury may also occur from the added stress of running without the benefit of cushioning under the foot. Bone marrow edema can be a manifestation of added stress on the foot. This study measured bone marrow edema in runners’ feet before and after a 10 week period of transitioning from traditional to minimalist running shoes.
Thirty-six experienced, recreational runners underwent MRIs before and after a 10 week period. Seventeen subjects were in the control group (ran in their traditional shoes only for 10 weeks), while the other 19 were in the experimental group (gradually transitioned to VibramFiveFinger running shoes over 10 weeks). The severity of the bone marrow edema was scored on a range of 0-4 (0 = no bone marrow edema, 3 = edema in more than 50% of the length of the bone). A score of 4 represented a stress fracture.
Pre-training MRI scores were not statistically different between the groups. The post-training MRI scores showed that more subjects in the Vibram group (10 of 19) showed increases in bone marrow edema in at least one bone after the 10 weeks of running than in the control group (p = .009).
Runners interested in transitioning to minimalist running shoes, such as Vibram FiveFingers should transition very slowly and gradually in order to avoid potential stress injury in the foot.
This was a pretty good study with a couple of minor issues. Essentially, what they showed was that in the group that transitioned to the Vibram FiveFingers there was more bone stress injury detected on MRI, yet somehow many have interpreted this study as a fatally and significantly flawed study because for no other reason than they do want to believe the results! (ie, the fallacy of wishful thinking).
- When I look at the inclusion criteria; subject selection; sample size; validity and reliability of the baseline and outcome measures; the blinding of assessors; and the statistical analysis, I see no issues that are flawed. There may be an issue with how they managed the analysis in the context of the dropouts from the study, but this is really minor, was allowed for in the sample size calculation and does not invalidate the study and is not out of the ordinary like that you would get in other studies of this nature (yet some have cherry picked this point to claim the study is not valid and at the same time accept other studies with similar dropout rates that support their world view!). I am also a little uncomfortable with the nature of the unconventional randomization process, but will let it pass (ie picking group allocation out of a hat vs computer randomization).
- One of the main criticisms that the critics of this study are using is that the transition in the group going to the minimalist Vibram FiveFingers was too short at 10 weeks, and therefore this invalidates the study. When doing research of this nature, all researchers sometimes have to make a judgement call when it comes to the protocols. There is nothing wrong with that as long as there is some rationale or logic to the decision the researchers made regarding the protocol and it can answer the research question. In this case, the decision on the 10 weeks was based on advice on the Vibram FiveFingers website! How can that 10 weeks be not enough if they were following the advice of the manufacturer of the minimalist shoes that they were using in the study? The researchers can easily justify their decision for the 10 week transition¹. I have even seen some claims that this study deliberately set out to injure people by using the 10 week transition protocol. These clowns might as well turn up in court on behalf of the plaintiffs in the class action and state that Vibram Five Fingers are deliberately injuring people, as they were following Vibrams protocol!
- A lot of comments got made about the ‘experimental design’ being flawed. I see no problem with the experimental design. It answers perfectly the research question that was asked. Those making the ‘flawed’ claims have no idea about ‘experimental design’ and were really talking about something that was a totally different research question which this project was not about.
- There has been some criticism directed at the compliance that those who were in the Vibram FiveFingers group with the transition protocol, but I do not see that as an issue. I see it as a good thing as it makes the study more reflective of what happens in the real world and the real compliance that happens with the transition protocols.
- Some have called the 36 subjects as a small study! This is just showing an ignorance of sample size calculations, statistical power and significance and effect sizes. Paradoxically, none of the Chi Running websites considered 9 subjects a small sample size in a study on Chi Running! Those that criticize the study based on the sample size are happy to accept studies with smaller sample sizes if the results supports their views. See the irony and hypocrisy?
- There certainly is a lot of confusion on the web as to exactly what bone marrow edema actually is. There is a good summary here for those who still don’t get it.
This study clearly showed that there is increased bone stress injury in those who transition to Vibram FiveFingers following the protocol that was advised on the Vibram website². Cherry picking and grasping at straws on really minor issues does not invalidate the study. Those that are cherry picking and grasping at straws over these really minor issues are also the ones that do not put studies that support their world view under the same level of scrutiny. Why is that? This study does not auger well for Vibram in their class action defense.
For anyone wanting the 1 minute superficial summary of this research, here is one of the researchers talking about it:
As always, I go where the evidence takes me until convinced otherwise, and I see nothing in the methods and results of any significance that invalidates this study. All research should be critically appraised, but at the same time all research should be held to the same standards and not different standards because it does or does not support your world view.
¹Having said that, 10 weeks is probably too short in general and for many people they probably should be expecting more time than that. I often advise people to take up to a year. If you can do it quicker, then fine. Despite my age and body weight, I was able to do it in less than a couple of months! It is going to be very individual.
²Vibram FiveFingers have since removed that advice.
Ridge ST, Johnson AW, Mitchell UH, Hunter I, Robinson E, Rich BS, & Brown SD (2013). Foot Bone Marrow Edema after 10-week Transition to Minimalist Running Shoes. Medicine and science in sports and exercise PMID: 23439417