(Editor’s Note: Neu­ro­feed­back is one of the tech­nolo­gies that peo­ple often ask us about.  It is a promis­ing inter­ven­tion in a vari­ety of areas, and has got sig­nif­i­cant trac­tion in help­ing kids with ADD/ ADHD. Now, given the sig­nif­i­cant cost it poses for par­ents, we need to ask the ques­tion: “How Strong is the Research Sup­port for Neu­ro­feed­back Treat­ment of Chil­dren with ADHD”? We are hon­ored to present the thoughts of Duke University’s Dr. David Rabiner, a lead­ing author­ity on the field, on that impor­tant issue. As a bonus, you will enjoy his detailed descrip­tion and sug­ges­tions of how to design a high-quality sci­en­tific study.)

(Update as of March 2009: Dr. David Rabiner has writ­ten an update to the arti­cle below based on a newer study. You can read it click­ing on link: New Study Sup­ports Neu­ro­feed­back Treat­ment for ADHD)
————————————–

How Strong is the Research Sup­port for Neu­ro­feed­back Treat­ment of Chil­dren with ADHD?

Nei­ther of the two promi­nent approaches to treat­ing ADHD — med­ica­tion treat­ment and behav­ior ther­apy — are expected to effect long term changes in the child. Med­ica­tion treat­ment induces short-term changes in brain activ­ity that is asso­ci­ated with a reduc­tion in symp­toms for many indi­vid­u­als. Behav­ior ther­apy attempts to cre­ate a set of envi­ron­men­tal con­tin­gen­cies that pro­mote desired behav­ior in the child, but which is unlikely to endure when those con­tin­gen­cies are removed.

In recent years, researchers have begun devot­ing greater atten­tion to the pos­si­bil­ity that chil­dren — and adults — may be pro­vided with par­tic­u­lar kinds of expe­ri­ences that may induce alter­ations in brain func­tion­ing that are asso­ci­ated with more endur­ing changes, i.e., they do not dis­si­pate as soon as treat­ment ends.

Neu­ro­feed­back — also known as EEG Biofeed­back — is reflec­tive of this approach and has a his­tory that goes back at least 30 years. It involves pro­vid­ing indi­vid­u­als with real-time feed­back on their brain­wave activ­ity in order that they may learn to alter their typ­i­cal EEG pat­tern to one that is con­sis­tent with a focused and atten­tive state. Accord­ing to neu­ro­feed­back pro­po­nents, when this occurs, improved atten­tion and reduced hyperactive/impulsive behav­ior will result. Fur­ther­more, this change is likely to endure because it reflects a basic alter­an­tion in an impor­tant aspect of brain functioning.

In this arti­cle, I’ll take a look at some of the con­tro­versy sur­round­ing neu­ro­feed­back treat­ment and attempt to high­light some of the strengths and lim­i­ta­tions in the exist­ing pub­lished research.

- Con­tro­versy Sur­round­ing Neu­ro­feed­back Research —

Neu­ro­feed­back treat­ment for ADHD has been a source of sub­stan­tial con­tro­versy in the field for many years and remains so today. Although there are a num­ber of pub­lished stud­ies in which pos­i­tive results have been reported, many promi­nent ADHD researchers feel that given sig­nif­i­cant lim­i­ta­tions to the design and imple­men­ta­tion of these stud­ies, neu­ro­feed­back should be con­sid­ered a promis­ing, but unproven treatment.

This posi­tion is sum­ma­rized in the CHADD fact sheet on alter­na­tive and com­ple­men­tary inter­ven­tions, which includes the fol­low­ing state­ment about neurofeedback:

“It is impor­tant to empha­size, how­ever, that although sev­eral stud­ies of neu­ro­feed­back have yielded promis­ing results, this treat­ment has not yet been tested in the rig­or­ous man­ner that is required to make a clear con­clu­sion about its effec­tive­ness for AD/HD. The afore­men­tioned stud­ies can not be con­sid­ered to have pro­duced per­sua­sive sci­en­tific evi­dence con­cern­ing the effec­tive­ness of EEG biofeed­back for ADHD.

Con­trolled ran­dom­ized tri­als are required before con­clu­sions can be reached. Until then, buy­ers should beware of the lim­i­ta­tions in the pub­lished sci­ence. Par­ents are advised to pro­ceed cau­tiously as it can be expen­sive — a typ­i­cal course of neu­ro­feed­back treat­ment may require 40 or more ses­sions — and because other AD/HD treat­ments (i.e., multi-modal treat­ment) cur­rently enjoy sub­stan­tially greater research support.”

You can find the com­plete CHADD fact sheet Here.

What Does an ‘Ideal’ Treat­ment Study Look Like?

Before review­ing some recent neu­ro­feed­back stud­ies, it would be use­ful to con­sider what an ‘ideal’ treat­ment study entails. This will pro­vide a con­text against which recent neu­ro­feed­back stud­ies can be evaluated.

Ide­ally, treat­ment stud­ies are designed so that if pos­i­tive results are obtained, all pos­si­ble expla­na­tions for those results besides the treat­ment itself have been elim­i­nated. This requires 2 basic ele­ments: ran­dom assign­ment and an appro­pri­ate con­trol group.

Ran­dom Assignment

Imag­ine that you are test­ing a new med­ica­tion treat­ment for ADHD with 50 chil­dren who have been care­fully diag­nosed. In a ran­dom assign­ment study, whether each child is assigned to the treat­ment or con­trol con­di­tion is deter­mined by chance — you could flip a coin and give the med­i­cine to the ‘heads’ and noth­ing to the ‘tails’. This insures that any dif­fer­ences that might exist between chil­dren who get the med­ica­tion and those who don’t are purely chance dif­fer­ences. At the end of the study, if those who received the med­i­cine are doing bet­ter, you could feel con­fi­dent that this is prob­a­bly due to the med­i­cine itself, and not to dif­fer­ences that may have been there before the treat­ment even started.

What if you didn’t use ran­dom assign­ment, but let each child’s par­ents choose whether their child is in the treat­ment or con­trol group? In this case, it is pos­si­ble that chil­dren in the 2 groups dif­fered in impor­tant ways before the treat­ment began. If chil­dren who received the med­ica­tion were doing bet­ter at the end of the study, it might be because of dif­fer­ences that were there to start with.

For exam­ple, par­ents who chose the med­i­cine might be more will­ing to pur­sue other ways to help their child than those who didn’t. The fact that chil­dren who received the med­ica­tion were doing bet­ter at the end of the study might thus have noth­ing to do with the med­i­cine itself, but reflect other things their par­ents were doing to help them. No mat­ter how hard you might try to rule out these other pos­si­ble expla­na­tions — and I’m sure you can think of many oth­ers — you could never do this with cer­tainty. Thus, I might rea­son­ably doubt that your new med­ica­tion is really effective.

What about con­trol groups?

Even with the ran­dom assign­ment exam­ple above, how­ever, your study would still have an impor­tant prob­lem. Because chil­dren in the con­trol group received noth­ing, every­one knows who is being treated and who isn’t. If you ask par­ents how their child is doing 4 weeks later, this could very pos­si­bly bias their reports. Par­ents whose child received med­ica­tion may report their child is doing bet­ter sim­ply because they expect the med­i­cine to help. Par­ents of chil­dren in the con­trol con­di­tion may be biased against see­ing improve­ment because they know their child was not treated.

Thus, if par­ents of treated chil­dren reported more improve­ment than par­ents of con­trol chil­dren, I could still rea­son­able ques­tion that the new med­ica­tion was truly help­ful. Even if reports from teach­ers yielded sim­i­lar find­ings, I would argue that teach­ers might have learned when chil­dren were get­ting med­ica­tion. While this may be a low prob­a­bil­ity event, you couldn’t com­pletely rule it out. If I was a real skep­tic about your new med­ica­tion, your study would not be all that convincing.

The way around this is to cre­ate a sit­u­a­tion where no one knows — not the par­ents, child, teach­ers, researchers, or any­one else — whether the child is receiv­ing med­ica­tion. With med­ica­tion stud­ies, this is rel­a­tively sim­ple to do: chil­dren in the con­trol con­di­tion are given a placebo pill that looks just like the real med­ica­tion but that has no active ingre­di­ents. Because no one knows who is get­ting med­ica­tion and who isn’t, pos­si­ble biases in par­ents’ and teach­ers’ reports at the end of the study are thus elim­i­nated. This way, if chil­dren in the med­ica­tion con­di­tion are doing bet­ter at the end of the study than chil­dren get­ting placebo, it is harder to doubt the ben­e­fits of your med­ica­tion. In fact, there would be no rea­son­able basis for such doubt, espe­cially if you repeated the study and found the same results.

Three Rep­re­sen­ta­tive Neu­ro­feed­back Studies

With this as a back­ground, let’s take a brief look at 3 recent neu­ro­feed­back stud­ies and see how they fare on the crit­i­cal dimen­sions of incor­po­rat­ing ran­dom assign­ment and an ‘ideal’ con­trol group.

- Study 1 -

In an inter­est­ing study by Vince Monas­tra and his col­leagues [Monas­tra et al. (2002). The Effects of Stim­u­lant Ther­apy, EEG Biofeed­back and Par­ent­ing Style on the pri­mary symp­toms of ADHD. Applied Psy­chophys­i­ol­ogy and Biofeed­back, 27, 249.] one hun­dred 6–19 year-olds with ADHD were treated over 12 months. Some par­ents chose a treat­ment plan that included med­ica­tion, behav­ior ther­apy, and school con­sul­ta­tion. Other par­ents chose to add neu­ro­feed­back to their child’s treatment.

After 12 months, chil­dren whose treat­ment included neu­ro­feed­back back were doing bet­ter than the other chil­dren accord­ing to both par­ents and teach­ers. They also showed ‘nor­mal’ EEG scans while the other chil­dren still had the EEG pat­tern char­ac­ter­is­tic of ADHD. Even more impres­sive was that neu­ro­feed­back treated chil­dren main­tained these ben­e­fits after med­ica­tion was dis­con­tin­ued for a week. You can read a detailed review of this study Here.

- Study 2 -

In a study by Fuchs et al (2003), par­ents of thirty-four 8–12-year-old chil­dren with AD/HD chose either stim­u­lant med­ica­tion or neu­ro­feed­back treat­ment for their child. After 3 months, chil­dren in both groups showed sig­nif­i­cant and com­pa­ra­ble reduc­tions in AD/HD symp­toms accord­ing to par­ents and teach­ers. Lab­o­ra­tory tests of atten­tion also showed equiv­a­lent improve­ment. A com­pre­hen­sive review of this study is avail­able at Here

- Study 3 -

In an espe­cially inter­est­ing study, (Levesque, J., Beau­re­gard, M., & Men­sour, B. 2006. Effect of neu­ro­feed­back train­ing on the neural sub­strates of selec­tive atten­tion in chil­dren with AD/HD: A func­tional mag­netic res­o­nance imag­ing study. Neu­ro­science Let­ters, 394, 216–221.) twenty 8–12-year-old chil­dren with ADHD were ran­domly assigned to receive neu­ro­feed­back treat­ment — 40 1-hours ses­sions — or a wait-list con­trol condition.

At the end of the study, treated chil­dren were doing sig­nif­i­cantly bet­ter than con­trol chil­dren accord­ing to par­ents. They also did bet­ter on sev­eral objec­tive, lab­o­ra­tory mea­sures of atten­tion. Espe­cially note­wor­thy was that fMRI scans used to mea­sure brain activ­ity dur­ing a com­plex cog­ni­tive task showed sig­nif­i­cant change for treated chil­dren but no change for con­trol children.

You can find a detailed review of this study Here.

So, what’s wrong with these studies?

I sus­pect the answer to this ques­tion is obvi­ous. While the first 2 stud­ies yielded impres­sive results, nei­ther included ran­dom assign­ment. Thus, as dis­cussed above, it is not pos­si­ble to con­clude that it is the neu­ro­feed­back treat­ment specif­i­cally that made the dif­fer­ence. Instead, dif­fer­ences that may have been present before treat­ment began and/or after treat­ment started could be respon­si­ble. While this may be unlikely, it can’t be entirely discounted.

The third study included ran­dom assign­ment so this is not a prob­lem. It should be noted, how­ever, that with only twenty par­tic­i­pants, treat­ment and con­trol groups are more likely to dif­fer at the start of the study than if a larger sam­ple had been ran­domly assigned.

The big­ger prob­lem is that the con­trol con­di­tion is not a very strong one in that every­one knew who received neu­ro­feed­back treat­ment and who did not. This may have biased par­ents’ rat­ings, although it is dif­fi­cult to argue that it could have biased children’s per­for­mance on the lab-based atten­tion tests or on the fMRI scan. Per­haps, how­ever, it wasn’t the spe­cific feed­back on EEG states that neu­ro­feed­back pro­vided, but sim­ply the atten­tion chil­dren received dur­ing the 40 hours of train­ing, that was the impor­tant fac­tor. Although unlikely in my opin­ion, this can’t be def­i­nitely ruled out.

What would an ‘ideal’ neu­ro­feed­back study look like?

This may be pretty clear now as well. The most con­clu­sive test of neu­ro­feed­back treat­ment would include ran­dom assign­ment and a con­trol con­di­tion that closely matched the neu­ro­feed­back con­di­tion. For exam­ple, chil­dren could receive video game coach­ing from a sup­port­ive adult for the same time period. Or, even bet­ter, they could do exactly what chil­dren get­ting the neu­ro­feed­back were doing but not receive direct feed­back on their EEG states. If pos­i­tive treat­ment results were still found, it would indi­cate that obtain­ing EEG feed­back and learn­ing to con­trol one’s EEG state is why neu­ro­feed­back treat­ment works.

I’ve been told by peo­ple who know much more about neu­ro­feed­back than I that such a study, while dif­fi­cult to do, is tech­ni­cally pos­si­ble. I am not aware of such a study hav­ing been pub­lished; if you are, please let me know.

I should point out that there would be impor­tant eth­i­cal con­cerns with such a study. Neu­ro­feed­back treat­ment typ­i­cally occurs over a period of months. Chil­dren who were receiv­ing ‘sham’ neu­ro­feed­back would be get­ting a treat­ment that no one expected to be help­ful for a sus­tained time period.

A more rea­son­able alter­na­tive might thus be to pro­vide chil­dren with a treat­ment of known effi­cacy — such as med­ica­tion — dur­ing the neu­ro­feed­back trial. If this were given to chil­dren in the real and sham con­di­tions it would not cre­ate a con­found because both groups would be receiv­ing it. After neu­ro­feed­back was com­pleted, one could see whether chil­dren who got the real treat­ment were doing bet­ter — i.e., did neu­ro­feed­back add any­thing to med­ica­tion — and whether these ben­e­fits per­sisted after med­ica­tion was tem­porar­ily stopped.

What can we con­clude about neu­ro­feed­back until such a study is done?

It would be ter­rific if a study like the one out­lined above were com­pleted. Unfor­tu­nately, how­ever, I think it is a real pos­si­bil­ity, how­ever, that we will never see such a study. This would be a large and expen­sive under­tak­ing and obtain­ing fund­ing for it would not be easy.

In the interim, my own view is that exist­ing sup­port for neu­ro­feed­back should not be so read­ily dis­counted because of the study lim­i­ta­tions dis­cussed above. Here’s why I think this is the case.

The way treat­ment was ‘assigned’ in the first 2 stud­ies sum­ma­rized is very sim­i­lar to what hap­pens when par­ents seek treat­ment for their child. That is, par­ents inves­ti­gate dif­fer­ent options and decide which one they want for their child.

This is what hap­pened in these stud­ies — some par­ents chose neu­ro­feed­back for their child and some did not. When neu­ro­feed­back was cho­sen, chil­dren were found to ben­e­fit on both ‘sub­jec­tive’ par­ent reports as well as on more ‘objec­tive’ assess­ments. This does not mean that neu­ro­feed­back would ‘work’ for chil­dren ran­domly assigned to receive it. It also does not mean that rea­son neu­ro­feed­back works by pro­vid­ing spe­cific train­ing in learn­ing how to man­age one’s EEG state. It is for these rea­sons that neu­ro­feed­back is under­stand­ably regarded as an unproven treat­ment approach for ADHD at this time by many ADHD researchers.

How­ever, these stud­ies do pro­vide a solid basis for sug­gest­ing that if par­ents choose to pur­sue neu­ro­feed­back for their child, there is a rea­son­able chance that their child will ben­e­fit even though we can’t be sure that it is the spe­cific EEG train­ing that is respon­si­ble for the ben­e­fits. Thus, although the effi­cacy of neu­ro­feed­back has yet to be con­clu­sively con­firmed in a ran­dom­ized, placebo-controlled trial, it is impor­tant to place this lim­i­ta­tion in the con­text of the sup­port­ive research evi­dence that has been accumulated.

Pro­vid­ing this con­text can help fam­i­lies bet­ter under­stand the strengths and lim­i­ta­tions of the exist­ing research on neu­ro­feed­back and enable them to make a bet­ter informed deci­sion about whether to con­sider this treat­ment option for their child.

— Dr. David Rabiner is a child clin­i­cal psy­chol­o­gist and Direc­tor of Under­grad­u­ate Stud­ies in the Depart­ment of Psy­chol­ogy and Neu­ro­science at Duke Uni­ver­sity. His research focuses on var­i­ous issues related to ADHD, the impact of atten­tion prob­lems on aca­d­e­mic achieve­ment, and atten­tion train­ing. He also pub­lishes Atten­tion Research Update, a com­pli­men­tary online newslet­ter that helps par­ents, pro­fes­sion­als, and edu­ca­tors keep up with the lat­est research on ADHD.

Other arti­cles by Dr. Rabiner:

Promis­ing Cog­ni­tive Train­ing Stud­ies for ADHD.

Mind­ful­ness Med­i­ta­tion for Adults & Teens with ADHD.

Work­ing Mem­ory Train­ing for Adults.

Self-Regulation and Barkley’s The­ory of ADHD.

Be Socia­ble, Share!

•