Sharp Brains: Brain Fitness and Cognitive Health News

Neuroplasticity, Brain Fitness and Cognitive Health News

Icon

Neurofeedback/ Quantitative EEG for ADHD diagnosis

Like all psy­chi­atric dis­or­ders, ADHD is diag­nosed based on the pres­ence of par­tic­u­lar behav­ioral symp­toms that are judged to cause sig­nif­i­cant impair­ment in an individual’s func­tion­ing, and not on the results of a spe­cif­ic test. In fact, recent­ly pub­lished ADHD eval­u­a­tion guide­lines from the Amer­i­can Acad­e­my of Pedi­atrics (AAP) explic­it­ly state that no par­tic­u­lar diag­nos­tic test should be rou­tine­ly used when eval­u­at­ing a child for ADHD.

While most ADHD experts would agree that no sin­gle test could or should be used in iso­la­tion to diag­nose ADHD, there are sev­er­al impor­tant rea­sons why the avail­abil­i­ty of an accu­rate objec­tive test would be use­ful.

First, many chil­dren do not receive a care­ful and com­pre­hen­sive assess­ment for ADHD but are instead diag­nosed with based on eval­u­a­tion pro­ce­dures that are far from opti­mal.

Sec­ond, although AAP guide­lines indi­cate that spe­cif­ic diag­nos­tic tests should not be rou­tine­ly used, many par­ents are con­cerned about the lack of objec­tive pro­ce­dures in their child’s eval­u­a­tion. In fact, many fam­i­lies do not pur­sue treat­ment for ADHD because the the absence of objec­tive eval­u­a­tion pro­ce­dures leads them to ques­tion the diag­no­sis. You can read a review of an inter­est­ing study on this issue at www.helpforadd.com/2006/january.htm

For these rea­sons an accu­rate and objec­tive diag­nos­tic test for ADHD could be of val­ue in many clin­i­cal sit­u­a­tions. Two impor­tant con­di­tions would have to be met for such a test to be use­ful.

First, it would have to be high­ly sen­si­tive to the pres­ence of ADHD, i.e., indi­vid­u­als who tru­ly have ADHD as deter­mined by a com­pre­hen­sive eval­u­a­tion should score pos­i­tive for ADHD on the test. If the test were 100% sen­si­tive, every indi­vid­ual who has ADHD based on cur­rent diag­nos­tic cri­te­ria would score pos­i­tive on the test. As the sen­si­tiv­i­ty of a test drops, the num­ber of “false neg­a­tives” — nor­mal test results in indi­vid­u­als who tru­ly have the dis­or­der increase and its util­i­ty goes down.

Sec­ond, indi­vid­u­als who don’t have ADHD should nev­er score pos­i­tive on the test, i.e., a pos­i­tive result should occur only for indi­vid­u­als with ADHD and no one else. When a diag­nos­tic test has high speci­fici­ty, indi­vid­u­als with­out the con­di­tion rarely score pos­i­tive on the test. When speci­fici­ty is low, many indi­vid­u­als with­out the con­di­tion will score pos­i­tive and may be incor­rect­ly diag­nosed as a result. This is referred to as a “false pos­i­tive”.

Although many psy­cho­log­i­cal tests yield dif­fer­ent results, on aver­age, for indi­vid­u­als with and with­out ADHD, they are not sen­si­tive or spe­cif­ic enough to be par­tic­u­lar­ly use­ful when mak­ing indi­vid­ual diag­nos­tic deci­sions. For exam­ple, a wide­ly used objec­tive test in ADHD eval­u­a­tions are Con­tin­u­ous Per­for­mance Tests (CPTs). These tests pro­vide a com­put­er­ized mea­sure of a child’s abil­i­ty to sus­tain atten­tion and refrain from impul­sive respond­ing. Although aver­age per­for­mance on CPTs for chil­dren with ADHD is below that of peers, and CPT data can be help­ful when thought­ful­ly inte­grat­ed with oth­er diag­nos­tic infor­ma­tion, these tests yields too many false pos­i­tives and false neg­a­tives to be use­ful as an “objec­tive” diag­nos­tic test for ADHD.

- Is there any­thing bet­ter? -

Sev­er­al past issues of Atten­tion Research Update have reviewed Quan­ti­ta­tive EEG, i.e., QEEG, as a diag­nos­tic aide for ADHD. The use of QEEG is based on find­ings that indi­vid­u­als with ADHD have a dis­tinc­tive pat­tern of brain elec­tri­cal activ­i­ty that is often referred to as “cor­ti­cal slow­ing”; this is char­ac­ter­ized by an ele­va­tion of low fre­quen­cy theta waves and a reduc­tion of high­er fre­quen­cy beta waves in the pre­frontal cor­tex. Theta wave activ­i­ty is asso­ci­at­ed with an unfo­cused and inat­ten­tive state while beta activ­i­ty is asso­ci­at­ed with more focused atten­tion. Thus, an ele­vat­ed theta/beta ratio reflects a less alert and more unfo­cused state.

In a QEEG test­ing, EEG data is col­lect­ed from a child or adult in a non-inva­sive pro­ce­dure that requires about 30 min­utes. The EEG data is dig­i­tized and com­put­er scored so that an individual’s theta/beta ratio can be com­put­ed; this ratio is then com­pared to what is typ­i­cal for indi­vid­u­als of sim­i­lar age. When this ratio is suf­fi­cient­ly ele­vat­ed ratio — the cut-off typ­i­cal­ly used is 1.5 stan­dard devi­a­tions above aver­age which cor­re­sponds to the high­est 7% of the pop­u­la­tion — the indi­vid­ual is con­sid­ered to have the EEG mark­er for ADHD.

In past stud­ies, rough­ly 90% of indi­vid­u­als diag­nosed with ADHD based on a com­pre­hen­sive eval­u­a­tion test­ed pos­i­tive for this EEG mark­er. In con­trast, about 95% of nor­mal con­trols test­ed neg­a­tive. Thus, while not a per­fect­ly reli­able indi­ca­tor, the sen­si­tiv­i­ty and speci­fici­ty of QEEG in iden­ti­fy­ing ADHD was extreme­ly strong. You can review these stud­ies at www.helpforadd.com/2001/april.htm and www.helpforadd.com/yr2000/april.htm.

The impor­tant lim­i­ta­tion of this work was that QEEG was test­ed using indi­vid­u­als known to have ADHD and nor­mal con­trols with­out any dis­or­der. Dif­fer­en­ti­at­ing between ADHD and no dis­or­der, how­ev­er, is not the sit­u­a­tion that clin­i­cians typ­i­cal­ly face. Instead, a child is referred because of atten­tion and/or behav­ior prob­lems and the clin­i­cian must deter­mine whether these prob­lems reflect ADHD, are bet­ter explained by anoth­er dis­or­der, or do not rise to the lev­el where any diag­no­sis is appro­pri­ate. Thus, for QEEG to be use­ful in ADHD eval­u­a­tions, it must also accu­rate­ly dis­tin­guish between ADHD and oth­er dis­or­ders.

One recent­ly pub­lished pre­lim­i­nary study indi­cat­ed promis­ing find­ings in this regard. Twen­ty-six chil­dren and ado­les­cents referred to an out­pa­tient psy­chi­a­try clin­ic for atten­tion and behav­ior prob­lems received a thor­ough ADHD assess­ment con­duct­ed by a team of child psy­chi­a­trists. They also received a QEEG eval­u­a­tion. Six­teen of the 26 were deter­mined to meet DSM-IV cri­te­ria for ADHD by the psy­chi­atric team while 10 were diag­nosed with oth­er con­di­tions. Of the 16 diag­nosed with ADHD, 15 showed the QEEG mark­er for ADHD; in con­trast, none of the 10 diag­nosed with oth­er con­di­tions showed the QEEG mark­er. Thus, the QEEG test per­formed extreme­ly well. A com­pre­hen­sive review of this study can be found at www.helpforadd.com/2007/november.htm

While these results were encour­ag­ing, the sam­ple was small and from a sin­gle clin­i­cal site. This rais­es impor­tant ques­tions about the gen­er­al­iz­abil­i­ty of the find­ings that need to be addressed in a study that incor­po­rates a larg­er sam­ple drawn from mul­ti­ple clin­i­cal sites. Recent­ly, a study meet­ing these cri­te­ria was pub­lished; I believe it is one of the most inter­est­ing and impor­tant stud­ies I have seen in sev­er­al years [Sny­der et al. (2008). Blind­ed, mul­ti-cen­ter val­i­da­tion of EEG and rat­ing scales in iden­ti­fy­ing ADHD with­in a clin­i­cal sam­ple. Psy­chi­a­try Research, 159, 346–358.]

- Meth­ods -

Par­tic­i­pants — Par­tic­i­pants were 159 6–18-year olds (101 males and 58 females) tak­en by par­ents to 1 of 4 pedi­atric and psy­chi­atric clin­ics because of con­cerns relat­ed to atten­tion and behav­ior prob­lems. One hun­dred and fif­teen were chil­dren (6–11 years old) and the remain­der were ado­les­cents. There was a good rep­re­sen­ta­tion of African Amer­i­cans in the sam­ple (37%).

Psy­chi­atric Exam — At each site, chil­dren received a stan­dard­ized psy­chi­atric eval­u­a­tion that includ­ed a semi-struc­tured inter­view (the KSADS-PL) and mea­sures of func­tion­al impair­ment and dis­or­der sever­i­ty. Both par­ents and children/adolescents were inter­viewed, the opti­mal pro­ce­dure for cov­er­ing both exter­nal­iz­ing and inter­nal­iz­ing dis­or­ders. Oth­er clin­i­cal pro­ce­dures includ­ed tak­ing a med­ical his­to­ry, a devel­op­men­tal his­to­ry, and pro­vid­ing a phys­i­cal exam.

Using results of these inter­views and asso­ci­at­ed mea­sures, the clin­i­cal team per­formed a com­plete dif­fer­en­tial diag­no­sis for the pres­ence of ADHD, comor­bid con­di­tions, and oth­er childhood/adolescent dis­or­ders. Diag­nos­tic deci­sions about ADHD fol­lowed a stan­dard pro­to­col to deter­mine whether strict DSM-IV diag­nos­tic cri­te­ria were met. The team’s deter­mi­na­tion about the pres­ence or absence of ADHD was con­sid­ered the “gold stan­dard” against which diag­nos­tic deci­sions based on the results from stan­dard­ized behav­ior rat­ing scales and QEEG were com­pared.

Rat­ing Scales — Par­ents and teacher com­plet­ed 2 behav­ior rat­ing scales that are wide­ly used in the assess­ment of ADHD — the Con­ners Rat­ing Scale and the ADHD-IV Rat­ing Scale. Chil­dren were con­sid­ered to be pos­i­tive for ADHD if their scores on these scales exceed­ed the rec­om­mend­ed cut-off for iden­ti­fy­ing ADHD. This enabled the researchers to deter­mine how well diag­nos­tic deci­sions derived fro rat­ing scales agreed with results from the com­pre­hen­sive psy­chi­atric exam.

QEEG — EEG data was col­lect­ed on each child using stan­dard col­lec­tion pro­ce­dures by trained EEG tech­ni­cians. The theta/beta ratio com­put­ed for each child and com­pared to val­ues for age matched con­trols from a large nor­ma­tive data base. Par­tic­i­pants whose theta/beta ratio was at 1.5 stan­dard devi­a­tions above the aver­age score, i.e., rough­ly the top 7%, were con­sid­ered to show the EEG mark­er for ADHD.

It is impor­tant to note that diag­nos­tic deci­sions from the psy­chi­atric eval­u­a­tion were made with­out the team hav­ing any access to rat­ing scale or QEEG data. Thus, deci­sions made about the pres­ence or absence of ADHD from the psy­chi­atric eval­u­a­tion was not influ­enced in any way by knowl­edge of these oth­er results.

- Results -

The log­ic of this study is sim­ple and straight for­ward. The authors treat­ed results of the psy­chi­atric exam as the “gold stan­dard” for deter­min­ing which of the 159 par­tic­i­pants met diag­nos­tic cri­te­ria for ADHD. Then, they exam­ined how well results based on the behav­ior rat­ing scales and the EEG exam matched this stan­dard.

Nine­ty-sev­en of the 159 chil­dren and ado­les­cents (61%) were diag­nosed with ADHD by the psy­chi­atric eval­u­a­tion. Six­ty-four of these chil­dren were diag­nosed with at least 1 oth­er dis­or­der, 35 had at least 2 addi­tion­al dis­or­ders, and 11 had at least 3 addi­tion­al dis­or­ders. The most com­mon comor­bidi­ties were one of the dis­rup­tive behav­ior dis­or­ders (Oppo­si­tion­al Defi­ant Dis­or­der or Con­duct Dis­or­der) which occurred in 66 of the 97, fol­lowed by an anx­i­ety dis­or­der (46 of 97), learn­ing dis­or­der (33 of 97), and mood dis­or­der (23 of 97).

Of the 62 par­tic­i­pants not meet­ing cri­te­ria for ADHD, all but 8 were diag­nosed with one of these oth­er dis­or­ders while 8 had no diag­no­sis.

Over­all, there­fore, this was a diverse clin­i­cal sam­ple that includ­ed the full range of psy­chi­atric dif­fi­cul­ties that clin­i­cians are called on to address.

- How accu­rate were behav­ior rat­ing scales at iden­ti­fy­ing ADHD? -

The behav­ior rat­ing scales did not per­form well. The results were as fol­lows:

ADHD-IV Par­ent — 28% false neg­a­tives, 67% false pos­i­tives, 56% over­all accu­ra­cy.

ADHD-IV Teacher — 62% false neg­a­tives, 39% false pos­i­tive, 47% over­all accu­ra­cy.

ADHD-IV P&T com­bined — 45% false neg­a­tives, 57% false pos­i­tives, 50% over­all accu­ra­cy.

Con­ners Par­ent — 22% false neg­a­tives, 86% false pos­i­tives, 55% over­all accu­ra­cy.

Con­ners Teacher — 33% false neg­a­tives, 59% false pos­i­tives, 58% over­all accu­ra­cy.

Con­ners P&T com­bined — 28% false neg­a­tives, 81% false pos­i­tives, 53% com­bined.

As can be seen, the rate of false neg­a­tives (chil­dren diag­nosed with ADHD based on the psy­chi­atric eval­u­a­tion that scored below the rec­om­mend­ed ADHD cut-off on the rat­ing scale) ranged from 28% for the par­ent ver­sion of the Con­ners Rat­ing Scales to 62% for the teacher ver­sion of the ADHD-IV rat­ing scale.

False pos­i­tive rates (chil­dren with­out ADHD based on the psy­chi­atric eval­u­a­tion who scored pos­i­tive for ADHD on the rat­ing scale) ranged from 39% to 86%. The extreme­ly high false pos­i­tive rate for the par­ent ver­sion of the Con­ners indi­cates that par­ents tend­ed to rate their child high on ADHD symp­toms even when ADHD was not judged to be present.

Over­all clas­si­fi­ca­tion accu­ra­cy — how often rat­ing scale results agreed with psy­chi­atric eval­u­a­tion results — was below 60% for every scale. Thus, the lev­el of agree­ment was not much bet­ter than chance.

- QEEG Accu­ra­cy -

The accu­ra­cy of QEEG as a diag­nos­tic test was much high­er — the false neg­a­tive rate was only 13% and the false pos­i­tive rate was only 6%; this result­ed in an over­all accu­ra­cy rate of 89%. These fig­ures indi­cate the fol­low­ing:

- 87% of chil­dren diag­nosed with ADHD by the psy­chi­atric eval­u­a­tion showed the EEG mark­er for the dis­or­der;

- 94% of chil­dren with­out ADHD screened neg­a­tive for the EEG mark­er;

- If ADHD diag­no­sis was based strict­ly on the pres­ence or absence of the EEG mark­er, it would match deci­sions based on the psy­chi­atric eval­u­a­tion almost 90% of the time.

Over­all, these results are far supe­ri­or to the clas­si­fi­ca­tion accu­ra­cy using rat­ing scales.

- Extend­ing the find­ings to dif­fer­ent sub­groups and comor­bidi­ties -

Because par­tic­i­pants rep­re­sent­ed a diverse clin­i­cal sam­ple, the researchers could test whether QEEG accu­ra­cy was sim­i­lar for chil­dren vs. ado­les­cents, whites vs. blacks, and males vs. females. Across these dif­fer­ent demo­graph­ic groups, over­all accu­ra­cy rates ranged from 87% to 95%. Thus, QEEG worked well with­in all demo­graph­ic groups.

The authors also exam­ined whether diag­nos­tic accu­ra­cy of the QEEG was con­sis­tent depend­ing on whether or not oth­er dis­or­ders were present. When the psy­chi­atric eval­u­a­tion indi­cat­ed ADHD, the QEEG was equal­ly like­ly to be pos­i­tive regard­less of what oth­er psy­chi­atric con­di­tions were diag­nosed. Sim­i­lar­ly, when ADHD was not diag­nosed, the like­li­hood that the QEEG mark­er was neg­a­tive did not depend on what oth­er con­di­tions were present. Thus, the clas­si­fi­ca­tion accu­ra­cy of QEEG as a diag­nos­tic test for ADHD was not influ­enced by the pres­ence or absence of oth­er psy­chi­atric con­di­tions.

- Sum­ma­ry and Impli­ca­tions -

I believe these find­ings are very impor­tant. One clear impli­ca­tion is that results from behav­ior rat­ing scales must be used cau­tious­ly in ADHD eval­u­a­tions. Mak­ing diag­nos­tic deci­sions based on count­ing symp­toms and/or deter­min­ing whether a child’s rat­ing scale results falls in a clin­i­cal­ly ele­vat­ed range for ADHD will lead to high rates of mis­di­ag­no­sis in com­par­i­son to what would emerge from a com­pre­hen­sive psy­chi­atric eval­u­a­tion. In par­tic­u­lar, data from this study sug­gests that many chil­dren who do not tru­ly have ADHD would be erro­neous­ly diag­nosed with the dis­or­der.

I should empha­size that ADHD eval­u­a­tion guide­lines from the Amer­i­can Acad­e­my of Pedi­atrics and the Amer­i­can Acad­e­my of Child and Ado­les­cent Psy­chi­a­try clear­ly indi­cate that rat­ing scales should nev­er be used in iso­la­tion to diag­nose an indi­vid­ual with ADHD. Thus, using rat­ing scales in this way is incon­sis­tent with best prac­tice guide­lines. How­ev­er, giv­en the lim­it­ed time avail­able in many pri­ma­ry care set­tings to con­duct com­pre­hen­sive eval­u­a­tions, it would not be sur­pris­ing if rat­ing scale results are some­times giv­en greater empha­sis than is rec­om­mend­ed.

This is where QEEG results can be so help­ful. In regards to match­ing ADHD diag­nos­tic deci­sions that result from a com­pre­hen­sive eval­u­a­tion, this test per­formed quite well — over­all accu­ra­cy rates were near­ly 90%. The false pos­i­tive rate of only 6% means that few chil­dren and ado­les­cents for whom ADHD is ruled out by a com­pre­hen­sive psy­chi­atric exam would be diag­nosed if QEEG find­ings were used to make the deci­sion. This is a strik­ing con­trast to false pos­i­tive rates that exceed­ed 80 % for some of the rat­ing scale mea­sures. Although adjust­ing how rat­ing scale data is used to make deci­sions about ADHD might improve clas­si­fi­ca­tion accu­ra­cy some­what, it is dif­fi­cult to imag­ine that over­all accu­ra­cy rates would ever approach that found for QEEG.

It is impor­tant to under­score that despite the strong results found for QEEG, this tool is not a sub­sti­tute for a com­pre­hen­sive diag­nos­tic exam and should not be used as a stand alone test for ADHD. One essen­tial rea­son for this is that diag­nos­tic eval­u­a­tions for ADHD should go beyond sim­ply decid­ing whether ADHD is present and gath­er oth­er infor­ma­tion that is crit­i­cal for devel­op­ing an opti­mal treat­ment plan. While QEEG may help with the for­mer, it does not con­tribute to the lat­ter, beyond iden­ti­fy­ing indi­vid­u­als for whom med­ica­tion treat­ment would be an appro­pri­ate option to con­sid­er. I have heard expe­ri­enced users of QEEG dis­cuss that oth­er data from the pro­ce­dure can be use­ful in more expan­sive treat­ment plan­ning, but I am not famil­iar with research that sup­ports this broad­er use.

Giv­en this lim­i­ta­tion, what val­ue would there be to rou­tine­ly incor­po­rat­ing QEEG into ADHD diag­nos­tic eval­u­a­tions. Sev­er­al things come to mind includ­ing the fol­low­ing:

1. In pri­ma­ry care set­tings where a com­pre­hen­sive psy­chi­atric exam can be dif­fi­cult to pro­vide, results from a 30–40 minute QEEG pro­ce­dure can iden­ti­fy with rea­son­ably high accu­ra­cy indi­vid­u­als for whom ADHD is like­ly to be an appro­pri­ate diag­no­sis.

2. Because false pos­i­tive rates are so low, QEEG could reduce the num­ber of indi­vid­u­als who are per­haps inap­pro­pri­ate­ly treat­ed with ADHD med­ica­tion if physi­cians referred indi­vid­u­als with neg­a­tive results for fur­ther eval­u­a­tion.

3. In cas­es where par­ents are reluc­tant to pur­sue treat­ment for their child because of con­cerns that objec­tive eval­u­a­tion pro­ce­dures were lack­ing, QEEG pro­vides an objec­tive bio­log­i­cal mark­er of ADHD that can increase par­ents’ con­fi­dence in their child’s eval­u­a­tion.

4. For peo­ple who con­tin­ue to doubt that ADHD is an actu­al con­di­tion with impor­tant bio­log­i­cal under­pin­nings, these find­ings high­light that the vast major­i­ty of indi­vid­u­als meet­ing DSM-IV cri­te­ria for ADHD have a dis­tinc­tive pat­tern of brain EEG activ­i­ty.

Over­all, find­ings from this care­ful­ly con­duct­ed study make an impor­tant con­tri­bu­tion to doc­u­ment­ing the util­i­ty of QEEG as an objec­tive test to assist in the diag­no­sis of ADHD. If this pro­ce­dure were to become more wide­ly used, these data sug­gest that the num­ber of chil­dren and ado­les­cents who are inap­pro­pri­ate­ly diag­nosed and treat­ed for the dis­or­der would dimin­ish sub­stan­tial­ly.

Rabiner_David– Dr. David Rabin­er is a child clin­i­cal psy­chol­o­gist and Direc­tor of Under­grad­u­ate Stud­ies in the Depart­ment of Psy­chol­ogy and Neu­ro­science at Duke Uni­ver­sity. He pub­lishes Atten­tion Research Update, an online newslet­ter that helps par­ents, pro­fes­sion­als, and edu­ca­tors keep up with the lat­est research on ADHD, and teach­es the online course  How to Nav­i­gate Con­ven­tion­al and Com­ple­men­tary ADHD Treat­ments for Healthy Brain Devel­op­ment.

For relat­ed read­ing, you may enjoy:

- How Strong is the Research Sup­port for Neu­ro­feed­back in Atten­tion Deficits?.

- More on Neurofeedback’s Brain Train­ing Val­ue

Leave a Reply...

Loading Facebook Comments ...

2 Responses

  1. chris harper says:

    Thank you for the excel­lent infor­ma­tion regard­ing objec­tive test­ing of ADHD. Hope­ful­ly, there will be fur­ther devel­op­ment in tests sim­i­lar to the QEEG and the psy­chi­atric com­mu­ni­ty will be able to fend off those that doubt that ADHD exists.

  2. Impor­tant arti­cle, well writ­ten Dr. Rabin­er. Thanks. The accu­ra­cy rate for the QEEG trumps every oth­er method! I hadn’t real­ized how impor­tant the Sny­der, 2008 study is. Thank you.

Leave a Reply

Categories: Attention and ADD/ADHD

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

All Slidedecks & Recordings Available — click image below

Search for anything brain-related in our article archives

About SharpBrains

As seen in The New York Times, The Wall Street Journal, BBC News, CNN, Reuters, and more, SharpBrains is an independent market research firm and think tank tracking health and performance applications of brain science.