All of the small bars within each pattern are actually the same color. Numerous theories of this illusion (such as Grossberg's and colleagues) have assumed that the alignment of the small horizontal targets played a critical role in the effect. Clearly, this is not true.

A theory of what's underlying the lightness illusions in this figure is described my 1997 Perception paper (sorry, no pdfs from this year).