Maybe its the opposite that's true....that large swaths of an unchanging background (i.e. large stretches of only white snow or long stretches of calm featureless water, etc) that actually screws with the S2's tracking mechanisms.
If the S2's tracking ability relies on depth perception (more so that contrast) it might get confused more easily when flying over snow or water.