I used to use ~$25 Tiffen filters (UV, ND and CPL) and I never had any such issue. The only reason I stopped using them was because I generally felt like the images had a little more "pop" without them (aside from the CPL) and I'm not afraid of damaging my cheapo lenses with hoods on them.