Yes, flats must be taken for every filter you use. Even more, if you take the camera away from the telescope, flats will change when you put it again in the focal plane. OTOH, light distribution can be affected also if we change focus position.
Vicent.