Not only the risk of rubbing, but when you change the offset you are also changing the track of the car and the loading forces on the wheel bearings, suspension arms etc. When you decrease the offset (move the wheels outwards) you put more and more stress on the wheel bearings. The same goes for moving the wheels inwards but that is that often a problem because people generally don't move wheels inward for aesthetics, and plus the wheel arch stops you at some point

It's probably not noticeable unless you are making huge changes like using spacers etc, but changing offset will also change the wheel rate (the effective spring rate of the suspension on the road surface when taking into account your spring rate and the leverage that the control arms etc apply onto the spring).