For the AlKo stabiliser t do its job properly the towball only has to be free from loose rust, paint, grease, etc. but it doesn't have to be absolutely bright.
Paint could effect the anti sway pads in the tow hitch, How about the finger of a rubber glove ( no other comments required )