On a black car any toothbrushing would leap out and slap you in the face the moment you finished an inch.... The reason you're not seeing it is the forgiveness of silver and other light colors... They hide their owner's sins well...

It's not permanent damage, it just requires a light polish to work back out...