most light swirl marks are caused by clothes and sponges..

dust will cause them....
in fact its hard to get the light ones out as the more you try to remove them the more they appear!

its rather like polishing cds. you will always have fine marks on them which you can see at certin angles, aslong as there not visible from direct view there not really a problem..