countersinking problem

hi,
I have a minor countersinking problem. I'm using a proper ali counter sink drill bit, in 3mm ali.
http://i135.photobucket.com/albums/q135/muggnz/rusty/countersinkingburrs.jpg
I cannot get the edge of the hole as smooth as I'd like by drilling. No matter how slow I drill, using light pressure & a slow speed drill. There always seems to be some rough edges.
The slowest speed of my drill press is 625 rpm.
I know I can sand them off, however that leaves other marks I'd rather avoid.
Is there an easy way of counter sinking, without creating this problem?
thanks
david
I have a minor countersinking problem. I'm using a proper ali counter sink drill bit, in 3mm ali.
http://i135.photobucket.com/albums/q135/muggnz/rusty/countersinkingburrs.jpg
I cannot get the edge of the hole as smooth as I'd like by drilling. No matter how slow I drill, using light pressure & a slow speed drill. There always seems to be some rough edges.
The slowest speed of my drill press is 625 rpm.
I know I can sand them off, however that leaves other marks I'd rather avoid.
Is there an easy way of counter sinking, without creating this problem?
thanks
david