If your not already, try using
PeerGuardian 2. It works like a mini firewall for while your using p2p apps. They maintain block lists that block unwanted ip's. Possibly that's why i havent had that problem. Those ip addresses may already be on the block list.