Direct Connect can be difficult. Very rarely will you be able to direct connect to ip addresses starting with 192. or 10. ... as they are network ip addresses. That's the way it's always been.

Other addresses it depends on so many things, whether their & your firewalls are properly set up, whether you both have free upload & download slots or bandwidth, etc. It certainly helps if they have chat enabled for some reason.