Almost no-one realizes that the family filter drastically decreases the amount of search results you are going to receive. Hell, most don't even realize there is a family filter. Turn it off, see what happens.

It's not the only reason why search results are fewer, but it's one of the major reasons.