regional disparity in search results

hey.


first i want to give an example illustrating what I mean by the headline-- :

Me and a friend are both gnutella users- I live in Germany,
she's in California.

I once wanted her to listen to some German Rap, and advised her to search for a specific artist on Gnutella.
We were both connected to the network at that time, and I
could find many files matching the keyword.

My friend was unable to get any search results.

Naturally, the content on the users' machines differs from country to country.

I assume that most machines she had in her horizon at that time were set up in the anglo-american sphere and that most of the hosts she was directly connected to where in the US.

This doesn't sound logical because the hostcaches should connect people from everywhere, disregarding their geographical position.

Yet connections hosted by an ISP spatially close to your own location generally have a better quality, i.e. the US ISPs are better interconnected than they are connected to the European / Asian ISPs.

therefore, I guess that the hosts one stays connected to (the ones not timing out or disconnecting because of lacking bandwidth etc.) are either regionally close to yourself or within the same "virtual" region of well-interconnected networks.

The search queries have a limited TTL and number of hops, so the farther "away" (in the terms described above) a host is, the harder it becomes to reach that host and its content.

For example, I hardly ever get connected to Japanese hosts.
I do know that the content I'm looking for is more likely to be situated on japanese machines.
The example of my US pal not finding German rap in her "regional" gnutella subnetwork describes exactly the same situation.

did I make a mistake in that thinking model?

Is there a way to tweak clients so that they integrate themselves in a subnetwork of the user's choice?

The solution would be "regional" hostcaches that automatically connect users to corresponding clients and provide a neat horizon showing the other hosts in that particular sphere.

Are there such regional hostcaches??

I saw some txt lists once, but that seems a lil bit awkward considering the dynamics of the gnutella network.

k please tell me what you think about this and whether I made any mistakes (or came up with something you've discussed already.....if so, sorry)

noci

[Moak]

> Are there such regional hostcaches??

I don't think so.

You needs a big portion of luck to find the same gnutella horizon. Better try to connect direct to each others gnutella client (problematic if behind firewalls) - OR - try both to connect to at least one host parallel (exchange the IPs your client is connected to via IRC/ICQ/Email, after connected to the gnutella network).
If you wanna try a direct connection between servants: At least one peer has to allow 'incoming connections' (make sure your firewall doesn't block), then connect to the other peer's IP and port. The port is usually 6346 (check in your servants settings), the "real" IP of your internet connection may be harder to find out. Ask a friend who is familiar with your operating system... or you can try to meet your friend on IRC: Perform a /whois <nickname> and you'll know the IP/hostname of your opponent. Once you started your gnutella client, connect to your friends IP/host... your gnutella client of choice should provide a "add host" option to do this.

Good luck! Feel free to consult a gnutella documentation before asking more questions.

Oh, and I don't wanna forget to mention, that exchanging large files between friends is also nice via FTP. Why? Most FTP software is very efficient in exchanging and resuming large files. Using FTP is similar to the 'direct connection' described above (little bit more "geeky"). One side does use a FTP client to connect to a FTP server on the other side. You find everything at www.tucows.com

Good night, Moak

[noci]

yeah if I personally know the other person using gnutella, I can manually connect.

but what happens if I don't know the IP number of any member of the "regional" subnetwork i want to connect to?

some sort of hostcache only providing IP numbers of a designated "origin" would come in handy.

i.e. only being provided a list of hostnames ending with *.jp would be a great help to really connect to machines actually situated in Japan and (hopefully) hosting the desired content.
same filtering could be done with almost any gTLD.

hey perhaps that could be a feature of the clients themselves- there should be a switch that forces the programme only to connect to clients from a certain gTLD.

n

[Moak]

I like the idea of gnutella being a global network.

Saying this... it might be very good idea to specialize gnutella horizons a little bit. You know for sure, a gnutella user is never connected to the whole gnutella network, it's too big. Instead you can only see a crowd of other users, the so called "horizon" within the network. Having spezialized horizons you could find more "rare files" or meet people with same interest (regional interests, same music taste, cook recipes etc). Together with a chat feature maybe?

My suggestion to achieve/implement this extension within a upcoming gnutella client: Each user can edit some keywords to describe his interests, e.g. "synthpop, italian food, OpenGL" (case doesn't matter). On connection gnutella clients exchange keywords with each other. Now every client tries to establish at least 1-2 gnutella connections to clients with same interest, this is constantly done. As a result gnutella horizons are dynamically sorted with slightly specialized horizons _AND_ still building a global network (important if you don't want to be stuck in a regional segmentated network).
Looking into far future, it might be possible to do horizon travelling.... search movies in one horizon and then step further to get the latest outer space cook recipes in another horizon. yeah.

Hope you like my suggestion, Moak

[noci]

yes, cool idea ;-)

faintly reminded me of the ID3 "genre" tag for Mp3s.
of course, the decision which musical genre a file represents is subjective.
But if Gnutella could search files by that tag, the results would still be averagely good because there is something like a "mental common ground" of users.

Same applies to the user interest groups- pools of interconnected users sharing the same interests would certainly form!

if it was possible to combine the group-by-interest feature with gTLD filtering, gnutella queries would no longer resemble searching for a needle in a haystack.
let's see what the developers think about all this......

you know -- in the old versions of Lime wire you could manually set the TTL to something extraordinary like 14. Its not very nice, but it sure pulled in the results -- especially if you were looking for something specific. I wish someone would tell me how to set the TTL in the current version...
-D

[Moak]

You know, a lot of (or all?) servants will lower TTL to something healthy while they route it. So do not expect better results with 'extraordinary' high TTLs.

that's good to know. So TTL doesn't do so much anymore. I swear that it used to make a huge difference. So what can I do to make deep searches? Just keep trying? and manually connect to different hosts? Seems rather inefficient...

[SRL]

I had been thinking that it help if a client watched which of the connections you have were returning the most results after a search, and then just try to connect to more IPs from that source (using IPs returned by the searches, pongs, and so on).

This way people with similar interests might just naturally "clump together" so to speak. It should also work without any changes to the protocol.

[Moak]

> naturally "clump together

yes, sound interesting! A kind of horizon travelling or creeping until you find more hits, horizons could dynamically order themselfs.