Gnutella Forums

Gnutella Forums (https://www.gnutellaforums.com/)
-   Development Open Discussion (https://www.gnutellaforums.com/development-open-discussion/)
-   -   Features doubts (https://www.gnutellaforums.com/development-open-discussion/95269-features-doubts.html)

zageyiff April 7th, 2010 03:12 PM

Features doubts
 
Hi all,

I've trying to find specific information about the features that Phex uses but I haven't been able to find anything.

* Which gnutella version is phex implementing. As I found there are different specification.

* Which search mecanism it uses. Looking at the source code I've found it uses Dynamic Queries, I just want to make sure here. And is it the only mechanism used?

* I've been looking for a way to do a hashcode search programatically using the phex source code. I haven't found anything, can anyone point me in the right direction.

* It would be great to have a firewall to firewall transfer, which I see is in the roadmap (http://www.phex.org/wiki/index.php/Roadmap). The question here is if there is an estimated time for when the development on this feature will start and how long will it take?
I see there's also a feature to support the limewire's mojito DHT which may help with the firewall to firewall transfer. Is there any estimated time for this as well?

* Is there a way that when bootstraping the phex client, it will find the clients in the local area network. I suppose it would by doing a multicast or broadcast in the network to identify which phex peers are on the same network. This will help in doing downloads faster if the file being wanted to download is within the same network.

* I have found some topics related to this. How would be the best way to manage fake results when these fakes constantly change their host or their sha1 hashcodes?

* Does phex have a limit handling large files?

* Are there any plans on implementing UPnP and NatPMP??

GregorK April 8th, 2010 02:13 AM

Quote:

Originally Posted by zageyiff (Post 354032)
* Which gnutella version is phex implementing. As I found there are different specification.

Phex is implementing the most current version, lets call it 0.6, and is additionally supporting a long list of protocol extension.

Quote:

Originally Posted by zageyiff (Post 354032)
* Which search mecanism it uses. Looking at the source code I've found it uses Dynamic Queries, I just want to make sure here. And is it the only mechanism used?

Yes it uses Dynamic Queries. Older search methods are not supported anymore.

Quote:

Originally Posted by zageyiff (Post 354032)
* I've been looking for a way to do a hashcode search programatically using the phex source code. I haven't found anything, can anyone point me in the right direction.

Phex supports hashcode queries, though they are not generally supported on the Gnutella network. You can assume that your hashcode searches wont return very satisfactory results, they will usually get dropped very fast.
Check out ResearchSettings.startSearch()

Quote:

Originally Posted by zageyiff (Post 354032)
* It would be great to have a firewall to firewall transfer, which I see is in the roadmap (http://www.phex.org/wiki/index.php/Roadmap). The question here is if there is an estimated time for when the development on this feature will start and how long will it take?
I see there's also a feature to support the limewire's mojito DHT which may help with the firewall to firewall transfer. Is there any estimated time for this as well?

We are looking for developers who would like to work on these topics. If you like to contribute you would be very welcome.

Quote:

Originally Posted by zageyiff (Post 354032)
* Is there a way that when bootstraping the phex client, it will find the clients in the local area network. I suppose it would by doing a multicast or broadcast in the network to identify which phex peers are on the same network. This will help in doing downloads faster if the file being wanted to download is within the same network.

Yes that would be a very nice feature. We have some ideas how we would like to improve local network support. Though we currently don't have the time and resources to work on this topic. Like already mentioned above, we would be happy to get help.

Quote:

Originally Posted by zageyiff (Post 354032)
* Does phex have a limit handling large files?

Yes: 2^63 - 1 bytes ~ 8 exabytes

Quote:

Originally Posted by zageyiff (Post 354032)
* Are there any plans on implementing UPnP and NatPMP??

Yes, once we found someone who would like to help.

arne_bab April 8th, 2010 03:40 AM

Hi,

Welcome to the Gnutella Forums!

I’ll directly come to your questions:

* Phex implements Gnutella 0.6 with almost all extensions except the DHT.

* The search mechanism is dynamic querying on the requester side. Also it supports Query Routing (via QRT) on the forwarding part.

* Hash-searching can only be done efficiently using the DHT which isn’t yet implemented. So you can only search for the filename and then match the returned hashes.

* The RoadMap progressing slowly right now – job vs. hoppy.

* Currently Phex gets all download-sources via the download mesh. I don’t know if there are additions for local broadcasts. But it would be nice, I think.

* For fake files you can either check for some common names (i.e. weed out all *.qt files for they can phone home), check for the host and ban it (only works if the fake files are intended to be downloaded and not just an attack on the network structure) or implement something like credence for Phex: Credence: Thwarting P2P Pollution

* I don’t know a limit for the file size.

* See RoadMap info…

For what do you want to use it?

EDIT: Posting collision :)

zageyiff April 9th, 2010 09:03 AM

Thanks GregorK and arne_bab for the quick response.

I have more questions regarding the answers

Quote:

Originally Posted by GregorK (Post 354044)
Phex is implementing the most current version, lets call it 0.6, and is additionally supporting a long list of protocol extension.

Is there some place where I can check the list of these protocol extensions??

Quote:

Originally Posted by GregorK (Post 354044)
Yes it uses Dynamic Queries. Older search methods are not supported anymore.

Are there plans to improve the search mechanism, maybe by using some of the features of the called "Gnutella2" features or by the protocol modifications made by limewire?

Quote:

Originally Posted by GregorK (Post 354044)
Phex supports hashcode queries, though they are not generally supported on the Gnutella network. You can assume that your hashcode searches wont return very satisfactory results, they will usually get dropped very fast.
Check out ResearchSettings.startSearch()

Thanks to pointing on this direction, actually what I was looking for was to find more candidates to one download. And this method is called when you select search in the candidates table. I found the logic that if the search term is less than two characters it will include the urn in the query search, but I think using only the search term is better. Even phex handles automatically adding the candidates to the SWFownloadFile which is great.


Quote:

Originally Posted by GregorK (Post 354044)
We are looking for developers who would like to work on these topics. If you like to contribute you would be very welcome.

This would be good. We are actually two developers who are working with phex, and we have some basic knowledge of the mojito DHT. We would be glad to help here. We need to get more familiar with the source code and read more about mojito DHT. But surely we can help. Let me know how we can get an agreement here.

Quote:

Originally Posted by GregorK (Post 354044)
Yes that would be a very nice feature. We have some ideas how we would like to improve local network support. Though we currently don't have the time and resources to work on this topic. Like already mentioned above, we would be happy to get help.

We actually have seen something about these, and have seen some working code. Our doubt would be how to add those nodes into phex. We can help here as well, let me know.

Quote:

Originally Posted by GregorK (Post 354044)
Yes, once we found someone who would like to help.

I guess this have something to do with multicast as well, which I imagine would be the mechanism of the LAN discovery.

As a resume, we would be glad to help. I think there are two main topics here: mojito DHT and multicast.
About mojito DHT, it will be a task that will take time. Having this we can use it as base for the firewall-to-firewall.
About multicast, it will help with the LAN discovery and with the upnp and natpmp. Which I guess will be less time consuming than DHT

Quote:

Originally Posted by arne_bab (Post 354045)
* Hash-searching can only be done efficiently using the DHT which isn’t yet implemented. So you can only search for the filename and then match the returned hashes.

Yes we actually found the code that does what we wanted, thanks

Quote:

Originally Posted by arne_bab (Post 354045)
* Currently Phex gets all download-sources via the download mesh. I don’t know if there are additions for local broadcasts. But it would be nice, I think.

What do you mean by download mesh? I haven't heard about it.

Quote:

Originally Posted by arne_bab (Post 354045)
* For fake files you can either check for some common names (i.e. weed out all *.qt files for they can phone home), check for the host and ban it (only works if the fake files are intended to be downloaded and not just an attack on the network structure) or implement something like credence for Phex: Credence: Thwarting P2P Pollution

I took a look at the page you sent. Looks like and interesting program, but how well is it supported? Does it have a good user base so it's working as expected? Also I think they gathered the limewire's source code and modify it, so if we want to integrate into phex it will be hard.

Quote:

Originally Posted by arne_bab (Post 354045)
* See RoadMap info…

Actually I've done that :) it's just that I didn't see anything about it.

Quote:

Originally Posted by arne_bab (Post 354045)
For what do you want to use it?

We want to use it as a gnutella API. Basically for download audio files and do keyword searches.

arne_bab April 10th, 2010 06:13 AM

Quote:

Originally Posted by zageyiff (Post 354066)
What do you mean by download mesh? I haven't heard about it.

The download mesh is an extension to http used by Gnutella. Basically all downloaders and uploaders exchange the sources they know (just like a completely decentral BitTorrent server).

The headers are X-Alt (IPs+ports of other down- and uploaders) and X-NAlt (non working IPs+ports for preventing spam and getting offline nodes out of the mesh).

As soon as you've seen a download going from 5 sources to 400 sources in half a minute, you know its efficiency :)

Quote:

I took a look at the page you sent. Looks like and interesting program, but how well is it supported?
Sadly it isn’t supported at all. It was implemented on top of LimeWire, but rejected by the limewire team. so it’s only a proof of concept (it worked quite well — at least for the tests I did back then).

This had the potential of stopping spam once and for all, so I thought it might interest you.

Quote:

Actually I've done that :) it's just that I didn't see anything about it.
I meant my info I wrote above — sorry for not being clearer.

Quote:

We want to use it as a gnutella API. Basically for download audio files and do keyword searches.
That’s great! http://groups.yahoo.com/group/the_gdf/message/23708

If I can do anything to help, please tell me. I’m no Java coder, but I have some background knowledge from supporting Phex users in here and discussing in the_gdf (the Gnutella development forum).

The current discussion in the GDF might also be interesting to you: More intelligent searches via a GGEP extension: "a AND (b OR c)"

the_gdf : The Gnutella Developer Forum (GDF)
Yahoo! Groups


All times are GMT -7. The time now is 10:21 PM.

Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2024, vBulletin Solutions, Inc.
SEO by vBSEO 3.6.0 ©2011, Crawlability, Inc.

Copyright © 2020 Gnutella Forums.
All Rights Reserved.