[Planetlab-users] easy and efficient file transfer from one node to many nodes?

KyoungSoo Park kyoungso at CS.Princeton.EDU
Thu Feb 14 13:07:13 EST 2008


Have you looked into CoBlitz?

http://codeen.cs.princeton.edu/coblitz/

You need to place the big file under a regular webserver,
and the client nodes can fetch it through any HTTP tools(wget, curl)
by attaching http://coblitz.codeen.org/ to the URL.

--KyoungSoo

Lucas Nussbaum wrote:
> Hi,
> 
> I'd like to transfer one big file available on one node, to many nodes.
> What would be the most efficient/easy ways to do that?
> 
> I've thought of GridFTP, but GridFTP seems to be good at many-to-many
> file transfers, not one-to-many. (ie I would have to run several
> servers)
> 
> Another option is BitTorrent, but then, I need to setup a tracker, a
> seeder, and kill them when the transfer is over. Or are there wrappers
> doing that for me already available?
> 
> PCP, pscp and prsync won't scale like I'd like them to (if I get the way
> they work right), since all transfers will be initiated by the server.
> 
> Any other idea?



More information about the Users mailing list