[Planetlab-users] easy and efficient file transfer from one node
to many nodes?
KyoungSoo Park
kyoungso at CS.Princeton.EDU
Thu Feb 14 13:07:13 EST 2008
Have you looked into CoBlitz?
http://codeen.cs.princeton.edu/coblitz/
You need to place the big file under a regular webserver,
and the client nodes can fetch it through any HTTP tools(wget, curl)
by attaching http://coblitz.codeen.org/ to the URL.
--KyoungSoo
Lucas Nussbaum wrote:
> Hi,
>
> I'd like to transfer one big file available on one node, to many nodes.
> What would be the most efficient/easy ways to do that?
>
> I've thought of GridFTP, but GridFTP seems to be good at many-to-many
> file transfers, not one-to-many. (ie I would have to run several
> servers)
>
> Another option is BitTorrent, but then, I need to setup a tracker, a
> seeder, and kill them when the transfer is over. Or are there wrappers
> doing that for me already available?
>
> PCP, pscp and prsync won't scale like I'd like them to (if I get the way
> they work right), since all transfers will be initiated by the server.
>
> Any other idea?
More information about the Users
mailing list