[Planetlab-users] Collecting log-files
Alex Sherman
asherman at cs.columbia.edu
Tue Apr 24 13:02:51 EDT 2007
You may want to gzip first. It will obviously take some CPU -
but it may be better if you need to process the logs multiple
times.
-Alex
On Tue, 24 Apr 2007, Chad Yoshikawa wrote:
> In my experience the CPU is scarcer than the network bandwidth, so I'd go
> with a time-staggered remote copy of the logfiles back to your machine.
>
> Other users might have different opinions...
>
> -Chad
>
> Chad Yoshikawa
> CS Graduate Student
> yoshikco at ececs.uc.edu
>
>
> > -----Original Message-----
> > From: users-bounces at planet-lab.org [mailto:users-bounces at planet-lab.org]
> > On Behalf Of Sven Westergren
> > Sent: Tuesday, April 24, 2007 12:17 PM
> > To: users at lists.planet-lab.org
> > Subject: [Planetlab-users] Collecting log-files
> >
> > Hi all,
> >
> > I have some very large logfiles I need to collect from approximately 200
> > nodes on planet-lab, and I'm pondering how I should go about this.
> >
> > The way I see it I have two options:
> > A: process the logfiles locally on each planetlab-node (run it through a
> > grep+sed-script) such that the amount of data transmitted is minimized
> > B: collect the raw logfiles and process them on my own machine, thereby
> > limiting the cpu-load induced on the planet-lab nodes.
> >
> > Which way would you consider the most polite to the planetlab-community?
> >
> > best regards
> > Sven Westergren
> >
> > _______________________________________________
> > Users mailing list: Users at lists.planet-lab.org
> > https://lists.planet-lab.org/mailman/listinfo/users
>
> _______________________________________________
> Users mailing list: Users at lists.planet-lab.org
> https://lists.planet-lab.org/mailman/listinfo/users
>
More information about the Users
mailing list