[metrics-dev] A Q about metrics

[Ian Foster]

right ... we had a detailed plan for this ... I don't know where it is, though!


At 11:33 AM 10/16/2006 -0500, William E. Allcock wrote:
>This is all very good.  However, it is not clear that what I was referring
>to as summarization is being done (maybe it is, but I can't tell).  I was
>not referring to these reports.  I was referring to long term handling of
>the raw data.  Actually summarizing the raw packet data into summary
>records, then rolling the raw data off to tape or some such system.  Is that
>happening?
>
>Bill
>
> > -----Original Message-----
> > From: owner-metrics-dev at globus.org
> > [mailto:owner-metrics-dev at globus.org] On Behalf Of Lee Liming
> > Sent: Monday, October 16, 2006 10:39 AM
> > To: Jarek Gawor
> > Cc: 'Stuart Martin'; 'Ian Foster'; metrics-dev at globus.org
> > Subject: Re: [metrics-dev] A Q about metrics
> >
> > Thanks Jarek!
> >
> >        -- Lee
> >
> > On Oct 13, 2006, at 4:45 PM, Jarek Gawor wrote:
> >
> > > Ok. I setup monthly reports for gram, rft, and gridftp
> > (from within my
> > > account).
> > >
> > > I also regenerated these reports for the last 12 months. You can
> > > see the
> > > results here: http://www-unix.mcs.anl.gov/~gawor/stats/
> > >
> > > I also committed most of the scripts that generate these
> > pages to cvs.
> > >
> > > Jarek
> > >
> > >> -----Original Message-----
> > >> From: Lee Liming [mailto:liming at mcs.anl.gov]
> > >> Sent: Monday, October 09, 2006 12:17 PM
> > >> To: Stuart Martin
> > >> Cc: Jarek Gawor; Ian Foster; metrics-dev at globus.org
> > >> Subject: Re: [metrics-dev] A Q about metrics
> > >>
> > >>
> > >> I have been running them monthly myself, though, to get the reports
> > >> that I include in our monthly metrics reports.  (And it's
> > time to do
> > >> it again!)
> > >>
> > >> It would be great to have them added to the monthly run.
> > >>
> > >> Far more important, however, would be to fix the report
> > >> generators so
> > >> that they are efficient.  Sadly, the report generator as currently
> > >> implemented is incredibly inefficient.  It literally takes up to 8
> > >> hours to run some of them on a month's worth of data.  That's
> > >> outrageous.
> > >>
> > >>        -- Lee
> > >>
> > >> On Oct 9, 2006, at 10:07 AM, Stuart Martin wrote:
> > >>
> > >>> Actually, the GRAM, GridFTP and RFT reports are not automatically
> > >>> rerun each month.  They need to be re-run by hand again in
> > >> order to
> > >>> get stats for Aug and Sept.  http://www-unix.mcs.anl.gov/~gawor/
> > >>> stats/other/gram/jobhistogram.png
> > >>>
> > >>> Jarek - can you add rerunning of GRAM, GridFTP and RFT
> > >> reports part
> > >>> of the monthly update that you send out for core?  So the monthly
> > >>> rerunning would be for any component that has written easy to run
> > >>> monthly reports.
> > >>>
> > >>> Is that reasonable?
> > >>>
> > >>> -Stu
> > >>>
> > >>> On Oct 9, 2006, at Oct 9, 10:52 AM, Lee Liming wrote:
> > >>>
> > >>>> You have sen the student's work in the monthly metrics reports,
> > >>>> which now have usage data reports for WS GRAM, GridFTP, RFT, and
> > >>>> Java WS Core.
> > >>>>
> > >>>> I don't think we ever intended for him to make changes to the
> > >>>> daily reports.
> > >>>>
> > >>>> We do have a set of changes to the daily reports scoped out for
> > >>>> someone to work on.  It's in the Metrics roadmap & campaign
> > >>>> information in Bugzilla, and it's in the CDIGS report
> > >> "Anticipated
> > >>>> changes to metrics reports in CDIGS Y1".
> > >>>>
> > >>>>         -- Lee
> > >>>>
> > >>>>
> > >>>> On Oct 8, 2006, at 7:26 AM, Ian Foster wrote:
> > >>>>
> > >>>>> Hi.
> > >>>>>
> > >>>>> I understand that Stu has a student working over the summer (?)
> > >>>>> on metric reporting, with the goal of producing more detailed
> > >>>>> reports. Did that work get completed? I don't see new data
> > >>>>> reflected in the daily email reports.
> > >>>>>
> > >>>>> Ian.
> > >>>>>
> > >>>>> _______________________________________________________________
> > >>>>> Ian Foster -- Weblog: http://ianfoster.typepad.com
> > >>>>> Computation Institute: www.ci.uchicago.edu & www.ci.anl.gov
> > >>>>> Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439
> > >>>>> Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637
> > >>>>> Tel: +1 630 252 4619 --- Globus Alliance: www.globus.org
> > >>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> > >>
> > >
> >
> >

_______________________________________________________________
Ian Foster -- Weblog: http://ianfoster.typepad.com
Computation Institute: www.ci.uchicago.edu & www.ci.anl.gov
Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439
Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637
Tel: +1 630 252 4619 --- Globus Alliance: www.globus.org


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.globus.org/pipermail/metrics-dev/attachments/20061016/c7aadfa3/attachment.htm>