[metrics-dev] A Q about metrics

Lee Liming liming at mcs.anl.gov
Mon Oct 16 11:49:46 CDT 2006


No, it isn't yet.

      -- Lee

On Oct 16, 2006, at 10:33 AM, William E. Allcock wrote:

> This is all very good.  However, it is not clear that what I was  
> referring
> to as summarization is being done (maybe it is, but I can't tell).   
> I was
> not referring to these reports.  I was referring to long term  
> handling of
> the raw data.  Actually summarizing the raw packet data into summary
> records, then rolling the raw data off to tape or some such  
> system.  Is that
> happening?
>
> Bill
>
>> -----Original Message-----
>> From: owner-metrics-dev at globus.org
>> [mailto:owner-metrics-dev at globus.org] On Behalf Of Lee Liming
>> Sent: Monday, October 16, 2006 10:39 AM
>> To: Jarek Gawor
>> Cc: 'Stuart Martin'; 'Ian Foster'; metrics-dev at globus.org
>> Subject: Re: [metrics-dev] A Q about metrics
>>
>> Thanks Jarek!
>>
>>        -- Lee
>>
>> On Oct 13, 2006, at 4:45 PM, Jarek Gawor wrote:
>>
>>> Ok. I setup monthly reports for gram, rft, and gridftp
>> (from within my
>>> account).
>>>
>>> I also regenerated these reports for the last 12 months. You can
>>> see the
>>> results here: http://www-unix.mcs.anl.gov/~gawor/stats/
>>>
>>> I also committed most of the scripts that generate these
>> pages to cvs.
>>>
>>> Jarek
>>>
>>>> -----Original Message-----
>>>> From: Lee Liming [mailto:liming at mcs.anl.gov]
>>>> Sent: Monday, October 09, 2006 12:17 PM
>>>> To: Stuart Martin
>>>> Cc: Jarek Gawor; Ian Foster; metrics-dev at globus.org
>>>> Subject: Re: [metrics-dev] A Q about metrics
>>>>
>>>>
>>>> I have been running them monthly myself, though, to get the reports
>>>> that I include in our monthly metrics reports.  (And it's
>> time to do
>>>> it again!)
>>>>
>>>> It would be great to have them added to the monthly run.
>>>>
>>>> Far more important, however, would be to fix the report
>>>> generators so
>>>> that they are efficient.  Sadly, the report generator as currently
>>>> implemented is incredibly inefficient.  It literally takes up to 8
>>>> hours to run some of them on a month's worth of data.  That's
>>>> outrageous.
>>>>
>>>>        -- Lee
>>>>
>>>> On Oct 9, 2006, at 10:07 AM, Stuart Martin wrote:
>>>>
>>>>> Actually, the GRAM, GridFTP and RFT reports are not automatically
>>>>> rerun each month.  They need to be re-run by hand again in
>>>> order to
>>>>> get stats for Aug and Sept.  http://www-unix.mcs.anl.gov/~gawor/
>>>>> stats/other/gram/jobhistogram.png
>>>>>
>>>>> Jarek - can you add rerunning of GRAM, GridFTP and RFT
>>>> reports part
>>>>> of the monthly update that you send out for core?  So the monthly
>>>>> rerunning would be for any component that has written easy to run
>>>>> monthly reports.
>>>>>
>>>>> Is that reasonable?
>>>>>
>>>>> -Stu
>>>>>
>>>>> On Oct 9, 2006, at Oct 9, 10:52 AM, Lee Liming wrote:
>>>>>
>>>>>> You have sen the student's work in the monthly metrics reports,
>>>>>> which now have usage data reports for WS GRAM, GridFTP, RFT, and
>>>>>> Java WS Core.
>>>>>>
>>>>>> I don't think we ever intended for him to make changes to the
>>>>>> daily reports.
>>>>>>
>>>>>> We do have a set of changes to the daily reports scoped out for
>>>>>> someone to work on.  It's in the Metrics roadmap & campaign
>>>>>> information in Bugzilla, and it's in the CDIGS report
>>>> "Anticipated
>>>>>> changes to metrics reports in CDIGS Y1".
>>>>>>
>>>>>>         -- Lee
>>>>>>
>>>>>>
>>>>>> On Oct 8, 2006, at 7:26 AM, Ian Foster wrote:
>>>>>>
>>>>>>> Hi.
>>>>>>>
>>>>>>> I understand that Stu has a student working over the summer (?)
>>>>>>> on metric reporting, with the goal of producing more detailed
>>>>>>> reports. Did that work get completed? I don't see new data
>>>>>>> reflected in the daily email reports.
>>>>>>>
>>>>>>> Ian.
>>>>>>>
>>>>>>> _______________________________________________________________
>>>>>>> Ian Foster -- Weblog: http://ianfoster.typepad.com
>>>>>>> Computation Institute: www.ci.uchicago.edu & www.ci.anl.gov
>>>>>>> Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439
>>>>>>> Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637
>>>>>>> Tel: +1 630 252 4619 --- Globus Alliance: www.globus.org
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>
>




More information about the metrics-dev mailing list