Issue Type: Bug Bug
Assignee: abayer
Components: infrastructure
Created: 03/Feb/14 6:27 PM
Description:

The generation of the jenkins infra-statistics [0] takes ages (more then 10 hours and increasing [1]).

The raw files [3] used, contain a lot more data then actually used. The raw data files contain multiple metrics per month per instance. During generation of the stats we actually only use the last/newest entry of each instance [2].

We might be able to speed up the whole process when reducing the data contained within the raw file (only one per instance per month).

Instead of replacing the current files, we could also introduce a second set of files with a different filename pattern (should contain year/month too).

[0] http://stats.jenkins-ci.org/jenkins-stats/
[1] https://ci.jenkins-ci.org/job/infra_statistics/buildTimeTrend
[2] https://github.com/jenkinsci/infra-statistics
[3] http://jenkins-ci.org/census/

Project: Jenkins
Priority: Major Major
Reporter: Dominik Bartholdi
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira

--
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Reply via email to