It is not required for https://s.apache.org/beam-community-metrics .
I believe that's main dash we have atm. @Alan Myrvold <amyrv...@google.com> Can you confirm? --Mikhail Have feedback <http://go/migryz-feedback>? On Thu, Jan 3, 2019 at 1:59 PM Udi Meiri <eh...@google.com> wrote: > > > On Thu, Dec 27, 2018 at 11:02 AM Ismaël Mejía <ieme...@gmail.com> wrote: > >> Bringing this subject for awareness to dev@ >> We are sadly part of this top. >> Does somebody know what this data is? And if we can clean it periodically? >> Can somebody with more sysadmin super powers take a look and act on this. >> >> ---------- Forwarded message --------- >> From: Chris Lambertus <c...@apache.org> >> Date: Thu, Dec 27, 2018 at 1:36 AM >> Subject: workspace cleanups needed on jenkins master >> To: <bui...@apache.org> >> >> >> All, >> >> The Jenkins master needs to be cleaned up. Could the following >> projects please reduce your usage significantly by 5 January. After 5 >> Jan Infra will be purging more aggressively and updating job >> configurations as needed. As a rule of thumb, we’d like to see >> projects retain no more than 1 week or 7 builds worth of historical >> data at the absolute maximum. Larger projects should retain less to >> avoid using up a disproportionate amount of space on the master. >> >> Some workspaces without any identifiable associated Project will be >> removed. >> >> >> >> 3911 GB . >> 275 GB ./incubator-netbeans-linux >> 270 GB ./pulsar-website-build >> 249 GB ./pulsar-master >> 199 GB ./Packaging >> 127 GB ./HBase >> 121 GB ./PreCommit-ZOOKEEPER-github-pr-build >> 107 GB ./Any23-trunk >> 102 GB ./incubator-netbeans-release >> 79 GB ./incubator-netbeans-linux-experiment >> 77 GB ./beam_PostCommit_Java_PVR_Flink_Batch >> > > Wow, this job has huge logs (400MB+). > https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Java_PVR_Flink_Batch/330/console > A few weeks back I suggested removing the --info flag passed to Gradle. > I haven't done that yet, but it might help reduce the size of logs. (which > I assume are all stored on master?) > > Short-term, we could reduce retention back down to 14 instead of the current > 30 > <https://github.com/apache/beam/blob/5716dba6d10f32dfa8ab807ffacc2e68f9267225/.test-infra/jenkins/CommonJobProperties.groovy#L46> > . > +Alan Myrvold <amyrv...@google.com> +Mikhail Gryzykhin <mig...@google.com> we > don't need 30 days retention any longer for test dashboards, right? > > >> 76 GB ./HBase-1.3-JDK8 >> 70 GB ./Jackrabbit-Oak-Windows >> 70 GB ./stanbol-0.12 >> 59 GB ./HBase-Find-Flaky-Tests >> 54 GB ./CouchDB >> 51 GB ./beam_PostCommit_Java_PVR_Flink_Streaming >> 48 GB ./incubator-netbeans-windows >> 47 GB ./FlexJS >> 42 GB ./HBase >> 41 GB ./pulsar-pull-request >> 37 GB ./ZooKeeper_branch35_jdk8 >> 32 GB ./HBase-Flaky-Tests >> 32 GB ./Atlas-master-NoTests >> 31 GB ./Atlas-1.0-NoTests >> 31 GB ./beam_PreCommit_Java_Commit >> 30 GB ./Zookeeper_UT_Java18 >> 29 GB ./Phoenix-4.x-HBase-1.4 >> 28 GB ./HBase-2.0-hadoop3-tests >> 27 GB ./flink-github-ci >> 27 GB ./ZooKeeper_branch35_jdk7 >> 27 GB ./oodt-trunk >> 25 GB ./opennlp >> 25 GB ./Trinidad >> 22 GB ./Phoenix-4.x-HBase-1.3 >> 21 GB ./ZooKeeper_Flaky_StressTest >> 21 GB ./Atlas-master-AllTests >> 21 GB ./beam_PostCommit_Java_ValidatesRunner_Flink >> 20 GB ./HBase-1.3-JDK7 >> 20 GB ./PreCommit-HBASE-Build >> 18 GB ./hadoop-trunk-win >> 18 GB ./HBase-1.2-JDK7 >> 18 GB ./HBASE-14070.HLC >> 18 GB ./maven-box >> 17 GB ./Atlas-1.0-AllTests >> 17 GB ./Archiva-TLP-Gitbox >> 17 GB ./Apache >> 17 GB ./Phoenix-5.x-HBase-2.0 >> 17 GB ./Phoenix-omid2 >> 16 GB ./Lucene-Solr-BadApples-NightlyTests-7.x >> 15 GB ./HBase-2.0 >> 14 GB ./flume-trunk >> 14 GB ./beam_PostCommit_Java_ValidatesRunner_Samza >> 14 GB ./HBase-Trunk_matrix >> 13 GB ./commons-csv >> 13 GB ./HBase-Flaky-Tests-old-just-master >> 13 GB ./oodt-coverage >> 12 GB ./incubator-rya-master-with-optionals >> 12 GB ./Syncope-master-deploy >> 11 GB ./PreCommit-PHOENIX-Build >> 11 GB ./Stratos-Master-Nightly-Build >> 11 GB ./Phoenix-master >> 11 GB ./Hadoop-trunk-JACC >> 10 GB ./ctakes-trunk-package >> 10 GB ./FlexJS >> 10 GB ./Atlas-1.0-IntegrationTests >> 9 GB ./incubator-rya-master >> 9 GB ./Atlas-master-IntegrationTests >> 9 GB ./beam_PostCommit_Java_ValidatesRunner_Spark >> 9 GB ./ZooKeeper_UT_Java7 >> 9 GB ./Qpid-Broker-J-7.0.x-TestMatrix >> 9 GB ./oodt-dependency-update >> 9 GB ./Apache >> 8 GB ./Struts-examples-JDK8-master >> 8 GB ./Phoenix-4.x-HBase-1.2 >> 8 GB ./flume-github-pull-request >> 8 GB ./HBase-HBASE-14614 >> 8 GB ./tika-trunk-jdk1.7 >> 8 GB ./HBase-1.2-JDK8 >> 8 GB ./HBase-1.5 >> 7 GB ./Atlas-master-UnitTests >> 7 GB ./tika-2.x-windows >> 7 GB ./incubator-rya-master-with-optionals-pull-requests >> 7 GB ./Hive-trunk >> 7 GB ./beam_PreCommit_Java_Cron >> 7 GB ./Atlas-1.0-UnitTests >> 6 GB ./Jackrabbit >> 6 GB ./beam_PostCommit_Java_PVR_Flink_PR >> 6 GB ./Lucene-Solr-Clover-master >> 6 GB ./Syncope-2_0_X-deploy >> 6 GB ./beam_PostCommit_Java_ValidatesRunner_Apex >> 6 GB ./Tika-trunk >> 6 GB ./pirk >> 6 GB ./Syncope-2_1_X-deploy >> 6 GB ./PLC4X >> 6 GB ./myfaces-current-2.0-integration-tests >> 5 GB ./commons-lang >> 5 GB ./Nemo >> 5 GB ./Mesos-Buildbot >> 5 GB ./Qpid-Broker-J-7.1.x-TestMatrix >> 5 GB ./beam_PostCommit_Java_Nexmark_Flink >> 5 GB ./Qpid-Broker-J-TestMatrix >> 5 GB ./ZooKeeper-Hammer >> 5 GB ./Camel >> 5 GB ./Royale >> 5 GB ./tika-branch-1x >> 5 GB ./ManifoldCF-ant >> 5 GB ./PreCommit-SQOOP-Build >> 5 GB ./HBase-1.4 >> 5 GB ./ZooKeeper_UT_Stress >> 4 GB ./beam_PreCommit_Java_Phrase >> 4 GB ./dir-studio >> 4 GB ./Camel.trunk.notest >> 4 GB ./pulsar-release-binaries >> 4 GB ./Qpid-Java-Java-6.1.x-TestMatrix >> 4 GB ./Oak-Win >> 4 GB ./Mesos-Websitebot >> 4 GB ./incubator-rya-fork >> 4 GB ./Knox-master-verify >> 4 GB ./Syncope-Release-Docker >> 4 GB ./Lucene-Solr-Clover-7.x >> 4 GB ./openmeetings >> 4 GB ./Mesos >> 4 GB ./apache-atlas-nightly >> 4 GB ./Pig-trunk >> 4 GB ./beam_PostCommit_Java_ValidatesRunner_Dataflow >> 4 GB ./Camel.2.20.x.notest >> 3 GB ./PreCommit-HDFS-Build >> 3 GB ./airavata-master >> 3 GB ./Stratos-41x-Nightly-Build >> 3 GB ./oodt-2.0-development >> 3 GB ./hadoop-qbt-branch2-java7-linux-x86-jhung >> 3 GB ./incubator-rya-fork-with-optionals >> 3 GB ./CXF-trunk-deploy >> 3 GB ./Camel.trunk.notest.java9 >> 3 GB ./Lens-Commit >> 3 GB ./commons-imaging >> 3 GB ./Giraph-trunk-site >> 3 GB ./Zookeeper-trunk-single-thread >> 3 GB ./brooklyn-dist-master >> 3 GB ./ZooKeeper-trunk >> 3 GB ./Mesos-Buildbot-Test >> 3 GB ./cloudstack-pr-analysis >> 3 GB ./Knox-master-daily >> 2 GB ./incubator-netbeans-javadoc >> 2 GB ./ZooKeeper-trunk-java10 >> 2 GB ./beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow >> 2 GB ./mailbox >> 2 GB ./ODFToolkit >> 2 GB ./beam_PostCommit_Java_ValidatesRunner_Gearpump >> 2 GB ./Curator >> 2 GB ./beam_PreCommit_JavaPortabilityApi_Commit >> 2 GB ./ODFToolkit-windows >> 2 GB ./Log4jCore >> 2 GB ./Apache-Falcon-Distributed-Assembly >> 2 GB ./ZooKeeper-trunk-openjdk10 >> 2 GB ./Stratos-Master-Commit-Build >> 2 GB ./mahout-nightly >> 2 GB ./Stratos-41x-Commit-Build >> 2 GB ./tika-2.x >> 2 GB ./james-server-trunk >> 2 GB ./ZooKeeper-trunk-java9 >> 2 GB ./OpenMeetings >> 2 GB ./Solr-Artifacts-master >> 2 GB ./isis >> 2 GB ./Solr-Artifacts-7.x >> 2 GB ./Lucene-Solr-Tests-5.5 >> 2 GB ./Solr-Artifacts-7.6 >> 2 GB ./ZooKeeper-trunk-clover >> 2 GB ./airavata-dev >> 2 GB ./HBASE-16264 >> 2 GB ./ZooKeeper-trunk-java11 >> 2 GB ./Camel.2.19.x.notest >> 2 GB ./drill-scm >> 2 GB ./HBase-Trunk-IT >> 2 GB ./sling-site >> 2 GB ./HBase-0.98-matrix >> 2 GB ./Chemistry >> >
