RE: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-19 Thread Uwe Schindler
Muir Sent: Sunday, January 19, 2020 11:47 PM To: dev@lucene.apache.org Subject: Re: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID agreed. for all situations it may not help. but for my test 0 bytes were left at the end. i watched the io

Re: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-19 Thread Robert Muir
agreed. for all situations it may not help. but for my test 0 bytes were left at the end. i watched the io and usage as tests ran and the usage only even peaks at megabytes. just death by a thousand stabs... literally. gazillions of tests writing only a few MB each. i think we can all agree

Re: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-19 Thread Uwe Schindler
...and safe your SSD from death. Some statistics: in 12 hours the macOS slave wrote 114 Gigabytes to it's virtual harddisk - according to Darwin's top implementation, which displays disk IO since bootup of kernel. Uwe Am January 19, 2020 8:35:55 PM UTC schrieb Dawid Weiss : >> Maybe we should

Re: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-19 Thread Dawid Weiss
> Maybe we should open an issue. For example it would be good to fix the > gradle build here too. > It's definitely possible to relocate those folders (gradle-wise). I don't think it buys anything for Windows users or for those who have /tmp mounted on a physical drive but if you know what you're

Re: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-19 Thread Robert Muir
On Thu, Jan 16, 2020 at 2:38 AM Uwe Schindler wrote: > So Lucene and Solr tests are eating your SSD, be aware of that!!!  > > By default all the tests are writing indexes to build/ directory where your source checkout is, I think this is a bad default? As a workaround I can manually pass

RE: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-17 Thread Uwe Schindler
ailto:dev@lucene.apache.org> Subject: RE: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID Actually the Solaris builds are sometimes hanging forever (more often with new hardware). So they don’t pollute mailinglist they just block executor.

RE: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-17 Thread Uwe Schindler
https://www.thetaphi.de eMail: u...@thetaphi.de From: Uwe Schindler Sent: Thursday, January 16, 2020 9:30 AM To: dev@lucene.apache.org Subject: RE: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID Actually the Solaris builds are sometimes hanging f

Re: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-17 Thread Dawid Weiss
>> It is printed with gradle builds (any non-defaults are). The option is >> "tests.multiplier" actually; check if you don't have a typo there? I think something like this could be added with relative ease. I don't know how much useful it is though. :) D.

Re: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-17 Thread Michael McCandless
On Thu, Jan 16, 2020 at 3:25 AM Dawid Weiss wrote: > > >> With new CPU, builds seem up to 2 times faster. FYI, the Linux builds are >> running with tests.multiplicator=3 to better trigger JVM failures. You have >> to remind about that when you reproduce failures - it looks like this is >> not

RE: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-16 Thread Uwe Schindler
he.org Subject: RE: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID $ cat lucene.build.properties tests.jvms=6 tests.multiplier=3 - UWE SCHINDLER Software Architecture, Apache Lucene, Elasticsearch PANGAEA - Data Publisher for

RE: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-16 Thread Uwe Schindler
phi.de eMail: u...@thetaphi.de From: Dawid Weiss Sent: Thursday, January 16, 2020 9:24 AM To: Lucene Dev Subject: Re: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID With new CPU, builds seem up to 2 times faster. FYI, the Linux

RE: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-16 Thread Uwe Schindler
emen Tel.: +49 421 218 65595 Fax: +49 421 218 65505 <https://www.pangaea.de/> https://www.pangaea.de/ E-mail: uschind...@pangaea.de From: Dawid Weiss Sent: Thursday, January 16, 2020 9:24 AM To: Lucene Dev Subject: Re: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4

Re: New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-16 Thread Dawid Weiss
> With new CPU, builds seem up to 2 times faster. FYI, the Linux builds are > running with tests.multiplicator=3 to better trigger JVM failures. You have > to remind about that when you reproduce failures - it looks like this is > not printed in reproduce lines. > It is printed with gradle builds

New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

2020-01-15 Thread Uwe Schindler
Hi, Since Monday afternoon, Policeman Jenkins was replaced by newer hardware (AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID), located again at Hetzner. The reason for the change was the old Intel Xeon E3-1275 v5 Quad-Core Skylake and the NVMe SSDs which were reaching the