New Policeman Jenkins Hardware: AMD Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID

[Uwe Schindler]

Hi,

Since Monday afternoon, Policeman Jenkins was replaced by newer hardware (AMD 
Ryzen 7 3700X Octa-Core, DDR4 ECC, 2x1 Terabyte NVME SSD as RAID), located 
again at Hetzner. The reason for the change was the old Intel Xeon E3-1275 v5 
Quad-Core Skylake and the NVMe SSDs which were reaching the end of their 
lifetime (they were already replaced by data center service a while ago after 
first smart errors). So Lucene and Solr tests are eating your SSD, be aware of 
that!!! 

One reason for the higher SSD destroy rate was also some "bug" in the original 
Ubuntu install image of the older server. The RAID was created back at that 
time with Linux and using the mdadm framework. The partitions were already 
aligned to 2048 sectors (default on many operating systems), but the RAID 
device inside the partitions were using a stupid alignment for the first data 
sector behind the RAID header. This caused that the actually used filesystem 
device was not starting at a multiple of 2048 sectors -> this causes additional 
reads and writes, because SSDs work with large blocks. On the new server (that 
was just copied over using dd of filesystem devices over network) I made the 
alignment of RAID correct. Jenkins is also using libeatmydata.so since a few 
weeks in LD_PRELOAD of all jobs, so fsync is swallowed by the libc. I'd 
recommend that to others, because data safety is not an issue (apt install 
eatmydata, in Jenkins node config add ENVIRONMENT variable through GUI that’s 
applied to all jobs: LD_PRELOAD=libeatmydata.so).

With new CPU, builds seem up to 2 times faster. FYI, the Linux builds are 
running with tests.multiplicator=3 to better trigger JVM failures. You have to 
remind about that when you reproduce failures - it looks like this is not 
printed in reproduce lines.

There were some false failures during the night Monday to Tuesday (caused by 
the usual gettimeofday() issue on MacOS), which is a bug in the MacOS kernel, 
affecting Java and all software calling nanotime/getSystemTimeMillies very 
often (causing a sigfpe on "time jumps"). Recent Darwin kernels replaced the 
assembly code by a more safe C version (the old and new code reads the time 
volatile from a special "comm" memory page that is hooked into every process, 
so a syscall is not needed). So I updated MacOS machine from El Captain to 
Mojave (no Catalina yet, as 32 bit support was dropped there). Since that time 
the gettimeofday errors seem to be fixed. The reason for it happening more 
often was possibly more CPU cores and more parallel calls to gettimeofday.

I disabled the Solaris builds for a while, they seem to hang more often (more 
parallelization). If somebody wants to look into this, I triggered a stack 
trace in the logs: It looks like the BSD networking layer causes those "hangs". 
[https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Solaris/503/console]. But we 
can also drop Solaris builds, as they only work with 8.x - no Java 11 support 
on Solaris anymore by Oracle. Any comments?

Uwe

-
Uwe Schindler
Achterdiek 19, D-28357 Bremen
https://www.thetaphi.de
eMail: u...@thetaphi.de



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Re: Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

[Gus Heck]

Congratulations :)

On Wed, Jan 15, 2020, 8:21 PM Đạt Cao Mạnh  wrote:

> Congrats Anshum!!
>
> On Thu, 16 Jan 2020 at 08:43, Michael McCandless <
> luc...@mikemccandless.com> wrote:
>
>> Congrats Anshum!  It's great fun!
>>
>> Mike
>>
>> On Wed, Jan 15, 2020 at 6:24 PM Steve Rowe  wrote:
>>
>>> Congrats Anshum!
>>>
>>> --
>>> Steve
>>>
>>>
>>> On Jan 15, 2020, at 4:15 PM, Cassandra Targett 
>>> wrote:
>>>
>>> Every year, the Lucene PMC rotates the Lucene PMC chair and Apache Vice
>>> President position.
>>>
>>> This year we have nominated and elected Anshum Gupta as the Chair, a
>>> decision that the board approved in its January 2020 meeting.
>>>
>>> Congratulations, Anshum!
>>>
>>> Cassandra
>>>
>>>
>>> --
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
> --
> *Best regards,*
> *Cao Mạnh Đạt*
> *E-mail: caomanhdat...@gmail.com *
>

Re: Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

[Đạt Cao Mạnh]

Congrats Anshum!!

On Thu, 16 Jan 2020 at 08:43, Michael McCandless 
wrote:

> Congrats Anshum!  It's great fun!
>
> Mike
>
> On Wed, Jan 15, 2020 at 6:24 PM Steve Rowe  wrote:
>
>> Congrats Anshum!
>>
>> --
>> Steve
>>
>>
>> On Jan 15, 2020, at 4:15 PM, Cassandra Targett 
>> wrote:
>>
>> Every year, the Lucene PMC rotates the Lucene PMC chair and Apache Vice
>> President position.
>>
>> This year we have nominated and elected Anshum Gupta as the Chair, a
>> decision that the board approved in its January 2020 meeting.
>>
>> Congratulations, Anshum!
>>
>> Cassandra
>>
>>
>> --
> Mike McCandless
>
> http://blog.mikemccandless.com
>
-- 
*Best regards,*
*Cao Mạnh Đạt*
*E-mail: caomanhdat...@gmail.com *

Re: Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

[Michael McCandless]

Congrats Anshum!  It's great fun!

Mike

On Wed, Jan 15, 2020 at 6:24 PM Steve Rowe  wrote:

> Congrats Anshum!
>
> --
> Steve
>
>
> On Jan 15, 2020, at 4:15 PM, Cassandra Targett 
> wrote:
>
> Every year, the Lucene PMC rotates the Lucene PMC chair and Apache Vice
> President position.
>
> This year we have nominated and elected Anshum Gupta as the Chair, a
> decision that the board approved in its January 2020 meeting.
>
> Congratulations, Anshum!
>
> Cassandra
>
>
> --
Mike McCandless

http://blog.mikemccandless.com

Re: Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

[Steve Rowe]

Congrats Anshum!

--
Steve

> On Jan 15, 2020, at 4:15 PM, Cassandra Targett  wrote:
> 
> Every year, the Lucene PMC rotates the Lucene PMC chair and Apache Vice 
> President position.
> 
> This year we have nominated and elected Anshum Gupta as the Chair, a decision 
> that the board approved in its January 2020 meeting.
> 
> Congratulations, Anshum!
> 
> Cassandra
> 

Re: Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

[Anshum Gupta]

Thank you everyone! :)

On Wed, Jan 15, 2020 at 2:54 PM Uwe Schindler  wrote:

> Moin,
>
>
>
> Congratulations from one of the previous chairs! You’ll have a hard time
> (just joking!).
>
>
>
> Uwe
>
>
>
> -
>
> Uwe Schindler
>
> Achterdiek 19, D-28357 Bremen
>
> https://www.thetaphi.de
>
> eMail: u...@thetaphi.de
>
>
>
> *From:* Tomás Fernández Löbbe 
> *Sent:* Wednesday, January 15, 2020 11:28 PM
> *To:* dev@lucene.apache.org
> *Subject:* Re: Congratulations to the new Lucene/Solr PMC Chair, Anshum
> Gupta!
>
>
>
> Congrats Anshum!!
>
>
>
> On Wed, Jan 15, 2020 at 2:25 PM David Smiley 
> wrote:
>
> Congrats Anshum!
>
>
> ~ David Smiley
>
> Apache Lucene/Solr Search Developer
>
> http://www.linkedin.com/in/davidwsmiley
>
>
>
>
>
> On Wed, Jan 15, 2020 at 4:15 PM Cassandra Targett 
> wrote:
>
> Every year, the Lucene PMC rotates the Lucene PMC chair and Apache Vice
> President position.
>
> This year we have nominated and elected Anshum Gupta as the Chair, a
> decision that the board approved in its January 2020 meeting.
>
>
>
> Congratulations, Anshum!
>
>
>
> Cassandra
>
>
>
>

-- 
Anshum Gupta

RE: Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

[Uwe Schindler]

Moin,

 

Congratulations from one of the previous chairs! You’ll have a hard time (just 
joking!).

 

Uwe

 

-

Uwe Schindler

Achterdiek 19, D-28357 Bremen

https://www.thetaphi.de

eMail: u...@thetaphi.de

 

From: Tomás Fernández Löbbe  
Sent: Wednesday, January 15, 2020 11:28 PM
To: dev@lucene.apache.org
Subject: Re: Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

 

Congrats Anshum!!

 

On Wed, Jan 15, 2020 at 2:25 PM David Smiley mailto:david.w.smi...@gmail.com> > wrote:

Congrats Anshum!




~ David Smiley

Apache Lucene/Solr Search Developer

http://www.linkedin.com/in/davidwsmiley

 

 

On Wed, Jan 15, 2020 at 4:15 PM Cassandra Targett mailto:ctarg...@apache.org> > wrote:

Every year, the Lucene PMC rotates the Lucene PMC chair and Apache Vice 
President position.

This year we have nominated and elected Anshum Gupta as the Chair, a decision 
that the board approved in its January 2020 meeting.

 

Congratulations, Anshum!

 

Cassandra

 

RE: Gradle build is on master

[Uwe Schindler]

Thanks Dawid – great work!

 

there is a small problem with Jenkins (still running ANT build; I may add a 
second one running the gradle build!): The Jenkins build does a license and JAR 
file check by first deleting all checksum files and then regenerate all of them 
from the downloaded artifacts. Afterwards it checks that the GIT checkout is 
clean. This is done to detect obsolete or incorrect checksum files.

 

With the gradle update you added the shaded jetty JAR file, but the old ANT 
build seems to still use the old/different name. It means after checksum 
regeneration the checkout is no longer clean:

 

/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:494: Source checkout 
is dirty (unversioned/missing files) after running tests!!! Offending files:

* solr/licenses/jetty-start-9.4.24.v20191120-shaded.jar.sha1

 

It does not seem to happen on 8.x branch so it look like caused by Gradle build.

 

See here:  
 
https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/25336/console

 

Uwe

 

-

Uwe Schindler

Achterdiek 19, D-28357 Bremen

https://www.thetaphi.de

eMail: u...@thetaphi.de

 

From: David Smiley  
Sent: Wednesday, January 15, 2020 11:24 PM
To: Solr/Lucene Dev 
Subject: Re: Gradle build is on master

 

This is a big milestone indeed!  Thanks Mark, Dawid, Erick, Dat, Mike, etc.




~ David Smiley

Apache Lucene/Solr Search Developer

http://www.linkedin.com/in/davidwsmiley

 

 

On Wed, Jan 15, 2020 at 2:00 PM Anshum Gupta mailto:ans...@anshumgupta.net> > wrote:

Thank you Dawid and everyone else !

 

On Wed, Jan 15, 2020 at 5:33 AM Dawid Weiss mailto:dawid.we...@gmail.com> > wrote:

Hello,

I've just merged the gradle-master branch so gradle build can be used
on master.

As previously mentioned, it isn't a complete replacement for ant but I
think we're getting darn close and common tasks are fairly well
covered.

Any issues or concerns: create an issue in jira or send an e-mail to
the mailing list, CCing me directly.

Dawid

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org 
 
For additional commands, e-mail: dev-h...@lucene.apache.org 
 




 

-- 

Anshum Gupta

Re: Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

[Tomás Fernández Löbbe]

Congrats Anshum!!

On Wed, Jan 15, 2020 at 2:25 PM David Smiley 
wrote:

> Congrats Anshum!
>
> ~ David Smiley
> Apache Lucene/Solr Search Developer
> http://www.linkedin.com/in/davidwsmiley
>
>
> On Wed, Jan 15, 2020 at 4:15 PM Cassandra Targett 
> wrote:
>
>> Every year, the Lucene PMC rotates the Lucene PMC chair and Apache Vice
>> President position.
>>
>> This year we have nominated and elected Anshum Gupta as the Chair, a
>> decision that the board approved in its January 2020 meeting.
>>
>> Congratulations, Anshum!
>>
>> Cassandra
>>
>>

Re: Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

[David Smiley]

Congrats Anshum!

~ David Smiley
Apache Lucene/Solr Search Developer
http://www.linkedin.com/in/davidwsmiley


On Wed, Jan 15, 2020 at 4:15 PM Cassandra Targett 
wrote:

> Every year, the Lucene PMC rotates the Lucene PMC chair and Apache Vice
> President position.
>
> This year we have nominated and elected Anshum Gupta as the Chair, a
> decision that the board approved in its January 2020 meeting.
>
> Congratulations, Anshum!
>
> Cassandra
>
>

Re: Gradle build is on master

[David Smiley]

This is a big milestone indeed!  Thanks Mark, Dawid, Erick, Dat, Mike, etc.

~ David Smiley
Apache Lucene/Solr Search Developer
http://www.linkedin.com/in/davidwsmiley


On Wed, Jan 15, 2020 at 2:00 PM Anshum Gupta  wrote:

> Thank you Dawid and everyone else !
>
> On Wed, Jan 15, 2020 at 5:33 AM Dawid Weiss  wrote:
>
>> Hello,
>>
>> I've just merged the gradle-master branch so gradle build can be used
>> on master.
>>
>> As previously mentioned, it isn't a complete replacement for ant but I
>> think we're getting darn close and common tasks are fairly well
>> covered.
>>
>> Any issues or concerns: create an issue in jira or send an e-mail to
>> the mailing list, CCing me directly.
>>
>> Dawid
>>
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>
>>
>
> --
> Anshum Gupta
>

Re: Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

[Jan Høydahl]

Congrats Anshum!

Jan

> 15. jan. 2020 kl. 22:15 skrev Cassandra Targett :
> 
> 
> Every year, the Lucene PMC rotates the Lucene PMC chair and Apache Vice 
> President position.
> 
> This year we have nominated and elected Anshum Gupta as the Chair, a decision 
> that the board approved in its January 2020 meeting.
> 
> Congratulations, Anshum!
> 
> Cassandra
> 

Congratulations to the new Lucene/Solr PMC Chair, Anshum Gupta!

[Cassandra Targett]

Every year, the Lucene PMC rotates the Lucene PMC chair and Apache Vice
President position.

This year we have nominated and elected Anshum Gupta as the Chair, a
decision that the board approved in its January 2020 meeting.

Congratulations, Anshum!

Cassandra

Re: Gradle build is on master

[Anshum Gupta]

Thank you Dawid and everyone else !

On Wed, Jan 15, 2020 at 5:33 AM Dawid Weiss  wrote:

> Hello,
>
> I've just merged the gradle-master branch so gradle build can be used
> on master.
>
> As previously mentioned, it isn't a complete replacement for ant but I
> think we're getting darn close and common tasks are fairly well
> covered.
>
> Any issues or concerns: create an issue in jira or send an e-mail to
> the mailing list, CCing me directly.
>
> Dawid
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>
>

-- 
Anshum Gupta

Re: Gradle build is on master

[Ishan Chattopadhyaya]

Thanks Dawid. Big milestone reached.
Thanks Mark, Erick and everyone else who helped. I'm super excited.

On Wed, 15 Jan, 2020, 7:03 PM Dawid Weiss,  wrote:

> Hello,
>
> I've just merged the gradle-master branch so gradle build can be used
> on master.
>
> As previously mentioned, it isn't a complete replacement for ant but I
> think we're getting darn close and common tasks are fairly well
> covered.
>
> Any issues or concerns: create an issue in jira or send an e-mail to
> the mailing list, CCing me directly.
>
> Dawid
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>
>

Heads up: the FSTOrd postings format is about to be removed

[Adrien Grand]

Hello all,

Short version: I'm about to remove the FSTOrd postings format.

Longer version:

I'm trying to simplify the API we have for the terms dictionary to interact
with postings. This involves removing an API that is only used by the FST
and FSTOrd postings format, as a way to store intermediate outputs on
intermediate arcs of the FST that serves as a terms dictionary.

The FST postings format is preserved but its behavior is changed since it
now only stores outputs on final arcs. However the FSTOrd postings format
is removed by this change.

More information at https://issues.apache.org/jira/browse/LUCENE-9116 and
https://github.com/apache/lucene-solr/pull/1158.

-- 
Adrien

Gradle build is on master

[Dawid Weiss]

Hello,

I've just merged the gradle-master branch so gradle build can be used
on master.

As previously mentioned, it isn't a complete replacement for ant but I
think we're getting darn close and common tasks are fairly well
covered.

Any issues or concerns: create an issue in jira or send an e-mail to
the mailing list, CCing me directly.

Dawid

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org