[jira] [Updated] (SOLR-7319) Workaround the "Four Month Bug" causing GC pause problems

2015-03-31 Thread Shawn Heisey (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shawn Heisey updated SOLR-7319:
---
Fix Version/s: (was: 5.1)

> Workaround the "Four Month Bug" causing GC pause problems
> -
>
> Key: SOLR-7319
> URL: https://issues.apache.org/jira/browse/SOLR-7319
> Project: Solr
>  Issue Type: Bug
>  Components: scripts and tools
>Affects Versions: 5.0
>Reporter: Shawn Heisey
>Assignee: Shawn Heisey
> Attachments: SOLR-7319.patch, SOLR-7319.patch, SOLR-7319.patch
>
>
> A twitter engineer found a bug in the JVM that contributes to GC pause 
> problems:
> http://www.evanjones.ca/jvm-mmap-pause.html
> Problem summary (in case the blog post disappears):  The JVM calculates 
> statistics on things like garbage collection and writes them to a file in the 
> temp directory using MMAP.  If there is a lot of other MMAP write activity, 
> which is precisely how Lucene accomplishes indexing and merging, it can 
> result in a GC pause because the mmap write to the temp file is delayed.
> We should implement the workaround in the solr start scripts (disable 
> creation of the mmap statistics tempfile) and document the impact in 
> CHANGES.txt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [jira] [Updated] (SOLR-7319) Workaround the "Four Month Bug" causing GC pause problems

2015-03-27 Thread Erick Erickson
Talk about arcane! Good find!

On Fri, Mar 27, 2015 at 9:48 AM, Shawn Heisey (JIRA)  wrote:
>
>  [ 
> https://issues.apache.org/jira/browse/SOLR-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
>  ]
>
> Shawn Heisey updated SOLR-7319:
> ---
> Attachment: SOLR-7319.patch
>
> New patch, this time against trunk, resolving a merge conflict on CHANGES.txt 
> with another commit.
>
>> Workaround the "Four Month Bug" causing GC pause problems
>> -
>>
>> Key: SOLR-7319
>> URL: https://issues.apache.org/jira/browse/SOLR-7319
>> Project: Solr
>>  Issue Type: Bug
>>  Components: scripts and tools
>>Affects Versions: 5.0
>>Reporter: Shawn Heisey
>>Assignee: Shawn Heisey
>> Fix For: 5.1
>>
>> Attachments: SOLR-7319.patch, SOLR-7319.patch, SOLR-7319.patch
>>
>>
>> A twitter engineer found a bug in the JVM that contributes to GC pause 
>> problems:
>> http://www.evanjones.ca/jvm-mmap-pause.html
>> Problem summary (in case the blog post disappears):  The JVM calculates 
>> statistics on things like garbage collection and writes them to a file in 
>> the temp directory using MMAP.  If there is a lot of other MMAP write 
>> activity, which is precisely how Lucene accomplishes indexing and merging, 
>> it can result in a GC pause because the mmap write to the temp file is 
>> delayed.
>> We should implement the workaround in the solr start scripts (disable 
>> creation of the mmap statistics tempfile) and document the impact in 
>> CHANGES.txt.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7319) Workaround the "Four Month Bug" causing GC pause problems

2015-03-27 Thread Shawn Heisey (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shawn Heisey updated SOLR-7319:
---
Attachment: SOLR-7319.patch

New patch, this time against trunk, resolving a merge conflict on CHANGES.txt 
with another commit.

> Workaround the "Four Month Bug" causing GC pause problems
> -
>
> Key: SOLR-7319
> URL: https://issues.apache.org/jira/browse/SOLR-7319
> Project: Solr
>  Issue Type: Bug
>  Components: scripts and tools
>Affects Versions: 5.0
>Reporter: Shawn Heisey
>Assignee: Shawn Heisey
> Fix For: 5.1
>
> Attachments: SOLR-7319.patch, SOLR-7319.patch, SOLR-7319.patch
>
>
> A twitter engineer found a bug in the JVM that contributes to GC pause 
> problems:
> http://www.evanjones.ca/jvm-mmap-pause.html
> Problem summary (in case the blog post disappears):  The JVM calculates 
> statistics on things like garbage collection and writes them to a file in the 
> temp directory using MMAP.  If there is a lot of other MMAP write activity, 
> which is precisely how Lucene accomplishes indexing and merging, it can 
> result in a GC pause because the mmap write to the temp file is delayed.
> We should implement the workaround in the solr start scripts (disable 
> creation of the mmap statistics tempfile) and document the impact in 
> CHANGES.txt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7319) Workaround the "Four Month Bug" causing GC pause problems

2015-03-27 Thread Shawn Heisey (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shawn Heisey updated SOLR-7319:
---
Attachment: SOLR-7319.patch

Found a typo in the patch.  Fixed.

> Workaround the "Four Month Bug" causing GC pause problems
> -
>
> Key: SOLR-7319
> URL: https://issues.apache.org/jira/browse/SOLR-7319
> Project: Solr
>  Issue Type: Bug
>  Components: scripts and tools
>Affects Versions: 5.0
>Reporter: Shawn Heisey
>Assignee: Shawn Heisey
> Fix For: 5.1
>
> Attachments: SOLR-7319.patch, SOLR-7319.patch
>
>
> A twitter engineer found a bug in the JVM that contributes to GC pause 
> problems:
> http://www.evanjones.ca/jvm-mmap-pause.html
> Problem summary (in case the blog post disappears):  The JVM calculates 
> statistics on things like garbage collection and writes them to a file in the 
> temp directory using MMAP.  If there is a lot of other MMAP write activity, 
> which is precisely how Lucene accomplishes indexing and merging, it can 
> result in a GC pause because the mmap write to the temp file is delayed.
> We should implement the workaround in the solr start scripts (disable 
> creation of the mmap statistics tempfile) and document the impact in 
> CHANGES.txt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7319) Workaround the "Four Month Bug" causing GC pause problems

2015-03-27 Thread Shawn Heisey (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shawn Heisey updated SOLR-7319:
---
Description: 
A twitter engineer found a bug in the JVM that contributes to GC pause problems:

http://www.evanjones.ca/jvm-mmap-pause.html

Problem summary (in case the blog post disappears):  The JVM calculates 
statistics on things like garbage collection and writes them to a file in the 
temp directory using MMAP.  If there is a lot of other MMAP write activity, 
which is precisely how Lucene accomplishes indexing and merging, it can result 
in a GC pause because the mmap write to the temp file is delayed.

We should implement the workaround in the solr start scripts (disable creation 
of the mmap statistics tempfile) and document the impact in CHANGES.txt.


  was:
A twitter engineer found a bug in the JVM that contributes to GC pause problems:

http://www.evanjones.ca/jvm-mmap-pause.html

We should implement the workaround and document the impact in CHANGES.txt.



> Workaround the "Four Month Bug" causing GC pause problems
> -
>
> Key: SOLR-7319
> URL: https://issues.apache.org/jira/browse/SOLR-7319
> Project: Solr
>  Issue Type: Bug
>  Components: scripts and tools
>Affects Versions: 5.0
>Reporter: Shawn Heisey
>Assignee: Shawn Heisey
> Fix For: 5.1
>
> Attachments: SOLR-7319.patch
>
>
> A twitter engineer found a bug in the JVM that contributes to GC pause 
> problems:
> http://www.evanjones.ca/jvm-mmap-pause.html
> Problem summary (in case the blog post disappears):  The JVM calculates 
> statistics on things like garbage collection and writes them to a file in the 
> temp directory using MMAP.  If there is a lot of other MMAP write activity, 
> which is precisely how Lucene accomplishes indexing and merging, it can 
> result in a GC pause because the mmap write to the temp file is delayed.
> We should implement the workaround in the solr start scripts (disable 
> creation of the mmap statistics tempfile) and document the impact in 
> CHANGES.txt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7319) Workaround the "Four Month Bug" causing GC pause problems

2015-03-27 Thread Shawn Heisey (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shawn Heisey updated SOLR-7319:
---
Attachment: SOLR-7319.patch

Patch implementing the workaround, and documenting the fact that tools like 
jstat will no longer function.

> Workaround the "Four Month Bug" causing GC pause problems
> -
>
> Key: SOLR-7319
> URL: https://issues.apache.org/jira/browse/SOLR-7319
> Project: Solr
>  Issue Type: Bug
>  Components: scripts and tools
>Affects Versions: 5.0
>Reporter: Shawn Heisey
>Assignee: Shawn Heisey
> Fix For: 5.1
>
> Attachments: SOLR-7319.patch
>
>
> A twitter engineer found a bug in the JVM that contributes to GC pause 
> problems:
> http://www.evanjones.ca/jvm-mmap-pause.html
> We should implement the workaround and document the impact in CHANGES.txt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org