[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

2016-09-07 Thread Xeto (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470692#comment-15470692
 ] 

Xeto commented on SPARK-17379:
--

Hi
I'm getting a huge "io.netty.buffer.PoolChunk" leak in Spark streaming from 
multiple Kinesis shards: SPARK-17380
Do you think a Netty version upgrade can fix that?



> Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)
> --
>
> Key: SPARK-17379
> URL: https://issues.apache.org/jira/browse/SPARK-17379
> Project: Spark
>  Issue Type: Improvement
>  Components: Build
>Affects Versions: 1.6.2, 2.0.0
>Reporter: Adam Roberts
>Assignee: Adam Roberts
>Priority: Trivial
>
> We should use the newest version of netty based on info here: 
> http://netty.io/news/2016/08/29/4-0-41-Final-4-1-5-Final.html, especially 
> interested in the static initialiser deadlock fix: 
> https://github.com/netty/netty/pull/5730
> Lots more fixes mentioned so will create the pull request - again a case of 
> updating the pom and then the dependency files



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

2016-09-05 Thread Apache Spark (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464976#comment-15464976
 ] 

Apache Spark commented on SPARK-17379:
--

User 'a-roberts' has created a pull request for this issue:
https://github.com/apache/spark/pull/14961

> Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)
> --
>
> Key: SPARK-17379
> URL: https://issues.apache.org/jira/browse/SPARK-17379
> Project: Spark
>  Issue Type: Improvement
>  Components: Build
>Affects Versions: 1.6.2, 2.0.0
>Reporter: Adam Roberts
>Priority: Trivial
>
> We should use the newest version of netty based on info here: 
> http://netty.io/news/2016/08/29/4-0-41-Final-4-1-5-Final.html, especially 
> interested in the static initialiser deadlock fix: 
> https://github.com/netty/netty/pull/5730
> Lots more fixes mentioned so will create the pull request - again a case of 
> updating the pom and then the dependency files



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

2016-09-05 Thread Adam Roberts (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464925#comment-15464925
 ] 

Adam Roberts commented on SPARK-17379:
--

Thanks Artur, useful to know, no new tests fail with branch-1.6 and the above 
change either.

> Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)
> --
>
> Key: SPARK-17379
> URL: https://issues.apache.org/jira/browse/SPARK-17379
> Project: Spark
>  Issue Type: Improvement
>  Components: Build
>Affects Versions: 1.6.2, 2.0.0
>Reporter: Adam Roberts
>Priority: Trivial
>
> We should use the newest version of netty based on info here: 
> http://netty.io/news/2016/08/29/4-0-41-Final-4-1-5-Final.html, especially 
> interested in the static initialiser deadlock fix: 
> https://github.com/netty/netty/pull/5730
> Lots more fixes mentioned so will create the pull request - again a case of 
> updating the pom and then the dependency files



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

2016-09-05 Thread Artur Sukhenko (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464604#comment-15464604
 ] 

Artur Sukhenko commented on SPARK-17379:


Tried to use spark with 4.1.5, after fixing deprecated and implementing new 
methods some tests failed. So agree with you to just upgrade to 4.0.41.

> Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)
> --
>
> Key: SPARK-17379
> URL: https://issues.apache.org/jira/browse/SPARK-17379
> Project: Spark
>  Issue Type: Improvement
>Affects Versions: 2.0.0
>Reporter: Adam Roberts
>Priority: Trivial
>
> We should use the newest version of netty based on info here: 
> http://netty.io/news/2016/08/29/4-0-41-Final-4-1-5-Final.html, especially 
> interested in the static initialiser deadlock fix: 
> https://github.com/netty/netty/pull/5730
> Lots more fixes mentioned so will create the pull request - again a case of 
> updating the pom and then the dependency files



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

2016-09-05 Thread Adam Roberts (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464539#comment-15464539
 ] 

Adam Roberts commented on SPARK-17379:
--

Title modified to at least mention 4.1.5, no new test failures building on 
master so repeating the tests and change against the latest 1.6 code before 
creating my pull request. Trivial inline with the Snappy java upgrade (ongoing 
PR that's very similar).

> Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)
> --
>
> Key: SPARK-17379
> URL: https://issues.apache.org/jira/browse/SPARK-17379
> Project: Spark
>  Issue Type: Improvement
>Affects Versions: 2.0.0
>Reporter: Adam Roberts
>Priority: Trivial
>
> We should use the newest version of netty based on info here: 
> http://netty.io/news/2016/08/29/4-0-41-Final-4-1-5-Final.html, especially 
> interested in the static initialiser deadlock fix: 
> https://github.com/netty/netty/pull/5730
> Lots more fixes mentioned so will create the pull request - again a case of 
> updating the pom and then the dependency files



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org