[jira] [Commented] (SPARK-25308) ArrayContains function may return a error in the code generation phase.

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599951#comment-16599951 ] Apache Spark commented on SPARK-25308: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25308) ArrayContains function may return a error in the code generation phase.

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25308: Assignee: Apache Spark > ArrayContains function may return a error in the code generation

[jira] [Assigned] (SPARK-25308) ArrayContains function may return a error in the code generation phase.

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25308: Assignee: (was: Apache Spark) > ArrayContains function may return a error in the code

[jira] [Created] (SPARK-25308) ArrayContains function may return a error in the code generation phase.

2018-09-01 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-25308: Summary: ArrayContains function may return a error in the code generation phase. Key: SPARK-25308 URL: https://issues.apache.org/jira/browse/SPARK-25308 Project: Spar

[jira] [Commented] (SPARK-25307) ArraySort function may return a error in the code generation phase.

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599933#comment-16599933 ] Apache Spark commented on SPARK-25307: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25307) ArraySort function may return a error in the code generation phase.

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25307: Assignee: (was: Apache Spark) > ArraySort function may return a error in the code gen

[jira] [Assigned] (SPARK-25307) ArraySort function may return a error in the code generation phase.

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25307: Assignee: Apache Spark > ArraySort function may return a error in the code generation pha

[jira] [Created] (SPARK-25307) ArraySort function may return a error in the code generation phase.

2018-09-01 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-25307: Summary: ArraySort function may return a error in the code generation phase. Key: SPARK-25307 URL: https://issues.apache.org/jira/browse/SPARK-25307 Project: Spark

[jira] [Resolved] (SPARK-10697) Lift Calculation in Association Rule mining

2018-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10697. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22236 [https://github.c

[jira] [Assigned] (SPARK-10697) Lift Calculation in Association Rule mining

2018-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-10697: - Assignee: Marco Gaido > Lift Calculation in Association Rule mining > -

[jira] [Updated] (SPARK-25306) Use cache to speed up `createFilter` in ORC

2018-09-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25306: -- Affects Version/s: 1.6.3 > Use cache to speed up `createFilter` in ORC > -

[jira] [Updated] (SPARK-25306) Use cache to speed up `createFilter` in ORC

2018-09-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25306: -- Affects Version/s: 2.0.2 > Use cache to speed up `createFilter` in ORC > -

[jira] [Updated] (SPARK-25306) Use cache to speed up `createFilter` in ORC

2018-09-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25306: -- Description: In ORC data source, `createFilter` function has exponential time complexity due

[jira] [Updated] (SPARK-25306) Use cache to speed up `createFilter` in ORC

2018-09-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25306: -- Affects Version/s: (was: SQL) 2.4.0 2.1.3

[jira] [Commented] (SPARK-25306) Use cache to speed up `createFilter` in ORC

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599822#comment-16599822 ] Apache Spark commented on SPARK-25306: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-25306) Use cache to speed up `createFilter` in ORC

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25306: Assignee: Apache Spark > Use cache to speed up `createFilter` in ORC > --

[jira] [Assigned] (SPARK-25306) Use cache to speed up `createFilter` in ORC

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25306: Assignee: (was: Apache Spark) > Use cache to speed up `createFilter` in ORC > ---

[jira] [Created] (SPARK-25306) Use cache to speed up `createFilter` in ORC

2018-09-01 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-25306: - Summary: Use cache to speed up `createFilter` in ORC Key: SPARK-25306 URL: https://issues.apache.org/jira/browse/SPARK-25306 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:38 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:37 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:36 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:36 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:35 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:28 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:27 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:26 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:25 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:25 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:24 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:23 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:21 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:17 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:14 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:13 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:12 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:11 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:10 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:10 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:09 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos edited comment on SPARK-24434 at 9/1/18 8:08 PM: -

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599728#comment-16599728 ] Stavros Kontopoulos commented on SPARK-24434: - Spark belongs to the communit

[jira] [Commented] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599717#comment-16599717 ] Apache Spark commented on SPARK-17916: -- User 'koertkuipers' has created a pull requ

[jira] [Commented] (SPARK-23253) Only write shuffle temporary index file when there is not an existing one

2018-09-01 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599714#comment-16599714 ] Imran Rashid commented on SPARK-23253: -- I think I see the issue you are referring t

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-09-01 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599697#comment-16599697 ] Matt Cheah commented on SPARK-24434: Everyone, thank you for your contribution to th

[jira] [Updated] (SPARK-25305) Respect attribute name in `CollapseProject` and `ColumnPruning`

2018-09-01 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-25305: --- Summary: Respect attribute name in `CollapseProject` and `ColumnPruning` (was: Respect attr

[jira] [Updated] (SPARK-25305) Respect attribute name in `CollapseProject`

2018-09-01 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-25305: --- Description: Currently in optimizer rule `CollapseProject`, the lower level project is coll

[jira] [Commented] (SPARK-25305) Respect attribute name in `CollapseProject`

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599665#comment-16599665 ] Apache Spark commented on SPARK-25305: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25305) Respect attribute name in `CollapseProject`

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25305: Assignee: Apache Spark > Respect attribute name in `CollapseProject` > --

[jira] [Assigned] (SPARK-25305) Respect attribute name in `CollapseProject`

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25305: Assignee: (was: Apache Spark) > Respect attribute name in `CollapseProject` > ---

[jira] [Created] (SPARK-25305) Respect attribute name in `CollapseProject`

2018-09-01 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-25305: -- Summary: Respect attribute name in `CollapseProject` Key: SPARK-25305 URL: https://issues.apache.org/jira/browse/SPARK-25305 Project: Spark Issue Type: B

[jira] [Assigned] (SPARK-25298) spark-tools build failure for Scala 2.12

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25298: Assignee: Apache Spark > spark-tools build failure for Scala 2.12 > -

[jira] [Commented] (SPARK-25298) spark-tools build failure for Scala 2.12

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599660#comment-16599660 ] Apache Spark commented on SPARK-25298: -- User 'sadhen' has created a pull request fo

[jira] [Assigned] (SPARK-25298) spark-tools build failure for Scala 2.12

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25298: Assignee: (was: Apache Spark) > spark-tools build failure for Scala 2.12 > --

[jira] [Commented] (SPARK-20384) supporting value classes over primitives in DataSets

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599659#comment-16599659 ] Apache Spark commented on SPARK-20384: -- User 'mt40' has created a pull request for

[jira] [Assigned] (SPARK-20384) supporting value classes over primitives in DataSets

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20384: Assignee: Apache Spark > supporting value classes over primitives in DataSets > -

[jira] [Assigned] (SPARK-20384) supporting value classes over primitives in DataSets

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20384: Assignee: (was: Apache Spark) > supporting value classes over primitives in DataSets

[jira] [Commented] (SPARK-25298) spark-tools build failure for Scala 2.12

2018-09-01 Thread Darcy Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599651#comment-16599651 ] Darcy Shen commented on SPARK-25298: sbt -Dscala-2.12 -Dscala.version=2.12.6   Thi

[jira] [Assigned] (SPARK-25304) enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25304: Assignee: Apache Spark > enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12 > ---

[jira] [Commented] (SPARK-25304) enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599640#comment-16599640 ] Apache Spark commented on SPARK-25304: -- User 'sadhen' has created a pull request fo

[jira] [Assigned] (SPARK-25304) enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25304: Assignee: (was: Apache Spark) > enable HiveSparkSubmitSuite SPARK-8489 test for Scala

[jira] [Commented] (SPARK-8489) Add regression tests for SPARK-8470

2018-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599641#comment-16599641 ] Apache Spark commented on SPARK-8489: - User 'sadhen' has created a pull request for t

[jira] [Created] (SPARK-25304) enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12

2018-09-01 Thread Darcy Shen (JIRA)
Darcy Shen created SPARK-25304: -- Summary: enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12 Key: SPARK-25304 URL: https://issues.apache.org/jira/browse/SPARK-25304 Project: Spark Issue

[jira] [Assigned] (SPARK-25289) ChiSqSelector max on empty collection

2018-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25289: - Assignee: Marco Gaido > ChiSqSelector max on empty collection > ---

[jira] [Resolved] (SPARK-25289) ChiSqSelector max on empty collection

2018-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25289. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22303 [https://github.c

[jira] [Assigned] (SPARK-24615) Accelerator-aware task scheduling for Spark

2018-09-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-24615: --- Assignee: (was: Saisai Shao) > Accelerator-aware task scheduling for Spark > --

[jira] [Commented] (SPARK-25297) Future for Scala 2.12 will block on a already shutdown ExecutionContext

2018-09-01 Thread Darcy Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599580#comment-16599580 ] Darcy Shen commented on SPARK-25297: This issue has been fixed by https://github.com

[jira] [Commented] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc

2018-09-01 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599574#comment-16599574 ] Zhichao Zhang commented on SPARK-25279: [~dkbiswal], thank you. you mean that u

[jira] [Resolved] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError

2018-09-01 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25290. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22297 [https://gith

[jira] [Assigned] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError

2018-09-01 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25290: --- Assignee: Liang-Chi Hsieh > BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOf

[jira] [Commented] (SPARK-25303) A DStream that is checkpointed should allow its parent(s) to be removed and not persisted

2018-09-01 Thread Nikunj Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599566#comment-16599566 ] Nikunj Bansal commented on SPARK-25303: --- I have a potential fix for this and SPARK

[jira] [Commented] (SPARK-25302) ReducedWindowedDStream not using checkpoints for reduced RDDs

2018-09-01 Thread Nikunj Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599565#comment-16599565 ] Nikunj Bansal commented on SPARK-25302: --- I have a potential fix for this and SPARK

[jira] [Commented] (SPARK-25302) ReducedWindowedDStream not using checkpoints for reduced RDDs

2018-09-01 Thread Nikunj Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599563#comment-16599563 ] Nikunj Bansal commented on SPARK-25302: --- See also related issue SPARK-25303 > Red

[jira] [Created] (SPARK-25303) A DStream that is checkpointed should allow its parent(s) to be removed and not persisted

2018-09-01 Thread Nikunj Bansal (JIRA)
Nikunj Bansal created SPARK-25303: - Summary: A DStream that is checkpointed should allow its parent(s) to be removed and not persisted Key: SPARK-25303 URL: https://issues.apache.org/jira/browse/SPARK-25303

[jira] [Created] (SPARK-25302) ReducedWindowedDStream not using checkpoints for reduced RDDs

2018-09-01 Thread Nikunj Bansal (JIRA)
Nikunj Bansal created SPARK-25302: - Summary: ReducedWindowedDStream not using checkpoints for reduced RDDs Key: SPARK-25302 URL: https://issues.apache.org/jira/browse/SPARK-25302 Project: Spark

[jira] [Comment Edited] (SPARK-23253) Only write shuffle temporary index file when there is not an existing one

2018-09-01 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599557#comment-16599557 ] Wenchen Fan edited comment on SPARK-23253 at 9/1/18 7:05 AM: -