[jira] [Created] (SPARK-25093) CodeFormatter could avoid creating regex object again and again

2018-08-11 Thread Izek Greenfield (JIRA)
Izek Greenfield created SPARK-25093: --- Summary: CodeFormatter could avoid creating regex object again and again Key: SPARK-25093 URL: https://issues.apache.org/jira/browse/SPARK-25093 Project: Spark

[jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

2018-08-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25081: Fix Version/s: 2.2.3 > Nested spill in ShuffleExternalSorter may access a released memory page >

[jira] [Resolved] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules

2018-08-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25092. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.4.0 > Add RewriteExceptAll and

[jira] [Commented] (SPARK-24420) Upgrade ASM to 6.x to support JDK9+

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577409#comment-16577409 ] Apache Spark commented on SPARK-24420: -- User 'gatorsmile' has created a pull reques

[jira] [Commented] (SPARK-25051) where clause on dataset gives AnalysisException

2018-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577401#comment-16577401 ] Yuming Wang commented on SPARK-25051: - Can you it with Spark [2.3.2-rc4  |https://di

[jira] [Commented] (SPARK-25071) BuildSide is coming not as expected with join queries

2018-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577385#comment-16577385 ] Yuming Wang commented on SPARK-25071: - I think it's correct. CBO based on RowCount.

[jira] [Resolved] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-08-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24152. -- Resolution: Fixed > SparkR CRAN feasibility check server problem > ---

[jira] [Commented] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110)

2018-08-11 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577379#comment-16577379 ] Liang-Chi Hsieh commented on SPARK-25080: - Did a quick test but can't reproduce

[jira] [Commented] (SPARK-23654) Cut jets3t as a dependency of spark-core

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577334#comment-16577334 ] Apache Spark commented on SPARK-23654: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-23654) Cut jets3t as a dependency of spark-core

2018-08-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23654: - Assignee: Steve Loughran > Cut jets3t as a dependency of spark-core > -

[jira] [Comment Edited] (SPARK-24152) SparkR CRAN feasibility check server problem

2018-08-11 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577065#comment-16577065 ] Liang-Chi Hsieh edited comment on SPARK-24152 at 8/11/18 9:23 PM:

[jira] [Updated] (SPARK-25091) Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory

2018-08-11 Thread Yunling Cai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunling Cai updated SPARK-25091: Description: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory. Through Spark UI, a

[jira] [Updated] (SPARK-25091) Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory

2018-08-11 Thread Yunling Cai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunling Cai updated SPARK-25091: Description: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory. Through Spark UI, a

[jira] [Assigned] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25092: Assignee: (was: Apache Spark) > Add RewriteExceptAll and RewriteIntersectAll in the l

[jira] [Assigned] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25092: Assignee: Apache Spark > Add RewriteExceptAll and RewriteIntersectAll in the list of nonE

[jira] [Commented] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577281#comment-16577281 ] Apache Spark commented on SPARK-25092: -- User 'dilipbiswal' has created a pull reque

[jira] [Created] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules

2018-08-11 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-25092: Summary: Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules Key: SPARK-25092 URL: https://issues.apache.org/jira/browse/SPARK-25092 Projec

[jira] [Created] (SPARK-25091) Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory

2018-08-11 Thread Yunling Cai (JIRA)
Yunling Cai created SPARK-25091: --- Summary: Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory Key: SPARK-25091 URL: https://issues.apache.org/jira/browse/SPARK-25091 Pr

[jira] [Commented] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577229#comment-16577229 ] Apache Spark commented on SPARK-23207: -- User 'bersprockets' has created a pull requ

[jira] [Commented] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

2018-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577221#comment-16577221 ] Yuming Wang commented on SPARK-25085: - [~lirui] A another issue you may be interest:

[jira] [Assigned] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25085: Assignee: (was: Apache Spark) > Insert overwrite a non-partitioned table can delete t

[jira] [Issue Comment Deleted] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

2018-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25085: Comment: was deleted (was: I'm working on this.) > Insert overwrite a non-partitioned table can d

[jira] [Assigned] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25085: Assignee: Apache Spark > Insert overwrite a non-partitioned table can delete table folder

[jira] [Commented] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577219#comment-16577219 ] Apache Spark commented on SPARK-25085: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577211#comment-16577211 ] Apache Spark commented on SPARK-25084: -- User 'LantaoJin' has created a pull request

[jira] [Assigned] (SPARK-24822) Python support for barrier execution mode

2018-08-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24822: --- Assignee: Jiang Xingbo > Python support for barrier execution mode > --

[jira] [Resolved] (SPARK-24822) Python support for barrier execution mode

2018-08-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24822. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22011 [https://gith

[jira] [Assigned] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25084: --- Assignee: yucai > "distribute by" on multiple columns may lead to codegen issue > -

[jira] [Resolved] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

2018-08-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25084. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22066 [https://gith

[jira] [Assigned] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25090: Assignee: (was: Apache Spark) > java.lang.ClassCastException when using a CrossValida

[jira] [Commented] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577121#comment-16577121 ] Apache Spark commented on SPARK-25090: -- User 'mgaido91' has created a pull request

[jira] [Assigned] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

2018-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25090: Assignee: Apache Spark > java.lang.ClassCastException when using a CrossValidator > -