[jira] [Commented] (SPARK-33082) Remove hive-1.2 workaround code

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209966#comment-17209966 ] Apache Spark commented on SPARK-33082: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-33090) Upgrade Google Guava

2020-10-07 Thread Stephen Coy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209968#comment-17209968 ] Stephen Coy commented on SPARK-33090: - I can create a PR for this if you like...  

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209967#comment-17209967 ] Apache Spark commented on SPARK-20202: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209969#comment-17209969 ] Apache Spark commented on SPARK-20202: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209970#comment-17209970 ] Apache Spark commented on SPARK-20202: -- User 'HyukjinKwon' has created a pull reque

[jira] [Resolved] (SPARK-32793) Expose assert_true in Python/Scala APIs and add error message parameter

2020-10-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32793. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29947 [https://gi

[jira] [Assigned] (SPARK-32793) Expose assert_true in Python/Scala APIs and add error message parameter

2020-10-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32793: Assignee: Karen Feng > Expose assert_true in Python/Scala APIs and add error message para

[jira] [Resolved] (SPARK-33089) avro format does not propagate Hadoop config from DS options to underlying HDFS file system

2020-10-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33089. -- Fix Version/s: 3.1.0 3.0.2 Assignee: Yuning Zhang Resolution

[jira] [Commented] (SPARK-32989) Performance regression when selecting from str_to_map

2020-10-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209979#comment-17209979 ] Yang Jie commented on SPARK-32989: -- [~ondrej] You're right, It will execute n times wit

[jira] [Comment Edited] (SPARK-32989) Performance regression when selecting from str_to_map

2020-10-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209979#comment-17209979 ] Yang Jie edited comment on SPARK-32989 at 10/8/20, 3:22 AM:

[jira] [Comment Edited] (SPARK-32989) Performance regression when selecting from str_to_map

2020-10-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209979#comment-17209979 ] Yang Jie edited comment on SPARK-32989 at 10/8/20, 3:23 AM:

[jira] [Comment Edited] (SPARK-32989) Performance regression when selecting from str_to_map

2020-10-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209979#comment-17209979 ] Yang Jie edited comment on SPARK-32989 at 10/8/20, 3:24 AM:

[jira] [Commented] (SPARK-32989) Performance regression when selecting from str_to_map

2020-10-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209990#comment-17209990 ] Yang Jie commented on SPARK-32989: -- I found that if  stringToMap use codegen, the optim

[jira] [Comment Edited] (SPARK-32989) Performance regression when selecting from str_to_map

2020-10-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209990#comment-17209990 ] Yang Jie edited comment on SPARK-32989 at 10/8/20, 3:59 AM:

[jira] [Resolved] (SPARK-32282) Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-10-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32282. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29074 [https://gith

[jira] [Created] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at OrcUtils.readCatalystSchema

2020-10-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-33091: Summary: Avoid using map instead of foreach to avoid potential side effect at OrcUtils.readCatalystSchema Key: SPARK-33091 URL: https://issues.apache.org/jira/browse/SPARK-33091

[jira] [Updated] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at OrcUtils.readCatalystSchema

2020-10-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33091: - Issue Type: Improvement (was: Bug) > Avoid using map instead of foreach to avoid potential side

[jira] [Updated] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at OrcUtils.readCatalystSchema

2020-10-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33091: - Priority: Minor (was: Major) > Avoid using map instead of foreach to avoid potential side effec

[jira] [Updated] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at callers of OrcUtils.readCatalystSchema

2020-10-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33091: - Summary: Avoid using map instead of foreach to avoid potential side effect at callers of OrcUtil

[jira] [Updated] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at callee of OrcUtils.readCatalystSchema

2020-10-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33091: - Summary: Avoid using map instead of foreach to avoid potential side effect at callee of OrcUtils

[jira] [Commented] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at callers of OrcUtils.readCatalystSchema

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210014#comment-17210014 ] Apache Spark commented on SPARK-33091: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at callers of OrcUtils.readCatalystSchema

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33091: Assignee: (was: Apache Spark) > Avoid using map instead of foreach to avoid potential

[jira] [Assigned] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at callers of OrcUtils.readCatalystSchema

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33091: Assignee: Apache Spark > Avoid using map instead of foreach to avoid potential side effec

[jira] [Commented] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at callers of OrcUtils.readCatalystSchema

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210015#comment-17210015 ] Apache Spark commented on SPARK-33091: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-33074) Classify dialect exceptions in JDBC v2 Table Catalog

2020-10-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33074: --- Assignee: Maxim Gekk > Classify dialect exceptions in JDBC v2 Table Catalog > -

[jira] [Resolved] (SPARK-33074) Classify dialect exceptions in JDBC v2 Table Catalog

2020-10-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33074. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29952 [https://gith

[jira] [Created] (SPARK-33092) Support subexpression elimination in ProjectExec

2020-10-07 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-33092: --- Summary: Support subexpression elimination in ProjectExec Key: SPARK-33092 URL: https://issues.apache.org/jira/browse/SPARK-33092 Project: Spark Issue Type: Im

[jira] [Assigned] (SPARK-33092) Support subexpression elimination in ProjectExec

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33092: Assignee: L. C. Hsieh (was: Apache Spark) > Support subexpression elimination in Project

[jira] [Commented] (SPARK-33092) Support subexpression elimination in ProjectExec

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210024#comment-17210024 ] Apache Spark commented on SPARK-33092: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-33092) Support subexpression elimination in ProjectExec

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33092: Assignee: Apache Spark (was: L. C. Hsieh) > Support subexpression elimination in Project

[jira] [Assigned] (SPARK-33092) Support subexpression elimination in ProjectExec

2020-10-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33092: Assignee: Apache Spark (was: L. C. Hsieh) > Support subexpression elimination in Project

[jira] [Assigned] (SPARK-33092) Support subexpression elimination in ProjectExec

2020-10-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-33092: --- Assignee: L. C. Hsieh (was: Apache Spark) > Support subexpression elimination in ProjectEx

<    1   2