[jira] [Commented] (SPARK-32867) HiveTablerelation show too much message of Catalogpartitions

2020-09-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194939#comment-17194939 ] Apache Spark commented on SPARK-32867: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-32867) HiveTablerelation show too much message of Catalogpartitions

2020-09-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32867: Assignee: Apache Spark > HiveTablerelation show too much message of Catalogpartitions > -

[jira] [Assigned] (SPARK-32867) HiveTablerelation show too much message of Catalogpartitions

2020-09-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32867: Assignee: (was: Apache Spark) > HiveTablerelation show too much message of Catalogpar

[jira] [Created] (SPARK-32867) HiveTablerelation show too much message of Catalogpartitions

2020-09-12 Thread angerszhu (Jira)
angerszhu created SPARK-32867: - Summary: HiveTablerelation show too much message of Catalogpartitions Key: SPARK-32867 URL: https://issues.apache.org/jira/browse/SPARK-32867 Project: Spark Issue

[jira] [Updated] (SPARK-32860) Encoders::bean doc incorrectly states maps are not supported

2020-09-12 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32860: Labels: starter (was: ) > Encoders::bean doc incorrectly states maps are not supported >

[jira] [Resolved] (SPARK-32802) Avoid using SpecificInternalRow in RunLengthEncoding#Encoder

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32802. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29654 [https://

[jira] [Assigned] (SPARK-32802) Avoid using SpecificInternalRow in RunLengthEncoding#Encoder

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32802: - Assignee: Chao Sun > Avoid using SpecificInternalRow in RunLengthEncoding#Encoder > ---

[jira] [Updated] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32865: -- Affects Version/s: 2.2.3 > python section in quickstart page doesn't display SPARK_VERSION cor

[jira] [Updated] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32865: -- Affects Version/s: 2.3.4 > python section in quickstart page doesn't display SPARK_VERSION cor

[jira] [Resolved] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32865. --- Resolution: Fixed Issue resolved by pull request 29738 [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32865: - Assignee: Bowen Li > python section in quickstart page doesn't display SPARK_VERSION co

[jira] [Updated] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32865: -- Affects Version/s: 2.4.7 > python section in quickstart page doesn't display SPARK_VERSION cor

[jira] [Updated] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32865: -- Fix Version/s: 2.4.8 > python section in quickstart page doesn't display SPARK_VERSION correct

[jira] [Assigned] (SPARK-24994) Support cast pushdown for integral types

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-24994: - Assignee: Chao Sun > Support cast pushdown for integral types > ---

[jira] [Updated] (SPARK-24994) Add UnwrapCastInBinaryComparison optimizer to simplify literal types

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24994: -- Summary: Add UnwrapCastInBinaryComparison optimizer to simplify literal types (was: Support c

[jira] [Resolved] (SPARK-24994) Support cast pushdown for integral types

2020-09-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-24994. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29565 [https://

[jira] [Created] (SPARK-32866) Docker buildx now requires --push

2020-09-12 Thread Holden Karau (Jira)
Holden Karau created SPARK-32866: Summary: Docker buildx now requires --push Key: SPARK-32866 URL: https://issues.apache.org/jira/browse/SPARK-32866 Project: Spark Issue Type: Bug C

[jira] [Assigned] (SPARK-30090) Update REPL for 2.13

2020-09-12 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30090: Assignee: Karol Chmist > Update REPL for 2.13 > > >

[jira] [Resolved] (SPARK-30090) Update REPL for 2.13

2020-09-12 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30090. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28545 [https://gi

[jira] [Assigned] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32865: Assignee: Apache Spark > python section in quickstart page doesn't display SPARK_VERSION

[jira] [Assigned] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32865: Assignee: (was: Apache Spark) > python section in quickstart page doesn't display SPA

[jira] [Commented] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194903#comment-17194903 ] Apache Spark commented on SPARK-32865: -- User 'bowenli86' has created a pull request

[jira] [Commented] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Bowen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194896#comment-17194896 ] Bowen Li commented on SPARK-32865: -- can someone help to assign this ticket to me? seems

[jira] [Created] (SPARK-32865) python section in quickstart page doesn't display SPARK_VERSION correctly

2020-09-12 Thread Bowen Li (Jira)
Bowen Li created SPARK-32865: Summary: python section in quickstart page doesn't display SPARK_VERSION correctly Key: SPARK-32865 URL: https://issues.apache.org/jira/browse/SPARK-32865 Project: Spark

[jira] [Assigned] (SPARK-32804) run-example failed in standalone cluster mode

2020-09-12 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32804: Assignee: Kevin Wang > run-example failed in standalone cluster mode > --

[jira] [Resolved] (SPARK-32804) run-example failed in standalone cluster mode

2020-09-12 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32804. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29653 [https://gi

[jira] [Updated] (SPARK-32067) [K8S] Executor pod template config map of ongoing submission got inadvertently altered by subsequent submission

2020-09-12 Thread James Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Yu updated SPARK-32067: - Description: THE BUG: The bug is reproducible by spark-submit two different apps (app1 and app2) with

[jira] [Updated] (SPARK-32067) [K8S] Executor pod template config map of ongoing submission got inadvertently altered by subsequent submission

2020-09-12 Thread James Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Yu updated SPARK-32067: - Description: THE BUG: The bug is reproducible by spark-submit two different apps (app1 and app2) with

[jira] [Updated] (SPARK-32067) [K8S] Executor pod template config map of ongoing submission got inadvertently altered by subsequent submission

2020-09-12 Thread James Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Yu updated SPARK-32067: - Description: THE BUG: The bug is reproducible by spark-submit two different apps (app1 and app2) with

[jira] [Updated] (SPARK-32067) [K8S] Executor pod template config map of ongoing submission got inadvertently altered by subsequent submission

2020-09-12 Thread James Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Yu updated SPARK-32067: - Summary: [K8S] Executor pod template config map of ongoing submission got inadvertently altered by subse

[jira] [Assigned] (SPARK-32864) Support ORC forced positional evolution

2020-09-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32864: Assignee: Apache Spark > Support ORC forced positional evolution > --

[jira] [Commented] (SPARK-32864) Support ORC forced positional evolution

2020-09-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194763#comment-17194763 ] Apache Spark commented on SPARK-32864: -- User 'peter-toth' has created a pull reques

[jira] [Assigned] (SPARK-32864) Support ORC forced positional evolution

2020-09-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32864: Assignee: (was: Apache Spark) > Support ORC forced positional evolution > ---

[jira] [Assigned] (SPARK-32864) Support ORC forced positional evolution

2020-09-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32864: Assignee: (was: Apache Spark) > Support ORC forced positional evolution > ---

[jira] [Created] (SPARK-32864) Support ORC forced positional evolution

2020-09-12 Thread Peter Toth (Jira)
Peter Toth created SPARK-32864: -- Summary: Support ORC forced positional evolution Key: SPARK-32864 URL: https://issues.apache.org/jira/browse/SPARK-32864 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-32542) Add an optimizer rule to split an Expand into multiple Expands for aggregates

2020-09-12 Thread karl wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] karl wang resolved SPARK-32542. --- Resolution: Fixed > Add an optimizer rule to split an Expand into multiple Expands for aggregates >

[jira] [Commented] (SPARK-32863) Full outer stream-stream join

2020-09-12 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194646#comment-17194646 ] Cheng Su commented on SPARK-32863: -- Will raise a PR in next couple of weeks. Thanks. >

[jira] [Created] (SPARK-32863) Full outer stream-stream join

2020-09-12 Thread Cheng Su (Jira)
Cheng Su created SPARK-32863: Summary: Full outer stream-stream join Key: SPARK-32863 URL: https://issues.apache.org/jira/browse/SPARK-32863 Project: Spark Issue Type: New Feature Compo

[jira] [Comment Edited] (SPARK-32838) Connot overwite different partition with same table

2020-09-12 Thread CHC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194644#comment-17194644 ] CHC edited comment on SPARK-32838 at 9/12/20, 7:47 AM: --- After spen

[jira] [Commented] (SPARK-32838) Connot overwite different partition with same table

2020-09-12 Thread CHC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194644#comment-17194644 ] CHC commented on SPARK-32838: - After spending a long time exploring, I found that [HiveStr

[jira] [Comment Edited] (SPARK-32838) Connot overwite different partition with same table

2020-09-12 Thread CHC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194644#comment-17194644 ] CHC edited comment on SPARK-32838 at 9/12/20, 7:47 AM: --- After spen

[jira] [Commented] (SPARK-32862) Left semi stream-stream join

2020-09-12 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194643#comment-17194643 ] Cheng Su commented on SPARK-32862: -- Will raise a PR in next couple of weeks. Thanks. >

[jira] [Created] (SPARK-32862) Left semi stream-stream join

2020-09-12 Thread Cheng Su (Jira)
Cheng Su created SPARK-32862: Summary: Left semi stream-stream join Key: SPARK-32862 URL: https://issues.apache.org/jira/browse/SPARK-32862 Project: Spark Issue Type: New Feature Compon

[jira] [Comment Edited] (SPARK-24528) Add support to read multiple sorted bucket files for data source v1

2020-09-12 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194505#comment-17194505 ] Cheng Su edited comment on SPARK-24528 at 9/12/20, 7:28 AM: