[jira] [Resolved] (SPARK-34723) Correct parameter type for subexpression elimination under whole-stage

2021-03-13 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34723. - Fix Version/s: 3.0.3 3.1.2 3.2.0 Resolution: Fixed

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300773#comment-17300773 ] Nick Hryhoriev commented on SPARK-31427: I check spark 3, it's the same. Maybe i

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300773#comment-17300773 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 9:22 AM:

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300773#comment-17300773 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 9:24 AM:

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300775#comment-17300775 ] Nick Hryhoriev commented on SPARK-31427: In spark 3 on GUI, I even can see that

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev commented on SPARK-31427: And even more strange, when I use only

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 9:41 AM:

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 10:16 AM: ---

[jira] [Commented] (SPARK-34630) Add type hints of pyspark.__version__ and pyspark.sql.Column.contains

2021-03-13 Thread Danny Meijer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300786#comment-17300786 ] Danny Meijer commented on SPARK-34630: -- I was browsing around and thought to have a

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 10:20 AM: ---

[jira] [Commented] (SPARK-34728) Remove all SQLConf.get if extends from Rule

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300790#comment-17300790 ] Apache Spark commented on SPARK-34728: -- User 'leoluan2009' has created a pull reque

[jira] [Commented] (SPARK-34728) Remove all SQLConf.get if extends from Rule

2021-03-13 Thread Xuedong Luan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300788#comment-17300788 ] Xuedong Luan commented on SPARK-34728: -- https://github.com/apache/spark/pull/31822/

[jira] [Commented] (SPARK-34630) Add type hints of pyspark.__version__ and pyspark.sql.Column.contains

2021-03-13 Thread Danny Meijer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300789#comment-17300789 ] Danny Meijer commented on SPARK-34630: -- PR opened: [[SPARK-34630]Added typehint for

[jira] [Assigned] (SPARK-34728) Remove all SQLConf.get if extends from Rule

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34728: Assignee: (was: Apache Spark) > Remove all SQLConf.get if extends from Rule > ---

[jira] [Assigned] (SPARK-34728) Remove all SQLConf.get if extends from Rule

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34728: Assignee: Apache Spark > Remove all SQLConf.get if extends from Rule > --

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 10:21 AM: ---

[jira] [Commented] (SPARK-34728) Remove all SQLConf.get if extends from Rule

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300791#comment-17300791 ] Apache Spark commented on SPARK-34728: -- User 'leoluan2009' has created a pull reque

[jira] [Assigned] (SPARK-34630) Add type hints of pyspark.__version__ and pyspark.sql.Column.contains

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34630: Assignee: Apache Spark > Add type hints of pyspark.__version__ and pyspark.sql.Column.con

[jira] [Assigned] (SPARK-34630) Add type hints of pyspark.__version__ and pyspark.sql.Column.contains

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34630: Assignee: (was: Apache Spark) > Add type hints of pyspark.__version__ and pyspark.sql

[jira] [Commented] (SPARK-34630) Add type hints of pyspark.__version__ and pyspark.sql.Column.contains

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300792#comment-17300792 ] Apache Spark commented on SPARK-34630: -- User 'dannymeijer' has created a pull reque

[jira] [Commented] (SPARK-34629) Python type hints improvement

2021-03-13 Thread Danny Meijer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300794#comment-17300794 ] Danny Meijer commented on SPARK-34629: -- I was so bold as to address the typehint yo

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 10:38 AM: ---

[jira] [Commented] (SPARK-32082) Project Zen: Improving Python usability

2021-03-13 Thread Danny Meijer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300801#comment-17300801 ] Danny Meijer commented on SPARK-32082: -- I would like to suggest we blackify all the

[jira] [Updated] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-31427: --- Affects Version/s: 2.4.7 3.0.1 3.0.2 > Spark S

[jira] [Commented] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

2021-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300862#comment-17300862 ] Kent Yao commented on SPARK-34128: -- Unfortunately, I tried the newly released `libthrif

[jira] [Created] (SPARK-34732) The logForFailedTest throws an exception when driver is not started

2021-03-13 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-34732: -- Summary: The logForFailedTest throws an exception when driver is not started Key: SPARK-34732 URL: https://issues.apache.org/jira/browse/SPARK-34732 Proje

[jira] [Commented] (SPARK-34732) The logForFailedTest throws an exception when driver is not started

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300882#comment-17300882 ] Apache Spark commented on SPARK-34732: -- User 'attilapiros' has created a pull reque

[jira] [Assigned] (SPARK-34732) The logForFailedTest throws an exception when driver is not started

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34732: Assignee: (was: Apache Spark) > The logForFailedTest throws an exception when driver

[jira] [Assigned] (SPARK-34732) The logForFailedTest throws an exception when driver is not started

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34732: Assignee: Apache Spark > The logForFailedTest throws an exception when driver is not star

[jira] [Commented] (SPARK-34732) The logForFailedTest throws an exception when driver is not started

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300883#comment-17300883 ] Apache Spark commented on SPARK-34732: -- User 'attilapiros' has created a pull reque

[jira] [Issue Comment Deleted] (SPARK-34728) Remove all SQLConf.get if extends from Rule

2021-03-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-34728: Comment: was deleted (was: I'm working on.) > Remove all SQLConf.get if extends from Rule > -

[jira] [Commented] (SPARK-34629) Python type hints improvement

2021-03-13 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300901#comment-17300901 ] Maciej Szymkiewicz commented on SPARK-34629: {quote} Would love to help out

[jira] [Created] (SPARK-34733) Spark UI not showing memory used of partitions in memory

2021-03-13 Thread sam (Jira)
sam created SPARK-34733: --- Summary: Spark UI not showing memory used of partitions in memory Key: SPARK-34733 URL: https://issues.apache.org/jira/browse/SPARK-34733 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34733) Spark UI not showing memory used of partitions in memory

2021-03-13 Thread sam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sam updated SPARK-34733: Attachment: Screenshot 2021-03-13 at 16.31.06.png > Spark UI not showing memory used of partitions in memory > ---

[jira] [Updated] (SPARK-34733) Spark UI not showing memory used of partitions in memory

2021-03-13 Thread sam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sam updated SPARK-34733: Description: We have a job that caches RDDs into memory. We know the code to cache is working as the spark logs

[jira] [Updated] (SPARK-34733) Spark UI not showing memory used of partitions in memory

2021-03-13 Thread sam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sam updated SPARK-34733: Description: We have a job that caches RDDs into memory. We know the code to cache is working as the spark logs

[jira] [Updated] (SPARK-34710) Add tableType for SHOW TABLES to distinguish view and tables

2021-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34710: - Summary: Add tableType for SHOW TABLES to distinguish view and tables (was: Add isView for SHOW TABLES

[jira] [Updated] (SPARK-33944) Incorrect logging for warehouse keys in SharedState options

2021-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-33944: - Description: While using SparkSession's initial options to generate the sharable Spark conf and Hadoop c

[jira] [Resolved] (SPARK-34732) The logForFailedTest throws an exception when driver is not started

2021-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34732. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31824 [https://

[jira] [Assigned] (SPARK-34732) The logForFailedTest throws an exception when driver is not started

2021-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34732: - Assignee: Attila Zsolt Piros > The logForFailedTest throws an exception when driver is

[jira] [Commented] (SPARK-34699) 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store temp views

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301019#comment-17301019 ] Apache Spark commented on SPARK-34699: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-34699) 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store temp views

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34699: Assignee: (was: Apache Spark) > 'CREATE TEMP VIEW USING' should use TemporaryViewRela

[jira] [Assigned] (SPARK-34699) 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store temp views

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34699: Assignee: Apache Spark > 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to sto

[jira] [Assigned] (SPARK-34731) ConcurrentModificationException in EventLoggingListener when redacting properties

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34731: Assignee: Apache Spark > ConcurrentModificationException in EventLoggingListener when red

[jira] [Commented] (SPARK-34731) ConcurrentModificationException in EventLoggingListener when redacting properties

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301021#comment-17301021 ] Apache Spark commented on SPARK-34731: -- User 'bersprockets' has created a pull requ

[jira] [Assigned] (SPARK-34731) ConcurrentModificationException in EventLoggingListener when redacting properties

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34731: Assignee: (was: Apache Spark) > ConcurrentModificationException in EventLoggingListen

[jira] [Commented] (SPARK-34731) ConcurrentModificationException in EventLoggingListener when redacting properties

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301023#comment-17301023 ] Apache Spark commented on SPARK-34731: -- User 'bersprockets' has created a pull requ

[jira] [Assigned] (SPARK-34492) Create "CSV Files" page for Data Source documents.

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34492: Assignee: Apache Spark > Create "CSV Files" page for Data Source documents. > ---

[jira] [Commented] (SPARK-34492) Create "CSV Files" page for Data Source documents.

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301026#comment-17301026 ] Apache Spark commented on SPARK-34492: -- User 'twoentartian' has created a pull requ

[jira] [Commented] (SPARK-34492) Create "CSV Files" page for Data Source documents.

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301027#comment-17301027 ] Apache Spark commented on SPARK-34492: -- User 'twoentartian' has created a pull requ

[jira] [Assigned] (SPARK-34492) Create "CSV Files" page for Data Source documents.

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34492: Assignee: (was: Apache Spark) > Create "CSV Files" page for Data Source documents. >

[jira] [Created] (SPARK-34734) Update sbt version to 1.4.9

2021-03-13 Thread William Hyun (Jira)
William Hyun created SPARK-34734: Summary: Update sbt version to 1.4.9 Key: SPARK-34734 URL: https://issues.apache.org/jira/browse/SPARK-34734 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-34734) Update sbt version to 1.4.9

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34734: Assignee: Apache Spark > Update sbt version to 1.4.9 > --- > >

[jira] [Commented] (SPARK-34734) Update sbt version to 1.4.9

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301032#comment-17301032 ] Apache Spark commented on SPARK-34734: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-34734) Update sbt version to 1.4.9

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34734: Assignee: (was: Apache Spark) > Update sbt version to 1.4.9 > ---

[jira] [Commented] (SPARK-34493) Create "TEXT Files" page for Data Source documents.

2021-03-13 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301034#comment-17301034 ] Haejoon Lee commented on SPARK-34493: - I'm working on this > Create "TEXT Files" pa

[jira] [Resolved] (SPARK-34727) Difference in results of casting float to timestamp

2021-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34727. -- Fix Version/s: 3.2.0 Assignee: Max Gekk Resolution: Fixed Fixed in https://git

[jira] [Commented] (SPARK-32082) Project Zen: Improving Python usability

2021-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301036#comment-17301036 ] Hyukjin Kwon commented on SPARK-32082: -- That's a good idea. One thing makes me hesi

[jira] [Commented] (SPARK-33098) Explicit or implicit casts involving partition columns can sometimes result in a MetaException.

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301037#comment-17301037 ] Bruce Robbins commented on SPARK-33098: --- Fixed by PR for SPARK-27421. > Explicit

[jira] [Resolved] (SPARK-33098) Explicit or implicit casts involving partition columns can sometimes result in a MetaException.

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-33098. --- Resolution: Duplicate > Explicit or implicit casts involving partition columns can sometimes

[jira] [Resolved] (SPARK-24814) Relationship between catalog and datasources

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-24814. --- Resolution: Resolved > Relationship between catalog and datasources > --

[jira] [Commented] (SPARK-24814) Relationship between catalog and datasources

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301038#comment-17301038 ] Bruce Robbins commented on SPARK-24814: --- Very old Jira, now obsolete. > Relations

[jira] [Resolved] (SPARK-24758) Create table wants to use /user/hive/warehouse in clean clone

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-24758. --- Resolution: Fixed > Create table wants to use /user/hive/warehouse in clean clone >

[jira] [Commented] (SPARK-24758) Create table wants to use /user/hive/warehouse in clean clone

2021-03-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301039#comment-17301039 ] Bruce Robbins commented on SPARK-24758: --- Issue no longer present on master. > Cre

[jira] [Created] (SPARK-34735) Add modified configs for SQL execution in UI

2021-03-13 Thread ulysses you (Jira)
ulysses you created SPARK-34735: --- Summary: Add modified configs for SQL execution in UI Key: SPARK-34735 URL: https://issues.apache.org/jira/browse/SPARK-34735 Project: Spark Issue Type: New Fe

[jira] [Updated] (SPARK-34735) Add modified configs for SQL execution in UI

2021-03-13 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34735: Attachment: sql-ui.jpg > Add modified configs for SQL execution in UI > --

[jira] [Commented] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

2021-03-13 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301046#comment-17301046 ] Attila Zsolt Piros commented on SPARK-34736: Working on this > Kubernetes a

[jira] [Created] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

2021-03-13 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-34736: -- Summary: Kubernetes and Minikube version upgrade for integration tests Key: SPARK-34736 URL: https://issues.apache.org/jira/browse/SPARK-34736 Project: Sp

[jira] [Assigned] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34736: Assignee: Apache Spark > Kubernetes and Minikube version upgrade for integration tests >

[jira] [Assigned] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34736: Assignee: (was: Apache Spark) > Kubernetes and Minikube version upgrade for integrati

[jira] [Commented] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301054#comment-17301054 ] Apache Spark commented on SPARK-34736: -- User 'attilapiros' has created a pull reque

[jira] [Commented] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

2021-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301055#comment-17301055 ] Apache Spark commented on SPARK-34736: -- User 'attilapiros' has created a pull reque

[jira] [Assigned] (SPARK-34734) Update sbt version to 1.4.9

2021-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34734: Assignee: William Hyun > Update sbt version to 1.4.9 > --- > >

[jira] [Resolved] (SPARK-34734) Update sbt version to 1.4.9

2021-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34734. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31828 [https://gi

[jira] [Created] (SPARK-34737) Discrepancy between TIMESTAMP_SECONDS and cast from float

2021-03-13 Thread Max Gekk (Jira)
Max Gekk created SPARK-34737: Summary: Discrepancy between TIMESTAMP_SECONDS and cast from float Key: SPARK-34737 URL: https://issues.apache.org/jira/browse/SPARK-34737 Project: Spark Issue Type: