[jira] [Updated] (SPARK-31997) Should drop test_udtf table when SingleSessionSuite completed

2020-06-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-31997: - Description: If we execute mvn test SingleSessionSuite and HiveThriftBinaryServerSuite in order,  the

[jira] [Updated] (SPARK-31997) Should drop test_udtf table when SingleSessionSuite completed

2020-06-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-31997: - Priority: Minor (was: Major) > Should drop test_udtf table when SingleSessionSuite completed >

[jira] [Updated] (SPARK-31959) Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian"

2020-06-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31959: Fix Version/s: 3.0.1 > Test failure "RebaseDateTimeSuite.optimization of micros rebasing -

[jira] [Assigned] (SPARK-31997) Should drop test_udtf table when SingleSessionSuite completed

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31997: Assignee: (was: Apache Spark) > Should drop test_udtf table when SingleSessionSuite

[jira] [Assigned] (SPARK-31997) Should drop test_udtf table when SingleSessionSuite completed

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31997: Assignee: Apache Spark > Should drop test_udtf table when SingleSessionSuite completed >

[jira] [Commented] (SPARK-31997) Should drop test_udtf table when SingleSessionSuite completed

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136309#comment-17136309 ] Apache Spark commented on SPARK-31997: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-31997) Should drop test_udtf table when SingleSessionSuite completed

2020-06-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-31997: Summary: Should drop test_udtf table when SingleSessionSuite completed Key: SPARK-31997 URL: https://issues.apache.org/jira/browse/SPARK-31997 Project: Spark Issue

[jira] [Commented] (SPARK-31996) Specify the version of ChromeDriver and RemoteWebDriver which can work with guava 14.0.1

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136303#comment-17136303 ] Apache Spark commented on SPARK-31996: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31996) Specify the version of ChromeDriver and RemoteWebDriver which can work with guava 14.0.1

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31996: Assignee: Kousuke Saruta (was: Apache Spark) > Specify the version of ChromeDriver and

[jira] [Assigned] (SPARK-31996) Specify the version of ChromeDriver and RemoteWebDriver which can work with guava 14.0.1

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31996: Assignee: Apache Spark (was: Kousuke Saruta) > Specify the version of ChromeDriver and

[jira] [Commented] (SPARK-31996) Specify the version of ChromeDriver and RemoteWebDriver which can work with guava 14.0.1

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136302#comment-17136302 ] Apache Spark commented on SPARK-31996: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-31996) Specify the version of ChromeDriver and RemoteWebDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Description: SPARK-31765 upgraded HtmlUnit due to a security reason and Selenium was also

[jira] [Updated] (SPARK-31996) Specify the version of ChromeDriver and RemoteWebDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Summary: Specify the version of ChromeDriver and RemoteWebDriver which can work with guava

[jira] [Updated] (SPARK-31996) Specify the version of chrome-driver and remote-driver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Description: SPARK-31765 upgraded HtmlUnit due to a security reason and Selenium was also

[jira] [Updated] (SPARK-31996) Specify the version of chrome-driver and remote-driver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Summary: Specify the version of chrome-driver and remote-driver which can work with guava

[jira] [Updated] (SPARK-31996) Specify the version of ChromeDriver and RemoteDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Description: SPARK-31765 upgraded HtmlUnit due to a security reason and Selenium was also

[jira] [Updated] (SPARK-31996) Specify the version of ChromeDriver and RemoteDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Summary: Specify the version of ChromeDriver and RemoteDriver which can work with guava

[jira] [Updated] (SPARK-31996) Specify the version of ChromeDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-31996: --- Description: SPARK-31765 upgraded HtmlUnit due to a security reason and Selenium was also

[jira] [Created] (SPARK-31996) Specify the version of ChromeDriver which can work with guava 14.0.1

2020-06-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-31996: -- Summary: Specify the version of ChromeDriver which can work with guava 14.0.1 Key: SPARK-31996 URL: https://issues.apache.org/jira/browse/SPARK-31996 Project:

[jira] [Assigned] (SPARK-31561) Add QUALIFY Clause

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31561: Assignee: (was: Apache Spark) > Add QUALIFY Clause > -- > >

[jira] [Assigned] (SPARK-31561) Add QUALIFY Clause

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31561: Assignee: Apache Spark > Add QUALIFY Clause > -- > >

[jira] [Commented] (SPARK-31561) Add QUALIFY Clause

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136264#comment-17136264 ] Apache Spark commented on SPARK-31561: -- User 'AngersZh' has created a pull request for this

[jira] [Comment Edited] (SPARK-31980) Spark sequence() fails if start and end of range are identical dates

2020-06-15 Thread JinxinTang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136248#comment-17136248 ] JinxinTang edited comment on SPARK-31980 at 6/16/20, 3:01 AM: --

[jira] [Commented] (SPARK-31980) Spark sequence() fails if start and end of range are identical dates

2020-06-15 Thread JinxinTang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136248#comment-17136248 ] JinxinTang commented on SPARK-31980: [~DaveDeCaprio] Maybe one of this PRs could rebase to solve

[jira] [Commented] (SPARK-14651) CREATE TEMPORARY TABLE is not supported yet

2020-06-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136200#comment-17136200 ] Takeshi Yamamuro commented on SPARK-14651: -- Yea, not supported yet. Please use `create

[jira] [Updated] (SPARK-31995) Spark Structure Streaming checkpiontFileManager ERROR when HDFS.DFSOutputStream.completeFile with IOException unable to close file because the last block does not have e

2020-06-15 Thread Jim Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Huang updated SPARK-31995: -- Environment: Apache Spark 2.4.5 Scala 2.11 without Hadoop Hadoop 2.7.3 - YARN cluster delta-core_

[jira] [Updated] (SPARK-31995) Spark Structure Streaming checkpiontFileManager ERROR when HDFS.DFSOutputStream.completeFile with IOException unable to close file because the last block does not have e

2020-06-15 Thread Jim Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Huang updated SPARK-31995: -- Labels: (was: delta) > Spark Structure Streaming checkpiontFileManager ERROR when >

[jira] [Updated] (SPARK-31995) Spark Structure Streaming checkpiontFileManager ERROR when HDFS.DFSOutputStream.completeFile with IOException unable to close file because the last block does not have e

2020-06-15 Thread Jim Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Huang updated SPARK-31995: -- Labels: delta (was: ) > Spark Structure Streaming checkpiontFileManager ERROR when >

[jira] [Updated] (SPARK-31995) Spark Structure Streaming checkpiontFileManager ERROR when HDFS.DFSOutputStream.completeFile with IOException unable to close file because the last block does not have e

2020-06-15 Thread Jim Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Huang updated SPARK-31995: -- Description: I am using Spark 2.4.5's Spark Structured Streaming with Delta table (0.6.1) as the

[jira] [Updated] (SPARK-31995) Spark Structure Streaming checkpiontFileManager ERROR when HDFS.DFSOutputStream.completeFile with IOException unable to close file because the last block does not have e

2020-06-15 Thread Jim Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Huang updated SPARK-31995: -- Description: I am using Spark 2.4.5's Spark Structured Streaming with Delta table as the sink

[jira] [Updated] (SPARK-31995) Spark Structure Streaming checkpiontFileManager ERROR when HDFS.DFSOutputStream.completeFile with IOException unable to close file because the last block does not have e

2020-06-15 Thread Jim Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Huang updated SPARK-31995: -- Description: I am using Spark 2.4.5's Spark Structured Streaming running in YARN cluster running on 

[jira] [Created] (SPARK-31995) Spark Structure Streaming checkpiontFileManager ERROR when HDFS.DFSOutputStream.completeFile with IOException unable to close file because the last block does not have e

2020-06-15 Thread Jim Huang (Jira)
Jim Huang created SPARK-31995: - Summary: Spark Structure Streaming checkpiontFileManager ERROR when HDFS.DFSOutputStream.completeFile with IOException unable to close file because the last block does not have enough number of replicas

[jira] [Comment Edited] (SPARK-14651) CREATE TEMPORARY TABLE is not supported yet

2020-06-15 Thread Jeffrey E Rodriguez (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136169#comment-17136169 ] Jeffrey E Rodriguez edited comment on SPARK-14651 at 6/15/20, 10:03 PM:

[jira] [Comment Edited] (SPARK-14651) CREATE TEMPORARY TABLE is not supported yet

2020-06-15 Thread Jeffrey E Rodriguez (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136169#comment-17136169 ] Jeffrey E Rodriguez edited comment on SPARK-14651 at 6/15/20, 9:58 PM:

[jira] [Commented] (SPARK-14651) CREATE TEMPORARY TABLE is not supported yet

2020-06-15 Thread Jeffrey E Rodriguez (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136169#comment-17136169 ] Jeffrey E Rodriguez commented on SPARK-14651: -- This is showing as solve/incomplete. Trying

[jira] [Commented] (SPARK-14948) Exception when joining DataFrames derived form the same DataFrame

2020-06-15 Thread John Born (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136157#comment-17136157 ] John Born commented on SPARK-14948: --- Alternative workaround (prettier code-wise, probably worse

[jira] [Commented] (SPARK-30520) Eliminate deprecation warnings for UserDefinedAggregateFunction

2020-06-15 Thread Erik Erlandson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136153#comment-17136153 ] Erik Erlandson commented on SPARK-30520: Starting in spark 3.0, any custom aggregator that would

[jira] [Resolved] (SPARK-31824) DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-06-15 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-31824. -- Fix Version/s: 3.1.0 Assignee: jiaan.geng Resolution: Fixed Resolved by

[jira] [Commented] (SPARK-31976) use MemoryUsage to control the size of block

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136103#comment-17136103 ] Dongjoon Hyun commented on SPARK-31976: --- Thank you for updating, [~smilegator]. :) > use

[jira] [Commented] (SPARK-31976) use MemoryUsage to control the size of block

2020-06-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136102#comment-17136102 ] Xiao Li commented on SPARK-31976: - I think [~podongfeng] just wants to target this feature in Spark 3.1

[jira] [Updated] (SPARK-31976) use MemoryUsage to control the size of block

2020-06-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31976: Target Version/s: 3.1.0 Priority: Major (was: Blocker) > use MemoryUsage to control the size

[jira] [Resolved] (SPARK-31902) K8s integration tests are failing with mockito errors

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31902. --- Resolution: Duplicate > K8s integration tests are failing with mockito errors >

[jira] [Reopened] (SPARK-31902) K8s integration tests are failing with mockito errors

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-31902: --- > K8s integration tests are failing with mockito errors >

[jira] [Commented] (SPARK-31976) use MemoryUsage to control the size of block

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136093#comment-17136093 ] Dongjoon Hyun commented on SPARK-31976: --- Hi, [~podongfeng]. Could you give us more context why

[jira] [Updated] (SPARK-31994) Docker image should use `https` urls for only mirrors that support it(SSL)

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31994: -- Priority: Minor (was: Major) > Docker image should use `https` urls for only mirrors that

[jira] [Assigned] (SPARK-31994) Docker image should use `https` urls for only mirrors that support it(SSL)

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31994: - Assignee: Prashant Sharma > Docker image should use `https` urls for only mirrors that

[jira] [Resolved] (SPARK-31994) Docker image should use `https` urls for only mirrors that support it(SSL)

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31994. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135996#comment-17135996 ] Apache Spark commented on SPARK-31926: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Updated] (SPARK-31860) Only push release tags on success

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31860: -- Affects Version/s: (was: 3.0.1) > Only push release tags on success >

[jira] [Comment Edited] (SPARK-31860) Only push release tags on success

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135983#comment-17135983 ] Dongjoon Hyun edited comment on SPARK-31860 at 6/15/20, 4:10 PM: - This

[jira] [Comment Edited] (SPARK-31860) Only push release tags on success

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135983#comment-17135983 ] Dongjoon Hyun edited comment on SPARK-31860 at 6/15/20, 4:10 PM: - This

[jira] [Commented] (SPARK-31860) Only push release tags on success

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135983#comment-17135983 ] Dongjoon Hyun commented on SPARK-31860: --- This is reverted from master/3.0 due to the regression on

[jira] [Comment Edited] (SPARK-31860) Only push release tags on success

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135983#comment-17135983 ] Dongjoon Hyun edited comment on SPARK-31860 at 6/15/20, 4:10 PM: - This

[jira] [Updated] (SPARK-31860) Only push release tags on success

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31860: -- Fix Version/s: (was: 3.0.1) (was: 3.1.0) > Only push release tags

[jira] [Resolved] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26905. -- Fix Version/s: 3.0.1 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Updated] (SPARK-31950) Extract SQL keywords from the generated parser class in TableIdentifierParserSuite

2020-06-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31950: - Fix Version/s: (was: 3.1.0) 3.0.1 > Extract SQL keywords from

[jira] [Resolved] (SPARK-31959) Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian"

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31959. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28832

[jira] [Assigned] (SPARK-31959) Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian"

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31959: - Assignee: Maxim Gekk > Test failure "RebaseDateTimeSuite.optimization of micros

[jira] [Resolved] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31990. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31990: - Assignee: Takeshi Yamamuro > Streaming's state store compatibility is broken >

[jira] [Resolved] (SPARK-31925) Summary.totalIterations greater than maxIters

2020-06-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31925. -- Fix Version/s: 3.1.0 Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-31925) Summary.totalIterations greater than maxIters

2020-06-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31925: - Priority: Minor (was: Trivial) > Summary.totalIterations greater than maxIters >

[jira] [Assigned] (SPARK-31925) Summary.totalIterations greater than maxIters

2020-06-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-31925: Docs Text: Before Spark 3.1, if maxIter=n in LogisticRegression and LinearRegression,

[jira] [Updated] (SPARK-31994) Docker image should use `https` urls for only mirrors that support it(SSL)

2020-06-15 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-31994: Summary: Docker image should use `https` urls for only mirrors that support it(SSL)

[jira] [Commented] (SPARK-31994) Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135716#comment-17135716 ] Apache Spark commented on SPARK-31994: -- User 'ScrapCodes' has created a pull request for this

[jira] [Commented] (SPARK-31994) Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135714#comment-17135714 ] Apache Spark commented on SPARK-31994: -- User 'ScrapCodes' has created a pull request for this

[jira] [Assigned] (SPARK-31994) Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31994: Assignee: Apache Spark > Docker image should use `https` urls for only deb.debian.org

[jira] [Assigned] (SPARK-31994) Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31994: Assignee: (was: Apache Spark) > Docker image should use `https` urls for only

[jira] [Created] (SPARK-31994) Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-31994: --- Summary: Docker image should use `https` urls for only deb.debian.org mirrors. Key: SPARK-31994 URL: https://issues.apache.org/jira/browse/SPARK-31994 Project:

[jira] [Updated] (SPARK-31905) Add compatibility tests for streaming state store format

2020-06-15 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-31905: Summary: Add compatibility tests for streaming state store format (was: Add compatibility tests

[jira] [Updated] (SPARK-29345) Add an API that allows a user to define and observe arbitrary metrics on batch and streaming queries

2020-06-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29345: Summary: Add an API that allows a user to define and observe arbitrary metrics on batch and

[jira] [Commented] (SPARK-31887) Date casting to string is giving wrong value

2020-06-15 Thread Amit Gupta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135638#comment-17135638 ] Amit Gupta commented on SPARK-31887: [~hyukjin.kwon] I will deploy the master on server and

[jira] [Commented] (SPARK-31985) Remove the incomplete code path on aggregation for continuous mode

2020-06-15 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135637#comment-17135637 ] Gabor Somogyi commented on SPARK-31985: --- +1 on this unless somebody wants to continue the work.

[jira] [Commented] (SPARK-20680) Spark-sql do not support for void column datatype of view

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135614#comment-17135614 ] Apache Spark commented on SPARK-20680: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Commented] (SPARK-20680) Spark-sql do not support for void column datatype of view

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135612#comment-17135612 ] Apache Spark commented on SPARK-20680: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Commented] (SPARK-31959) Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian"

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135602#comment-17135602 ] Apache Spark commented on SPARK-31959: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31959) Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian"

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135600#comment-17135600 ] Apache Spark commented on SPARK-31959: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31993) Generated code in 'concat_ws' fails to compile when splitting method is in effect

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135580#comment-17135580 ] Apache Spark commented on SPARK-31993: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-31993) Generated code in 'concat_ws' fails to compile when splitting method is in effect

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31993: Assignee: (was: Apache Spark) > Generated code in 'concat_ws' fails to compile when

[jira] [Commented] (SPARK-31993) Generated code in 'concat_ws' fails to compile when splitting method is in effect

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135579#comment-17135579 ] Apache Spark commented on SPARK-31993: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-31993) Generated code in 'concat_ws' fails to compile when splitting method is in effect

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31993: Assignee: Apache Spark > Generated code in 'concat_ws' fails to compile when splitting

[jira] [Resolved] (SPARK-31992) Benchmark the EXCEPTION rebase mode

2020-06-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31992. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-31992) Benchmark the EXCEPTION rebase mode

2020-06-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31992: --- Assignee: Maxim Gekk > Benchmark the EXCEPTION rebase mode >

[jira] [Updated] (SPARK-31705) Push more possible predicates through Join via CNF

2020-06-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31705: Summary: Push more possible predicates through Join via CNF (was: Rewrite join condition to

[jira] [Created] (SPARK-31993) Generated code in 'concat_ws' fails to compile when splitting method is in effect

2020-06-15 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-31993: Summary: Generated code in 'concat_ws' fails to compile when splitting method is in effect Key: SPARK-31993 URL: https://issues.apache.org/jira/browse/SPARK-31993

[jira] [Commented] (SPARK-31992) Benchmark the EXCEPTION rebase mode

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135452#comment-17135452 ] Apache Spark commented on SPARK-31992: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31992) Benchmark the EXCEPTION rebase mode

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31992: Assignee: Apache Spark > Benchmark the EXCEPTION rebase mode >

[jira] [Assigned] (SPARK-31992) Benchmark the EXCEPTION rebase mode

2020-06-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31992: Assignee: (was: Apache Spark) > Benchmark the EXCEPTION rebase mode >

[jira] [Created] (SPARK-31992) Benchmark the EXCEPTION rebase mode

2020-06-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31992: -- Summary: Benchmark the EXCEPTION rebase mode Key: SPARK-31992 URL: https://issues.apache.org/jira/browse/SPARK-31992 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31926: --- Assignee: Kent Yao > Fix concurrency issue for ThriftCLIService to getPortNumber >

[jira] [Resolved] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31926. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-31894) Introduce UnsafeRow format validation for streaming state store

2020-06-15 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135431#comment-17135431 ] Yuanjian Li commented on SPARK-31894: - This issue is blocking by SPARK-31990, see more details in 

[jira] [Commented] (SPARK-31990) Streaming's state store compatibility is broken

2020-06-15 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135428#comment-17135428 ] Yuanjian Li commented on SPARK-31990: - [~maropu] Thanks for the quick fix! [~dongjoon] This issue