[jira] [Resolved] (SPARK-30898) The behavior of MakeDecimal should not depend on SQLConf.get

2020-02-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30898. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27656

[jira] [Assigned] (SPARK-30898) The behavior of MakeDecimal should not depend on SQLConf.get

2020-02-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30898: Assignee: Peter Toth > The behavior of MakeDecimal should not depend on SQLConf.get >

[jira] [Resolved] (SPARK-30897) The behavior of ArrayExists should not depend on SQLConf.get

2020-02-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30897. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27655

[jira] [Assigned] (SPARK-30897) The behavior of ArrayExists should not depend on SQLConf.get

2020-02-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30897: Assignee: Peter Toth > The behavior of ArrayExists should not depend on SQLConf.get >

[jira] [Commented] (SPARK-30893) Expressions should not change its data type/behavior after it's created

2020-02-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043195#comment-17043195 ] Hyukjin Kwon commented on SPARK-30893: -- I am sure there are already multiple inconsistent instances

[jira] [Assigned] (SPARK-30924) Add additional validation into Merge Into

2020-02-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30924: --- Assignee: Burak Yavuz > Add additional validation into Merge Into >

[jira] [Resolved] (SPARK-30924) Add additional validation into Merge Into

2020-02-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30924. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27677

[jira] [Resolved] (SPARK-30922) Remove the max split config after changing the multi sub joins to multi sub partitions

2020-02-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30922. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27673

[jira] [Assigned] (SPARK-30922) Remove the max split config after changing the multi sub joins to multi sub partitions

2020-02-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30922: --- Assignee: Ke Jia > Remove the max split config after changing the multi sub joins to multi

[jira] [Updated] (SPARK-30936) Forwards-compatibility in JsonProtocol in broken

2020-02-23 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-30936: - Summary: Forwards-compatibility in JsonProtocol in broken (was: Fix the broken

[jira] [Created] (SPARK-30936) Fix the broken forwards-compatibility in JsonProtocol

2020-02-23 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-30936: Summary: Fix the broken forwards-compatibility in JsonProtocol Key: SPARK-30936 URL: https://issues.apache.org/jira/browse/SPARK-30936 Project: Spark Issue

[jira] [Assigned] (SPARK-30925) Overflow/round errors in conversions of milliseconds to/from microseconds

2020-02-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30925: --- Assignee: Maxim Gekk > Overflow/round errors in conversions of milliseconds to/from

[jira] [Resolved] (SPARK-30925) Overflow/round errors in conversions of milliseconds to/from microseconds

2020-02-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30925. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27676

[jira] [Updated] (SPARK-30923) Spark MLlib, GraphX 3.0 QA umbrella

2020-02-23 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-30923: - Component/s: PySpark > Spark MLlib, GraphX 3.0 QA umbrella >

[jira] [Commented] (SPARK-30923) Spark MLlib, GraphX 3.0 QA umbrella

2020-02-23 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043150#comment-17043150 ] zhengruifeng commented on SPARK-30923: -- refering to pervious ticket

[jira] [Updated] (SPARK-30923) Spark MLlib, GraphX 3.0 QA umbrella

2020-02-23 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-30923: - Issue Type: Umbrella (was: Task) > Spark MLlib, GraphX 3.0 QA umbrella >

[jira] [Created] (SPARK-30935) Update MLlib, GraphX websites for 3.0

2020-02-23 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30935: Summary: Update MLlib, GraphX websites for 3.0 Key: SPARK-30935 URL: https://issues.apache.org/jira/browse/SPARK-30935 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-30934) ML, GraphX 3.0 QA: Programming guide update and migration guide

2020-02-23 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30934: Summary: ML, GraphX 3.0 QA: Programming guide update and migration guide Key: SPARK-30934 URL: https://issues.apache.org/jira/browse/SPARK-30934 Project: Spark

[jira] [Created] (SPARK-30933) ML, GraphX 3.0 QA: Update user guide for new features & APIs

2020-02-23 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30933: Summary: ML, GraphX 3.0 QA: Update user guide for new features & APIs Key: SPARK-30933 URL: https://issues.apache.org/jira/browse/SPARK-30933 Project: Spark

[jira] [Created] (SPARK-30932) ML 3.0 QA: API: Java compatibility, docs

2020-02-23 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30932: Summary: ML 3.0 QA: API: Java compatibility, docs Key: SPARK-30932 URL: https://issues.apache.org/jira/browse/SPARK-30932 Project: Spark Issue Type:

[jira] [Created] (SPARK-30931) ML 3.0 QA: API: Python API coverage

2020-02-23 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30931: Summary: ML 3.0 QA: API: Python API coverage Key: SPARK-30931 URL: https://issues.apache.org/jira/browse/SPARK-30931 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-30930) ML, GraphX 3.0 QA: API: Experimental, DeveloperApi, final, sealed audit

2020-02-23 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30930: Summary: ML, GraphX 3.0 QA: API: Experimental, DeveloperApi, final, sealed audit Key: SPARK-30930 URL: https://issues.apache.org/jira/browse/SPARK-30930 Project:

[jira] [Created] (SPARK-30929) ML, GraphX 3.0 QA: API: New Scala APIs, docs

2020-02-23 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30929: Summary: ML, GraphX 3.0 QA: API: New Scala APIs, docs Key: SPARK-30929 URL: https://issues.apache.org/jira/browse/SPARK-30929 Project: Spark Issue Type:

[jira] [Created] (SPARK-30928) ML, GraphX 3.0 QA: API: Binary incompatible changes

2020-02-23 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30928: Summary: ML, GraphX 3.0 QA: API: Binary incompatible changes Key: SPARK-30928 URL: https://issues.apache.org/jira/browse/SPARK-30928 Project: Spark Issue

[jira] [Commented] (SPARK-30923) Spark MLlib, GraphX 3.0 QA umbrella

2020-02-23 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043147#comment-17043147 ] zhengruifeng commented on SPARK-30923: -- [~smilegator] Sure! > Spark MLlib, GraphX 3.0 QA umbrella

[jira] [Assigned] (SPARK-30867) add FValueRegressionTest

2020-02-23 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30867: Assignee: Huaxin Gao > add FValueRegressionTest > > >

[jira] [Resolved] (SPARK-30867) add FValueRegressionTest

2020-02-23 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30867. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27623

[jira] [Updated] (SPARK-30923) Spark MLlib, GraphX 3.0 QA umbrella

2020-02-23 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-30923: - Summary: Spark MLlib, GraphX 3.0 QA umbrella (was: Spark MLlib, GraphX 2.4 QA umbrella) >

[jira] [Created] (SPARK-30927) StreamingQueryManager should avoid keeping reference to terminated StreamingQuery

2020-02-23 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-30927: Summary: StreamingQueryManager should avoid keeping reference to terminated StreamingQuery Key: SPARK-30927 URL: https://issues.apache.org/jira/browse/SPARK-30927

[jira] [Updated] (SPARK-30926) Same SQL on CSV and on Parquet gives different result

2020-02-23 Thread Bozhidar Karaargirov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bozhidar Karaargirov updated SPARK-30926: - Description: SO I played around with a data set from here: 

[jira] [Updated] (SPARK-30926) Same SQL on CSV and on Parquet gives different result

2020-02-23 Thread Bozhidar Karaargirov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bozhidar Karaargirov updated SPARK-30926: - Description: SO I played around with a data set from here: 

[jira] [Updated] (SPARK-30926) Same SQL on CSV and on Parquet gives different result

2020-02-23 Thread Bozhidar Karaargirov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bozhidar Karaargirov updated SPARK-30926: - Description: SO I played around with a data set from here: 

[jira] [Updated] (SPARK-30926) Same SQL on CSV and on Parquet gives different result

2020-02-23 Thread Bozhidar Karaargirov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bozhidar Karaargirov updated SPARK-30926: - Description: SO I played around with a data set from here: 

[jira] [Created] (SPARK-30926) Same SQL on CSV and on Parquet gives different result

2020-02-23 Thread Bozhidar Karaargirov (Jira)
Bozhidar Karaargirov created SPARK-30926: Summary: Same SQL on CSV and on Parquet gives different result Key: SPARK-30926 URL: https://issues.apache.org/jira/browse/SPARK-30926 Project: Spark

[jira] [Reopened] (SPARK-30332) When running sql query with limit catalyst throw StackOverFlow exception

2020-02-23 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield reopened SPARK-30332: - Added code for reproduce > When running sql query with limit catalyst throw StackOverFlow

[jira] [Commented] (SPARK-30332) When running sql query with limit catalyst throw StackOverFlow exception

2020-02-23 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042851#comment-17042851 ] Izek Greenfield commented on SPARK-30332: - Code to reproduce the problem: {code:scala} import

[jira] [Created] (SPARK-30925) Overflow/round errors in conversions of milliseconds to/from microseconds

2020-02-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30925: -- Summary: Overflow/round errors in conversions of milliseconds to/from microseconds Key: SPARK-30925 URL: https://issues.apache.org/jira/browse/SPARK-30925 Project: Spark

[jira] [Resolved] (SPARK-30844) Static partition should also follow StoreAssignmentPolicy when insert into table

2020-02-23 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-30844. -- Fix Version/s: 3.0.0 Assignee: wuyi Resolution: Fixed Resolved by 

[jira] [Updated] (SPARK-30822) Pyspark queries fail if terminated with a semicolon

2020-02-23 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-30822: - Flags: (was: Patch) > Pyspark queries fail if terminated with a semicolon >

[jira] [Updated] (SPARK-30822) Pyspark queries fail if terminated with a semicolon

2020-02-23 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-30822: - Labels: (was: easyfix patch pull-request-available) > Pyspark queries fail if