[jira] [Created] (SPARK-31729) flaky test: org.apache.spark.sql.kafka010.KafkaRelationSuiteV2

2020-05-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31729: --- Summary: flaky test: org.apache.spark.sql.kafka010.KafkaRelationSuiteV2 Key: SPARK-31729 URL: https://issues.apache.org/jira/browse/SPARK-31729 Project: Spark

[jira] [Created] (SPARK-31728) flaky test: org.apache.spark.streaming.StreamingContextSuite

2020-05-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31728: --- Summary: flaky test: org.apache.spark.streaming.StreamingContextSuite Key: SPARK-31728 URL: https://issues.apache.org/jira/browse/SPARK-31728 Project: Spark

[jira] [Updated] (SPARK-31722) flaky test: org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31722: Description:

[jira] [Updated] (SPARK-31722) flaky test: org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31722: Summary: flaky test: org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite (was: flaky

[jira] [Updated] (SPARK-31723) flaky test: org.apache.spark.deploy.history.HistoryServerSuite

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31723: Description: HistoryServerSuite.static relative links are prefixed with uiRoot

[jira] [Updated] (SPARK-31723) flaky test: org.apache.spark.deploy.history.HistoryServerSuite

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31723: Summary: flaky test: org.apache.spark.deploy.history.HistoryServerSuite (was: flaky test:

[jira] [Resolved] (SPARK-31663) Grouping sets with having clause returns the wrong result

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31663. - Fix Version/s: 2.4.7 3.0.0 Assignee: Yuanjian Li Resolution:

[jira] [Commented] (SPARK-31393) Show the correct alias in schema for expression

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108831#comment-17108831 ] Apache Spark commented on SPARK-31393: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-31393) Show the correct alias in schema for expression

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108832#comment-17108832 ] Apache Spark commented on SPARK-31393: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-31235) Separates different categories of applications

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108810#comment-17108810 ] Apache Spark commented on SPARK-31235: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-31235) Separates different categories of applications

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108809#comment-17108809 ] Apache Spark commented on SPARK-31235: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-26908) Fix toMillis

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-26908: - Fix Version/s: (was: 2.4.7) 2.4.6 > Fix toMillis > > >

[jira] [Updated] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31456: - Fix Version/s: (was: 2.4.7) 2.4.6 > If shutdownhook is added with

[jira] [Updated] (SPARK-31676) QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0)

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31676: - Fix Version/s: (was: 2.4.7) 2.4.6 > QuantileDiscretizer raise error

[jira] [Updated] (SPARK-31671) Wrong error message in VectorAssembler when column lengths can not be inferred

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31671: - Fix Version/s: (was: 2.4.7) 2.4.6 > Wrong error message in

[jira] [Updated] (SPARK-31632) The ApplicationInfo in KVStore may be accessed before it's prepared

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31632: - Fix Version/s: (was: 2.4.7) 2.4.6 > The ApplicationInfo in KVStore may

[jira] [Updated] (SPARK-31722) flaky streaming tests

2020-05-15 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-31722: - Component/s: (was: Structured Streaming) DStreams > flaky streaming tests

[jira] [Assigned] (SPARK-31727) Inconsistent error messages of casting timestamp to int

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31727: Assignee: Apache Spark > Inconsistent error messages of casting timestamp to int >

[jira] [Assigned] (SPARK-31727) Inconsistent error messages of casting timestamp to int

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31727: Assignee: (was: Apache Spark) > Inconsistent error messages of casting timestamp to

[jira] [Commented] (SPARK-31727) Inconsistent error messages of casting timestamp to int

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108656#comment-17108656 ] Apache Spark commented on SPARK-31727: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-31727) Inconsistent error messages of casting timestamp to int

2020-05-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31727: -- Summary: Inconsistent error messages of casting timestamp to int Key: SPARK-31727 URL: https://issues.apache.org/jira/browse/SPARK-31727 Project: Spark Issue

[jira] [Updated] (SPARK-31712) Check casting timestamps to byte/short/int/long before 1970-01-01

2020-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31712: -- Fix Version/s: 2.4.6 > Check casting timestamps to byte/short/int/long before 1970-01-01 >

[jira] [Comment Edited] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

2020-05-15 Thread Sudharshann D. (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107609#comment-17107609 ] Sudharshann D. edited comment on SPARK-31579 at 5/15/20, 7:47 PM: -- Just

[jira] [Created] (SPARK-31726) Make spark.files available in driver with cluster deploy mode on kubernetes

2020-05-15 Thread koert kuipers (Jira)
koert kuipers created SPARK-31726: - Summary: Make spark.files available in driver with cluster deploy mode on kubernetes Key: SPARK-31726 URL: https://issues.apache.org/jira/browse/SPARK-31726

[jira] [Commented] (SPARK-31725) Set America/Los_Angeles time zone and Locale.US by default

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108577#comment-17108577 ] Apache Spark commented on SPARK-31725: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31725) Set America/Los_Angeles time zone and Locale.US by default

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31725: Assignee: Apache Spark > Set America/Los_Angeles time zone and Locale.US by default >

[jira] [Commented] (SPARK-31725) Set America/Los_Angeles time zone and Locale.US by default

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108578#comment-17108578 ] Apache Spark commented on SPARK-31725: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31725) Set America/Los_Angeles time zone and Locale.US by default

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31725: Assignee: (was: Apache Spark) > Set America/Los_Angeles time zone and Locale.US by

[jira] [Created] (SPARK-31725) Set America/Los_Angeles time zone and Locale.US by default

2020-05-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31725: -- Summary: Set America/Los_Angeles time zone and Locale.US by default Key: SPARK-31725 URL: https://issues.apache.org/jira/browse/SPARK-31725 Project: Spark Issue

[jira] [Comment Edited] (SPARK-31724) Improve the output mode for structured streaming

2020-05-15 Thread Xingcan Cui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108513#comment-17108513 ] Xingcan Cui edited comment on SPARK-31724 at 5/15/20, 6:02 PM: --- Copy some

[jira] [Commented] (SPARK-31724) Improve the output mode for structured streaming

2020-05-15 Thread Xingcan Cui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108513#comment-17108513 ] Xingcan Cui commented on SPARK-31724: - Copy some comments from 

[jira] [Created] (SPARK-31724) Improve the output mode for structured streaming

2020-05-15 Thread Xingcan Cui (Jira)
Xingcan Cui created SPARK-31724: --- Summary: Improve the output mode for structured streaming Key: SPARK-31724 URL: https://issues.apache.org/jira/browse/SPARK-31724 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31722) flaky streaming tests

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108430#comment-17108430 ] Wenchen Fan commented on SPARK-31722: - cc [~kabhwan] > flaky streaming tests >

[jira] [Created] (SPARK-31723) flaky test: org.apache.spark.deploy.history.HistoryServerSuite.proxyBase

2020-05-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31723: --- Summary: flaky test: org.apache.spark.deploy.history.HistoryServerSuite.proxyBase Key: SPARK-31723 URL: https://issues.apache.org/jira/browse/SPARK-31723 Project:

[jira] [Updated] (SPARK-31722) flaky streaming tests

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31722: Description: org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite.offset recovery

[jira] [Created] (SPARK-31722) flaky streaming tests

2020-05-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31722: --- Summary: flaky streaming tests Key: SPARK-31722 URL: https://issues.apache.org/jira/browse/SPARK-31722 Project: Spark Issue Type: Test Components:

[jira] [Resolved] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31620. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28496

[jira] [Assigned] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31620: --- Assignee: wuyi > TreeNodeException: Binding attribute, tree: sum#19L >

[jira] [Resolved] (SPARK-26111) Support ANOVA F-value between label/feature for the continuous distribution feature selection

2020-05-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-26111. -- Fix Version/s: 3.1.0 Assignee: Huaxin Gao Resolution: Done > Support ANOVA

[jira] [Resolved] (SPARK-31708) Add docs and examples for ANOVASelector and FValueSelector

2020-05-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31708. -- Fix Version/s: 3.1.0 Assignee: Huaxin Gao Resolution: Fixed Resolved by

[jira] [Assigned] (SPARK-30090) Update REPL for 2.13

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30090: Assignee: Apache Spark > Update REPL for 2.13 > > >

[jira] [Commented] (SPARK-30090) Update REPL for 2.13

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108337#comment-17108337 ] Apache Spark commented on SPARK-30090: -- User 'karolchmist' has created a pull request for this

[jira] [Assigned] (SPARK-30090) Update REPL for 2.13

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30090: Assignee: (was: Apache Spark) > Update REPL for 2.13 > > >

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2020-05-15 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108310#comment-17108310 ] Guillaume Martres commented on SPARK-25075: --- I've found what seems to be a miscompilation

[jira] [Commented] (SPARK-31387) HiveThriftServer2Listener update methods fail with unknown operation/session id

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108295#comment-17108295 ] Apache Spark commented on SPARK-31387: -- User 'alismess-db' has created a pull request for this

[jira] [Commented] (SPARK-31721) Assert optimized plan is initialized before tracking the execution of planning

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108223#comment-17108223 ] Apache Spark commented on SPARK-31721: -- User 'dbaliafroozeh' has created a pull request for this

[jira] [Assigned] (SPARK-31721) Assert optimized plan is initialized before tracking the execution of planning

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31721: Assignee: Apache Spark > Assert optimized plan is initialized before tracking the

[jira] [Commented] (SPARK-31721) Assert optimized plan is initialized before tracking the execution of planning

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108221#comment-17108221 ] Apache Spark commented on SPARK-31721: -- User 'dbaliafroozeh' has created a pull request for this

[jira] [Assigned] (SPARK-31721) Assert optimized plan is initialized before tracking the execution of planning

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31721: Assignee: (was: Apache Spark) > Assert optimized plan is initialized before tracking

[jira] [Updated] (SPARK-31721) Assert optimized plan is initialized before tracking the execution of planning

2020-05-15 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-31721: - Description: The {{QueryPlanningTracker}} in {{QueryExeuction}} reports the planning time that

[jira] [Created] (SPARK-31721) Assert optimized plan is initialized before tracking the execution of planning

2020-05-15 Thread Ali Afroozeh (Jira)
Ali Afroozeh created SPARK-31721: Summary: Assert optimized plan is initialized before tracking the execution of planning Key: SPARK-31721 URL: https://issues.apache.org/jira/browse/SPARK-31721

[jira] [Commented] (SPARK-31712) Check casting timestamps to byte/short/int/long before 1970-01-01

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108203#comment-17108203 ] Apache Spark commented on SPARK-31712: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31720) TaskMemoryManager allocate failed

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31720: Assignee: Apache Spark > TaskMemoryManager allocate failed >

[jira] [Assigned] (SPARK-31720) TaskMemoryManager allocate failed

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31720: Assignee: (was: Apache Spark) > TaskMemoryManager allocate failed >

[jira] [Commented] (SPARK-31719) Refactor JoinSelection

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108181#comment-17108181 ] Apache Spark commented on SPARK-31719: -- User 'dbaliafroozeh' has created a pull request for this

[jira] [Assigned] (SPARK-31719) Refactor JoinSelection

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31719: Assignee: Apache Spark > Refactor JoinSelection > -- > >

[jira] [Assigned] (SPARK-31719) Refactor JoinSelection

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31719: Assignee: (was: Apache Spark) > Refactor JoinSelection > -- > >

[jira] [Created] (SPARK-31720) TaskMemoryManager allocate failed

2020-05-15 Thread angerszhu (Jira)
angerszhu created SPARK-31720: - Summary: TaskMemoryManager allocate failed Key: SPARK-31720 URL: https://issues.apache.org/jira/browse/SPARK-31720 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-31719) Refactor JoinSelection

2020-05-15 Thread Ali Afroozeh (Jira)
Ali Afroozeh created SPARK-31719: Summary: Refactor JoinSelection Key: SPARK-31719 URL: https://issues.apache.org/jira/browse/SPARK-31719 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-31718) DataSourceV2 unexpected behavior with partition data distribution

2020-05-15 Thread Serhii (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii updated SPARK-31718: --- Description: Hi team,   We are using DataSourceV2.   We have a queston regarding using interface

[jira] [Commented] (SPARK-31405) fail by default when read/write datetime values and not sure if they need rebase or not

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108120#comment-17108120 ] Apache Spark commented on SPARK-31405: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-31718) DataSourceV2 unexpected behavior with partition data distribution

2020-05-15 Thread Serhii (Jira)
Serhii created SPARK-31718: -- Summary: DataSourceV2 unexpected behavior with partition data distribution Key: SPARK-31718 URL: https://issues.apache.org/jira/browse/SPARK-31718 Project: Spark

[jira] [Commented] (SPARK-31526) Add a new test suite for ExperssionInfo

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108100#comment-17108100 ] Apache Spark commented on SPARK-31526: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31526) Add a new test suite for ExperssionInfo

2020-05-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108093#comment-17108093 ] Apache Spark commented on SPARK-31526: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-31684) Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31684: Priority: Major (was: Blocker) > Overwrite partition failed with 'WRONG FS' when the target

[jira] [Commented] (SPARK-31684) Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108074#comment-17108074 ] Wenchen Fan commented on SPARK-31684: - This is not a new bug in 3.0, and shouldn't be marked as a

[jira] [Updated] (SPARK-31675) Fail to insert data to a table with remote location which causes by hive encryption check

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31675: Priority: Major (was: Blocker) > Fail to insert data to a table with remote location which

[jira] [Commented] (SPARK-31675) Fail to insert data to a table with remote location which causes by hive encryption check

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108073#comment-17108073 ] Wenchen Fan commented on SPARK-31675: - This is not a new bug in 3.0, and shouldn't be marked as

[jira] [Resolved] (SPARK-31682) Turn on spark.sql.legacy.createHiveTableByDefault.enabled by default

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31682. - Resolution: Invalid will do https://issues.apache.org/jira/browse/SPARK-31707 instead. > Turn

[jira] [Comment Edited] (SPARK-31714) Performance test on java vectorization vs dot vs gemv vs gemm

2020-05-15 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108018#comment-17108018 ] zhengruifeng edited comment on SPARK-31714 at 5/15/20, 7:33 AM:

[jira] [Commented] (SPARK-31686) Return of String instead of array in function get_json_object

2020-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108024#comment-17108024 ] Hyukjin Kwon commented on SPARK-31686: -- Please don't reopen the JIRA. {{get_json_object}} doesn't

[jira] [Commented] (SPARK-31714) Performance test on java vectorization vs dot vs gemv vs gemm

2020-05-15 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108018#comment-17108018 ] zhengruifeng commented on SPARK-31714: -- additionally test on impl of gemv: {code:java}

[jira] [Resolved] (SPARK-31716) Use a fallback version in HiveExternalCatalogVersionsSuite

2020-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31716. --- Fix Version/s: 3.0.0 2.4.6 Resolution: Fixed Issue resolved by

[jira] [Resolved] (SPARK-31686) Return of String instead of array in function get_json_object

2020-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31686. -- Resolution: Not A Problem > Return of String instead of array in function get_json_object >

[jira] [Assigned] (SPARK-31716) Use a fallback version in HiveExternalCatalogVersionsSuite

2020-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31716: - Assignee: Dongjoon Hyun > Use a fallback version in HiveExternalCatalogVersionsSuite >

[jira] [Assigned] (SPARK-31715) Fix flaky SparkSQLEnvSuite that sometimes varies single derby instance standard

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31715: --- Assignee: Kent Yao > Fix flaky SparkSQLEnvSuite that sometimes varies single derby

[jira] [Resolved] (SPARK-31715) Fix flaky SparkSQLEnvSuite that sometimes varies single derby instance standard

2020-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31715. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28537