[jira] [Closed] (SPARK-34895) Stay the same value of _canonicalized when reusing query stage

2021-03-28 Thread Xuedong Luan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuedong Luan closed SPARK-34895. The latest code have resolved this issue  > Stay the same value of _canonicalized when reusing query

[jira] [Resolved] (SPARK-34895) Stay the same value of _canonicalized when reusing query stage

2021-03-28 Thread Xuedong Luan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuedong Luan resolved SPARK-34895. -- Resolution: Not A Bug > Stay the same value of _canonicalized when reusing query stage > -

[jira] [Assigned] (SPARK-34894) Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout`

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34894: Assignee: (was: Apache Spark) > Use 'io.connectionTimeout' as a hint instead of `spar

[jira] [Commented] (SPARK-34894) Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout`

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310441#comment-17310441 ] Apache Spark commented on SPARK-34894: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-34894) Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout`

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34894: Assignee: Apache Spark > Use 'io.connectionTimeout' as a hint instead of `spark.network.t

[jira] [Updated] (SPARK-34895) Stay the same value of _canonicalized when reusing query stage

2021-03-28 Thread Xuedong Luan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuedong Luan updated SPARK-34895: - Summary: Stay the same value of _canonicalized when reusing query stage (was: The value of _can

[jira] [Created] (SPARK-34895) The value of _canonicalized in QueryStageExec which is created by reused should be same with the original QueryStageExec

2021-03-28 Thread Xuedong Luan (Jira)
Xuedong Luan created SPARK-34895: Summary: The value of _canonicalized in QueryStageExec which is created by reused should be same with the original QueryStageExec Key: SPARK-34895 URL: https://issues.apache.org/j

[jira] [Created] (SPARK-34894) Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout`

2021-03-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-34894: Summary: Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout` Key: SPARK-34894 URL: https://issues.apache.org/jira/browse/SPARK-34894 Project: Spark

[jira] [Updated] (SPARK-33747) Avoid calling unregisterMapOutput when the map stage is being rerunning.

2021-03-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33747: Fix Version/s: (was: 3.0.1) (was: 2.4.5) > Avoid calling unregisterMapO

[jira] [Resolved] (SPARK-34879) Hive inspect support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34879. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31979 [https://github.com

[jira] [Assigned] (SPARK-34879) Hive inspect support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-34879: Assignee: angerszhu > Hive inspect support DayTimeIntervalType and YearMonthIntervalType > --

[jira] [Commented] (SPARK-34891) Introduce state store manager for session window in streaming query

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310415#comment-17310415 ] Apache Spark commented on SPARK-34891: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-34891) Introduce state store manager for session window in streaming query

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34891: Assignee: (was: Apache Spark) > Introduce state store manager for session window in s

[jira] [Assigned] (SPARK-34891) Introduce state store manager for session window in streaming query

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34891: Assignee: Apache Spark > Introduce state store manager for session window in streaming qu

[jira] [Commented] (SPARK-34891) Introduce state store manager for session window in streaming query

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310414#comment-17310414 ] Apache Spark commented on SPARK-34891: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-34855) SparkContext - avoid using local lazy val

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310409#comment-17310409 ] Apache Spark commented on SPARK-34855: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-34889) Introduce MergingSessionsIterator merging elements directly which belong to the same session

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34889: Assignee: (was: Apache Spark) > Introduce MergingSessionsIterator merging elements di

[jira] [Commented] (SPARK-34889) Introduce MergingSessionsIterator merging elements directly which belong to the same session

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310402#comment-17310402 ] Apache Spark commented on SPARK-34889: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-34889) Introduce MergingSessionsIterator merging elements directly which belong to the same session

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310401#comment-17310401 ] Apache Spark commented on SPARK-34889: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-34889) Introduce MergingSessionsIterator merging elements directly which belong to the same session

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34889: Assignee: Apache Spark > Introduce MergingSessionsIterator merging elements directly whic

[jira] [Commented] (SPARK-34888) Introduce UpdatingSessionIterator adjusting session information on elements

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310393#comment-17310393 ] Apache Spark commented on SPARK-34888: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-34888) Introduce UpdatingSessionIterator adjusting session information on elements

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34888: Assignee: (was: Apache Spark) > Introduce UpdatingSessionIterator adjusting session i

[jira] [Assigned] (SPARK-34888) Introduce UpdatingSessionIterator adjusting session information on elements

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34888: Assignee: Apache Spark > Introduce UpdatingSessionIterator adjusting session information

[jira] [Commented] (SPARK-34888) Introduce UpdatingSessionIterator adjusting session information on elements

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310392#comment-17310392 ] Apache Spark commented on SPARK-34888: -- User 'HeartSaVioR' has created a pull reque

[jira] [Created] (SPARK-34893) Support native session window

2021-03-28 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-34893: Summary: Support native session window Key: SPARK-34893 URL: https://issues.apache.org/jira/browse/SPARK-34893 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34892) Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-03-28 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-34892: Summary: Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently Key: SPARK-34892 URL: https://issues.apache.org/jira/browse/SPARK-348

[jira] [Commented] (SPARK-34860) Multinomial Logistic Regression with intercept support centering

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310360#comment-17310360 ] Apache Spark commented on SPARK-34860: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-34860) Multinomial Logistic Regression with intercept support centering

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34860: Assignee: (was: Apache Spark) > Multinomial Logistic Regression with intercept suppor

[jira] [Assigned] (SPARK-34860) Multinomial Logistic Regression with intercept support centering

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34860: Assignee: Apache Spark > Multinomial Logistic Regression with intercept support centering

[jira] [Commented] (SPARK-34860) Multinomial Logistic Regression with intercept support centering

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310359#comment-17310359 ] Apache Spark commented on SPARK-34860: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-34891) Introduce state store manager for session window in streaming query

2021-03-28 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-34891: Summary: Introduce state store manager for session window in streaming query Key: SPARK-34891 URL: https://issues.apache.org/jira/browse/SPARK-34891 Project: Spark

[jira] [Created] (SPARK-34890) Integrate Koalas main API code into PySpark

2021-03-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-34890: --- Summary: Integrate Koalas main API code into PySpark Key: SPARK-34890 URL: https://issues.apache.org/jira/browse/SPARK-34890 Project: Spark Issue Type: Sub-tas

[jira] [Created] (SPARK-34889) Introduce MergingSessionsIterator merging elements directly which belong to the same session

2021-03-28 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-34889: Summary: Introduce MergingSessionsIterator merging elements directly which belong to the same session Key: SPARK-34889 URL: https://issues.apache.org/jira/browse/SPARK-34889

[jira] [Created] (SPARK-34888) Introduce UpdatingSessionIterator adjusting session information on elements

2021-03-28 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-34888: Summary: Introduce UpdatingSessionIterator adjusting session information on elements Key: SPARK-34888 URL: https://issues.apache.org/jira/browse/SPARK-34888 Project:

[jira] [Assigned] (SPARK-34814) LikeSimplification should handle NULL

2021-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34814: Assignee: angerszhu > LikeSimplification should handle NULL > ---

[jira] [Resolved] (SPARK-34814) LikeSimplification should handle NULL

2021-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34814. -- Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-34887) Integrate Koala dependencies into PySpark

2021-03-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-34887: --- Summary: Integrate Koala dependencies into PySpark Key: SPARK-34887 URL: https://issues.apache.org/jira/browse/SPARK-34887 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34886) Integrate Koalas tests into PySpark

2021-03-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-34886: --- Summary: Integrate Koalas tests into PySpark Key: SPARK-34886 URL: https://issues.apache.org/jira/browse/SPARK-34886 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-34876) Non-nullable aggregates can return NULL in a correlated subquery

2021-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34876: Assignee: Tanel Kiis > Non-nullable aggregates can return NULL in a correlated subquery >

[jira] [Resolved] (SPARK-34876) Non-nullable aggregates can return NULL in a correlated subquery

2021-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34876. -- Fix Version/s: 3.0.3 3.1.2 2.4.8 3.2.0

[jira] [Created] (SPARK-34885) Integrate Koalas documentation into PySpark

2021-03-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-34885: --- Summary: Integrate Koalas documentation into PySpark Key: SPARK-34885 URL: https://issues.apache.org/jira/browse/SPARK-34885 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-34819) MapType supports orderable semantics

2021-03-28 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34819: - Affects Version/s: 3.1.2 3.2.0 > MapType supports orderable seman

[jira] [Commented] (SPARK-34819) MapType supports orderable semantics

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310329#comment-17310329 ] Apache Spark commented on SPARK-34819: -- User 'WangGuangxin' has created a pull requ

[jira] [Updated] (SPARK-34819) MapType supports orderable semantics

2021-03-28 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34819: - Priority: Major (was: Minor) > MapType supports orderable semantics > -

[jira] [Assigned] (SPARK-34819) MapType supports orderable semantics

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34819: Assignee: (was: Apache Spark) > MapType supports orderable semantics > --

[jira] [Assigned] (SPARK-34819) MapType supports orderable semantics

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34819: Assignee: Apache Spark > MapType supports orderable semantics > -

[jira] [Assigned] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34884: Assignee: (was: Apache Spark) > Improve dynamic partition pruning evaluation > --

[jira] [Assigned] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34884: Assignee: Apache Spark > Improve dynamic partition pruning evaluation > -

[jira] [Commented] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310316#comment-17310316 ] Apache Spark commented on SPARK-34884: -- User 'wangyum' has created a pull request f

[jira] [Created] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-03-28 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-34884: --- Summary: Improve dynamic partition pruning evaluation Key: SPARK-34884 URL: https://issues.apache.org/jira/browse/SPARK-34884 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-34843) JDBCRelation columnPartition function improperly determines stride size. Upper bound is skewed due to stride alignment.

2021-03-28 Thread Jason Yarbrough (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Yarbrough updated SPARK-34843: Summary: JDBCRelation columnPartition function improperly determines stride size. Upper bo

[jira] [Issue Comment Deleted] (SPARK-26399) Define query parameters to support various filtering conditions in REST API for overall stages

2021-03-28 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-26399: --- Comment: was deleted (was: Hi [~Baohe Zhang] , This ticket proposes a new REST API:  http://:18080/api/v1/a

[jira] [Assigned] (SPARK-34882) RewriteDistinctAggregates can cause a bug if the aggregator does not ignore NULLs

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34882: Assignee: (was: Apache Spark) > RewriteDistinctAggregates can cause a bug if the aggr

[jira] [Commented] (SPARK-34882) RewriteDistinctAggregates can cause a bug if the aggregator does not ignore NULLs

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310285#comment-17310285 ] Apache Spark commented on SPARK-34882: -- User 'tanelk' has created a pull request fo

[jira] [Assigned] (SPARK-34882) RewriteDistinctAggregates can cause a bug if the aggregator does not ignore NULLs

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34882: Assignee: Apache Spark > RewriteDistinctAggregates can cause a bug if the aggregator does

[jira] [Updated] (SPARK-34883) Setting CSV reader option "multiLine" to "true" causes URISyntaxException when colon is in file path

2021-03-28 Thread Brady Tello (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brady Tello updated SPARK-34883: Description: Setting the CSV reader's "multiLine" option to "True" throws the following exception

[jira] [Updated] (SPARK-34883) Setting CSV reader option "multiLine" to "true" causes URISyntaxException when colon is in file path

2021-03-28 Thread Brady Tello (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brady Tello updated SPARK-34883: Description: Setting the CSV reader's "multiLine" option to "True" throws the following exception

[jira] [Created] (SPARK-34883) Setting CSV reader option "multiLine" to "true" causes URISyntaxException when colon is in file path

2021-03-28 Thread Brady Tello (Jira)
Brady Tello created SPARK-34883: --- Summary: Setting CSV reader option "multiLine" to "true" causes URISyntaxException when colon is in file path Key: SPARK-34883 URL: https://issues.apache.org/jira/browse/SPARK-34883

[jira] [Updated] (SPARK-34882) RewriteDistinctAggregates can cause a bug if the aggregator does not ignore NULLs

2021-03-28 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-34882: --- Description: {code:title=group-by.sql} SELECT first(DISTINCT a), last(DISTINCT a), first(a),

[jira] [Created] (SPARK-34882) RewriteDistinctAggregates can cause a bug if the aggregator does not ignore NULLs

2021-03-28 Thread Tanel Kiis (Jira)
Tanel Kiis created SPARK-34882: -- Summary: RewriteDistinctAggregates can cause a bug if the aggregator does not ignore NULLs Key: SPARK-34882 URL: https://issues.apache.org/jira/browse/SPARK-34882 Project

[jira] [Commented] (SPARK-34843) JDBCRelation columnPartition function improperly determines stride size. Upper bound is skewed do to stride alignment.

2021-03-28 Thread Jason Yarbrough (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310273#comment-17310273 ] Jason Yarbrough commented on SPARK-34843: - [~dongjoon], that makes sense. Thank

[jira] [Resolved] (SPARK-34843) JDBCRelation columnPartition function improperly determines stride size. Upper bound is skewed do to stride alignment.

2021-03-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34843. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31965 [https://gi

[jira] [Assigned] (SPARK-34843) JDBCRelation columnPartition function improperly determines stride size. Upper bound is skewed do to stride alignment.

2021-03-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34843: Assignee: Jason Yarbrough > JDBCRelation columnPartition function improperly determines s

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310268#comment-17310268 ] Dongjoon Hyun commented on SPARK-34674: --- Could you make a PR to the Apache Spark r

[jira] [Resolved] (SPARK-34829) transform_values return identical values when it's used with udf that returns reference type

2021-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34829. --- Fix Version/s: 3.1.2 3.2.0 Assignee: Peter Toth Resolution

[jira] [Resolved] (SPARK-34869) Extend k8s "EXTRA LOGS FOR THE FAILED TEST" section with describe pods output

2021-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34869. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31962 [https://

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-03-28 Thread Sergey Kotlov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310235#comment-17310235 ] Sergey Kotlov commented on SPARK-34674: --- Thanks for looking into this problem, [~d

[jira] [Commented] (SPARK-34843) JDBCRelation columnPartition function improperly determines stride size. Upper bound is skewed do to stride alignment.

2021-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310234#comment-17310234 ] Dongjoon Hyun commented on SPARK-34843: --- Thank you for the suggestion and PR, [~ha

[jira] [Updated] (SPARK-34843) JDBCRelation columnPartition function improperly determines stride size. Upper bound is skewed do to stride alignment.

2021-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34843: -- Affects Version/s: (was: 3.12) (was: 3.0.3)

[jira] [Assigned] (SPARK-34881) New SQL Function: TRY_CAST

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34881: Assignee: Apache Spark (was: Gengliang Wang) > New SQL Function: TRY_CAST >

[jira] [Assigned] (SPARK-34881) New SQL Function: TRY_CAST

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34881: Assignee: Gengliang Wang (was: Apache Spark) > New SQL Function: TRY_CAST >

[jira] [Commented] (SPARK-34881) New SQL Function: TRY_CAST

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310211#comment-17310211 ] Apache Spark commented on SPARK-34881: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-34881) New SQL Function: TRY_CAST

2021-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310212#comment-17310212 ] Apache Spark commented on SPARK-34881: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-34881) New SQL Function: TRY_CAST

2021-03-28 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-34881: -- Summary: New SQL Function: TRY_CAST Key: SPARK-34881 URL: https://issues.apache.org/jira/browse/SPARK-34881 Project: Spark Issue Type: New Feature