[jira] [Resolved] (SPARK-35358) Set maximum Java heap used for release build

[ https://issues.apache.org/jira/browse/SPARK-35358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35358. --- Fix Version/s: 3.2.0 3.1.2 3.0.3 Resolution: Fix

[jira] [Commented] (SPARK-35088) Accept ANSI intervals by the Sequence expression

[ https://issues.apache.org/jira/browse/SPARK-35088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341794#comment-17341794 ] Apache Spark commented on SPARK-35088: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-35360) Spark make add partition batch size configurable when call RepairTableCommand

[ https://issues.apache.org/jira/browse/SPARK-35360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35360: Assignee: angerszhu > Spark make add partition batch size configurable when call RepairTableComma

[jira] [Resolved] (SPARK-35360) Spark make add partition batch size configurable when call RepairTableCommand

[ https://issues.apache.org/jira/browse/SPARK-35360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35360. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32489 [https://github.com

[jira] [Commented] (SPARK-34246) New type coercion syntax rules in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-34246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341908#comment-17341908 ] Apache Spark commented on SPARK-34246: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-34246) New type coercion syntax rules in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-34246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341909#comment-17341909 ] Apache Spark commented on SPARK-34246: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

[ https://issues.apache.org/jira/browse/SPARK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-34736: -- Assignee: Attila Zsolt Piros > Kubernetes and Minikube version upgrade for in

[jira] [Resolved] (SPARK-34736) Kubernetes and Minikube version upgrade for integration tests

[ https://issues.apache.org/jira/browse/SPARK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-34736. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31829

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342018#comment-17342018 ] Attila Zsolt Piros commented on SPARK-34738: [~shaneknapp] I have merged my

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342024#comment-17342024 ] Shane Knapp commented on SPARK-34738: - sorry i dropped off the radar...  i've been d

[jira] [Commented] (SPARK-34883) Setting CSV reader option "multiLine" to "true" causes URISyntaxException when colon is in file path

[ https://issues.apache.org/jira/browse/SPARK-34883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342031#comment-17342031 ] Brady Tello commented on SPARK-34883: - Update to this thread: I found that if I pro

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes and move to docker 'virtualization' layer

[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342040#comment-17342040 ] Attila Zsolt Piros commented on SPARK-34738: [~shaneknapp] I am sorry to hea

[jira] [Created] (SPARK-35361) Improve performance for ApplyFunctionExpression

Chao Sun created SPARK-35361: Summary: Improve performance for ApplyFunctionExpression Key: SPARK-35361 URL: https://issues.apache.org/jira/browse/SPARK-35361 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-35361) Improve performance for ApplyFunctionExpression

[ https://issues.apache.org/jira/browse/SPARK-35361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-35361: - Priority: Major (was: Minor) > Improve performance for ApplyFunctionExpression > --

[jira] [Updated] (SPARK-35361) Improve performance for ApplyFunctionExpression

[ https://issues.apache.org/jira/browse/SPARK-35361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-35361: - Priority: Minor (was: Major) > Improve performance for ApplyFunctionExpression > --

[jira] [Commented] (SPARK-35353) Cross-building docker images to ARM64 is failing

[ https://issues.apache.org/jira/browse/SPARK-35353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342066#comment-17342066 ] Andy Grove commented on SPARK-35353: The issue seems specific to running on an Ubunt

[jira] [Updated] (SPARK-35353) Cross-building docker images to ARM64 is failing (with Ubuntu host)

[ https://issues.apache.org/jira/browse/SPARK-35353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated SPARK-35353: --- Summary: Cross-building docker images to ARM64 is failing (with Ubuntu host) (was: Cross-building d

[jira] [Created] (SPARK-35362) Update null count in the column stats for UNION stats estimation

shahid created SPARK-35362: -- Summary: Update null count in the column stats for UNION stats estimation Key: SPARK-35362 URL: https://issues.apache.org/jira/browse/SPARK-35362 Project: Spark Issue T

[jira] [Assigned] (SPARK-35362) Update null count in the column stats for UNION stats estimation

[ https://issues.apache.org/jira/browse/SPARK-35362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35362: Assignee: Apache Spark > Update null count in the column stats for UNION stats estimation

[jira] [Commented] (SPARK-35362) Update null count in the column stats for UNION stats estimation

[ https://issues.apache.org/jira/browse/SPARK-35362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342165#comment-17342165 ] Apache Spark commented on SPARK-35362: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-35362) Update null count in the column stats for UNION stats estimation

[ https://issues.apache.org/jira/browse/SPARK-35362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35362: Assignee: (was: Apache Spark) > Update null count in the column stats for UNION stats

[jira] [Commented] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342171#comment-17342171 ] shahid commented on SPARK-35079: Seems It is not reproducible with master branch? +-

[jira] [Comment Edited] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342171#comment-17342171 ] shahid edited comment on SPARK-35079 at 5/10/21, 10:29 PM: --- Se

[jira] [Created] (SPARK-35363) Refactor sort merge join code-gen be agnostic to join type

Cheng Su created SPARK-35363: Summary: Refactor sort merge join code-gen be agnostic to join type Key: SPARK-35363 URL: https://issues.apache.org/jira/browse/SPARK-35363 Project: Spark Issue Type

[jira] [Commented] (SPARK-35363) Refactor sort merge join code-gen be agnostic to join type

[ https://issues.apache.org/jira/browse/SPARK-35363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342175#comment-17342175 ] Apache Spark commented on SPARK-35363: -- User 'c21' has created a pull request for t

[jira] [Assigned] (SPARK-35363) Refactor sort merge join code-gen be agnostic to join type

[ https://issues.apache.org/jira/browse/SPARK-35363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35363: Assignee: Apache Spark > Refactor sort merge join code-gen be agnostic to join type > ---

[jira] [Assigned] (SPARK-35363) Refactor sort merge join code-gen be agnostic to join type

[ https://issues.apache.org/jira/browse/SPARK-35363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35363: Assignee: (was: Apache Spark) > Refactor sort merge join code-gen be agnostic to join

[jira] [Commented] (SPARK-35363) Refactor sort merge join code-gen be agnostic to join type

[ https://issues.apache.org/jira/browse/SPARK-35363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342177#comment-17342177 ] Apache Spark commented on SPARK-35363: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342182#comment-17342182 ] Takeshi Yamamuro commented on SPARK-35079: -- Could you check if branch-3.1 has t

[jira] [Assigned] (SPARK-35207) hash() and other hash builtins do not normalize negative zero

[ https://issues.apache.org/jira/browse/SPARK-35207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35207: Assignee: Apache Spark > hash() and other hash builtins do not normalize negative zero >

[jira] [Commented] (SPARK-35207) hash() and other hash builtins do not normalize negative zero

[ https://issues.apache.org/jira/browse/SPARK-35207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342207#comment-17342207 ] Apache Spark commented on SPARK-35207: -- User 'planga82' has created a pull request

[jira] [Assigned] (SPARK-35207) hash() and other hash builtins do not normalize negative zero

[ https://issues.apache.org/jira/browse/SPARK-35207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35207: Assignee: (was: Apache Spark) > hash() and other hash builtins do not normalize negat

[jira] [Updated] (SPARK-35301) Document migration guide from Koalas to pandas APIs on Spark

[ https://issues.apache.org/jira/browse/SPARK-35301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35301: - Summary: Document migration guide from Koalas to pandas APIs on Spark (was: Document migration

[jira] [Commented] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342230#comment-17342230 ] Takeshi Yamamuro commented on SPARK-35079: -- I've checked it and the issue has a

[jira] [Resolved] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35079. -- Fix Version/s: 3.2.0 3.1.2 Resolution: Fixed > Transform wit

[jira] [Commented] (SPARK-35359) Insert data with char/varchar datatype will fail when data length exceed length limitation

[ https://issues.apache.org/jira/browse/SPARK-35359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342233#comment-17342233 ] YuanGuanhu commented on SPARK-35359: I'd like to work on this. > Insert data with c

[jira] [Resolved] (SPARK-35363) Refactor sort merge join code-gen be agnostic to join type

[ https://issues.apache.org/jira/browse/SPARK-35363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35363. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by

[jira] [Created] (SPARK-35364) Renaming the existing Koalas related codes.

Haejoon Lee created SPARK-35364: --- Summary: Renaming the existing Koalas related codes. Key: SPARK-35364 URL: https://issues.apache.org/jira/browse/SPARK-35364 Project: Spark Issue Type: Sub-tas

[jira] [Commented] (SPARK-35364) Renaming the existing Koalas related codes.

[ https://issues.apache.org/jira/browse/SPARK-35364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342262#comment-17342262 ] Haejoon Lee commented on SPARK-35364: - I'm working on this > Renaming the existing

[jira] [Commented] (SPARK-30186) support Dynamic Partition Pruning in Adaptive Execution

[ https://issues.apache.org/jira/browse/SPARK-30186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342266#comment-17342266 ] weixiuli commented on SPARK-30186: -- https://github.com/apache/spark/pull/31941 > suppo

[jira] [Created] (SPARK-35365) spark3.1.1 use too long to analyze table fields

yao created SPARK-35365: --- Summary: spark3.1.1 use too long to analyze table fields Key: SPARK-35365 URL: https://issues.apache.org/jira/browse/SPARK-35365 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-35366) Avoid using deprecated `buildForBatch` and `buildForStreaming`

Linhong Liu created SPARK-35366: --- Summary: Avoid using deprecated `buildForBatch` and `buildForStreaming` Key: SPARK-35366 URL: https://issues.apache.org/jira/browse/SPARK-35366 Project: Spark

[jira] [Assigned] (SPARK-35366) Avoid using deprecated `buildForBatch` and `buildForStreaming`

[ https://issues.apache.org/jira/browse/SPARK-35366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35366: Assignee: (was: Apache Spark) > Avoid using deprecated `buildForBatch` and `buildForS

[jira] [Assigned] (SPARK-35366) Avoid using deprecated `buildForBatch` and `buildForStreaming`

[ https://issues.apache.org/jira/browse/SPARK-35366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35366: Assignee: Apache Spark > Avoid using deprecated `buildForBatch` and `buildForStreaming` >

[jira] [Commented] (SPARK-35366) Avoid using deprecated `buildForBatch` and `buildForStreaming`

[ https://issues.apache.org/jira/browse/SPARK-35366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342291#comment-17342291 ] Apache Spark commented on SPARK-35366: -- User 'linhongliu-db' has created a pull req

[jira] [Commented] (SPARK-35366) Avoid using deprecated `buildForBatch` and `buildForStreaming`

[ https://issues.apache.org/jira/browse/SPARK-35366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342292#comment-17342292 ] Apache Spark commented on SPARK-35366: -- User 'linhongliu-db' has created a pull req

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342311#comment-17342311 ] Shubham Chaurasia commented on SPARK-34675: --- Thanks for the previous investiga

[jira] [Updated] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shubham Chaurasia updated SPARK-34675: -- Fix Version/s: (was: 3.2.0) > TimeZone inconsistencies when JVM and session timezo

[jira] [Reopened] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shubham Chaurasia reopened SPARK-34675: --- > TimeZone inconsistencies when JVM and session timezones are different > --

[jira] [Comment Edited] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342311#comment-17342311 ] Shubham Chaurasia edited comment on SPARK-34675 at 5/11/21, 5:51 AM: -

[jira] [Comment Edited] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342311#comment-17342311 ] Shubham Chaurasia edited comment on SPARK-34675 at 5/11/21, 5:53 AM: -

[jira] [Commented] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342341#comment-17342341 ] Paul Praet commented on SPARK-12837: Seeing the same issue on Spark 2.4.6. Excessive

[jira] [Created] (SPARK-35367) Window group-key and pandas inconsistent

Sebastian Eckweiler created SPARK-35367: --- Summary: Window group-key and pandas inconsistent Key: SPARK-35367 URL: https://issues.apache.org/jira/browse/SPARK-35367 Project: Spark Issue

[jira] [Updated] (SPARK-35367) Window group-key and pandas inconsistent

[ https://issues.apache.org/jira/browse/SPARK-35367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Eckweiler updated SPARK-35367: Description: Not completely sure whether this is a bug or a configuration/usage is