[jira] [Commented] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597548#comment-17597548 ] Apache Spark commented on SPARK-40270: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40270: Assignee: Apache Spark > Make compute.max_rows as None working in DataFrame.style >

[jira] [Commented] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597546#comment-17597546 ] Apache Spark commented on SPARK-40270: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40270: Assignee: (was: Apache Spark) > Make compute.max_rows as None working in

[jira] [Commented] (SPARK-39616) Upgrade Breeze to 2.0

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597543#comment-17597543 ] Apache Spark commented on SPARK-39616: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-39616) Upgrade Breeze to 2.0

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597544#comment-17597544 ] Apache Spark commented on SPARK-39616: -- User 'zhengruifeng' has created a pull request for this

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

2022-08-29 Thread Pankaj Nagla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:39 AM: --- Thank you

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

2022-08-29 Thread Pankaj Nagla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:38 AM: --- Thank you

[jira] [Assigned] (SPARK-40269) Randomize the orders of peer in BlockManagerDecommissioner

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40269: Assignee: (was: Apache Spark) > Randomize the orders of peer in

[jira] [Commented] (SPARK-40269) Randomize the orders of peer in BlockManagerDecommissioner

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597542#comment-17597542 ] Apache Spark commented on SPARK-40269: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-40269) Randomize the orders of peer in BlockManagerDecommissioner

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40269: Assignee: Apache Spark > Randomize the orders of peer in BlockManagerDecommissioner >

[jira] [Created] (SPARK-40270) Support compute.max_rows as None in DataFrame.style

2022-08-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-40270: Summary: Support compute.max_rows as None in DataFrame.style Key: SPARK-40270 URL: https://issues.apache.org/jira/browse/SPARK-40270 Project: Spark Issue

[jira] [Updated] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40270: - Fix Version/s: 3.1.4 3.4.0 3.3.1 3.2.3

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

2022-08-29 Thread Pankaj Nagla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:34 AM: --- Thank you

[jira] [Updated] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40270: - Priority: Minor (was: Major) > Make compute.max_rows as None working in DataFrame.style >

[jira] [Updated] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40270: - Summary: Make compute.max_rows as None working in DataFrame.style (was: Support

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

2022-08-29 Thread Pankaj Nagla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:32 AM: --- Thank you

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

2022-08-29 Thread Pankaj Nagla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:32 AM: --- Thank you

[jira] [Created] (SPARK-40269) Randomize the orders of peer in BlockManagerDecommissioner

2022-08-29 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-40269: Summary: Randomize the orders of peer in BlockManagerDecommissioner Key: SPARK-40269 URL: https://issues.apache.org/jira/browse/SPARK-40269 Project: Spark

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

2022-08-29 Thread Pankaj Nagla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:31 AM: --- Thank you

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

2022-08-29 Thread Pankaj Nagla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:29 AM: --- Thank you

[jira] [Commented] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

2022-08-29 Thread Pankaj Nagla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597539#comment-17597539 ] Pankaj Nagla commented on SPARK-22588: -- Thank you for sharing the information. [Vlocity Salesforce

[jira] [Commented] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

2022-08-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597537#comment-17597537 ] BingKun Pan commented on SPARK-40056: - I will fix it. > Upgrade mvn-scalafmt from 1.0.4 to

[jira] [Updated] (SPARK-39971) ANALYZE TABLE makes some queries run forever

2022-08-29 Thread Felipe (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felipe updated SPARK-39971: --- Attachment: explainMode-cost.zip > ANALYZE TABLE makes some queries run forever >

[jira] [Commented] (SPARK-39971) ANALYZE TABLE makes some queries run forever

2022-08-29 Thread Felipe (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597528#comment-17597528 ] Felipe commented on SPARK-39971: [~yumwang] I uploaded the plans > ANALYZE TABLE makes some queries run

[jira] [Resolved] (SPARK-34777) [UI] StagePage input size/records not show when records greater than zero

2022-08-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-34777. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35498

[jira] [Assigned] (SPARK-34777) [UI] StagePage input size/records not show when records greater than zero

2022-08-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-34777: --- Assignee: Zhongwei Zhu > [UI] StagePage input size/records not show when records greater

[jira] [Assigned] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40056: Assignee: (was: Apache Spark) > Upgrade mvn-scalafmt from 1.0.4 to

[jira] [Assigned] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40056: Assignee: Apache Spark > Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9 >

[jira] [Updated] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40056: - Fix Version/s: (was: 3.4.0) > Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9 >

[jira] [Reopened] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-40056: -- Assignee: (was: BingKun Pan) > Upgrade mvn-scalafmt from 1.0.4 to

[jira] [Commented] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597512#comment-17597512 ] Hyukjin Kwon commented on SPARK-40056: -- Reverted in

[jira] [Resolved] (SPARK-40221) Not able to format using scalafmt

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40221. -- Fix Version/s: 3.4.0 Assignee: Hyukjin Kwon Resolution: Fixed > Not able to

[jira] [Commented] (SPARK-40221) Not able to format using scalafmt

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597511#comment-17597511 ] Hyukjin Kwon commented on SPARK-40221: -- Fixed in

[jira] [Commented] (SPARK-40221) Not able to format using scalafmt

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597509#comment-17597509 ] Hyukjin Kwon commented on SPARK-40221: -- Seems like SPARK-40056 caused this. I am reverting that

[jira] [Created] (SPARK-40268) Test decimal128 in UDF

2022-08-29 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-40268: -- Summary: Test decimal128 in UDF Key: SPARK-40268 URL: https://issues.apache.org/jira/browse/SPARK-40268 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-40253) Data read exception in orc format

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597500#comment-17597500 ] Hyukjin Kwon commented on SPARK-40253: -- Is this still an issue in Spark 3.1+? Spark 2.4.x is EOL >

[jira] [Resolved] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40258. -- Resolution: Duplicate > Spark does not support pagination > -

[jira] [Commented] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597498#comment-17597498 ] Hyukjin Kwon commented on SPARK-40258: -- We support it now, see SPARK-28330 > Spark does not

[jira] [Created] (SPARK-40267) Add description for ExecutorAllocationManager metrics

2022-08-29 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-40267: Summary: Add description for ExecutorAllocationManager metrics Key: SPARK-40267 URL: https://issues.apache.org/jira/browse/SPARK-40267 Project: Spark Issue

[jira] [Assigned] (SPARK-40257) Remove since usage in streaming/query.py and window.py

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40257: Assignee: Hyukjin Kwon > Remove since usage in streaming/query.py and window.py >

[jira] [Resolved] (SPARK-40257) Remove since usage in streaming/query.py and window.py

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40257. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37707

[jira] [Assigned] (SPARK-40252) Replace `Stream.collect(Collectors.joining(delimiter))` with `StringJoiner` Api

2022-08-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40252: Assignee: Yang Jie > Replace `Stream.collect(Collectors.joining(delimiter))` with

[jira] [Resolved] (SPARK-40252) Replace `Stream.collect(Collectors.joining(delimiter))` with `StringJoiner` Api

2022-08-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40252. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37701

[jira] [Updated] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

2022-08-29 Thread Prashant Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Singh updated SPARK-40266: --- Description: h3. What changes were proposed in this pull request? Corrected datatype

[jira] [Updated] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

2022-08-29 Thread Prashant Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Singh updated SPARK-40266: --- Description: ### What changes were proposed in this pull request? Corrected datatype

[jira] [Assigned] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40266: Assignee: Apache Spark > Corrected console output in quick-start - Datatype Integer

[jira] [Assigned] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40266: Assignee: (was: Apache Spark) > Corrected console output in quick-start - Datatype

[jira] [Commented] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597469#comment-17597469 ] Apache Spark commented on SPARK-40266: -- User 'pacificlion' has created a pull request for this

[jira] [Created] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

2022-08-29 Thread Prashant Singh (Jira)
Prashant Singh created SPARK-40266: -- Summary: Corrected console output in quick-start - Datatype Integer instead of Long Key: SPARK-40266 URL: https://issues.apache.org/jira/browse/SPARK-40266

[jira] [Updated] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

2022-08-29 Thread Prashant Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Singh updated SPARK-40266: --- Priority: Minor (was: Major) > Corrected console output in quick-start - Datatype

[jira] [Resolved] (SPARK-40160) Make pyspark.broadcast examples self-contained

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40160. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37629

[jira] [Assigned] (SPARK-40160) Make pyspark.broadcast examples self-contained

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40160: Assignee: Qian Sun > Make pyspark.broadcast examples self-contained >

[jira] [Resolved] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40012. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37702

[jira] [Assigned] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

2022-08-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40012: Assignee: Hyukjin Kwon > Make pyspark.sql.dataframe examples self-contained >

[jira] [Commented] (SPARK-40265) Fix the inconsistent behavior for Index.intersection.

2022-08-29 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597439#comment-17597439 ] Haejoon Lee commented on SPARK-40265: - I'm working on it > Fix the inconsistent behavior for

[jira] [Created] (SPARK-40265) Fix the inconsistent behavior for Index.intersection.

2022-08-29 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40265: --- Summary: Fix the inconsistent behavior for Index.intersection. Key: SPARK-40265 URL: https://issues.apache.org/jira/browse/SPARK-40265 Project: Spark Issue

[jira] [Commented] (SPARK-40262) Expensive UDF evaluation pushed down past a join leads to performance issues

2022-08-29 Thread Shardul Mahadik (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597436#comment-17597436 ] Shardul Mahadik commented on SPARK-40262: - cc: [~cloud_fan] [~xkrogen] [~mridulm80]  >

[jira] [Updated] (SPARK-40261) DirectTaskResult meta should not be counted into result size

2022-08-29 Thread Ziqi Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ziqi Liu updated SPARK-40261: - Summary: DirectTaskResult meta should not be counted into result size (was: TaskResult meta should not

[jira] [Resolved] (SPARK-40235) Use interruptible lock instead of synchronized in Executor.updateDependencies()

2022-08-29 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-40235. Fix Version/s: 3.4.0 Resolution: Fixed Fixed by

[jira] [Created] (SPARK-40264) Add helper function for DL model inference in pyspark.ml.functions

2022-08-29 Thread Lee Yang (Jira)
Lee Yang created SPARK-40264: Summary: Add helper function for DL model inference in pyspark.ml.functions Key: SPARK-40264 URL: https://issues.apache.org/jira/browse/SPARK-40264 Project: Spark

[jira] [Created] (SPARK-40263) Use interruptible lock instead of synchronized in TransportClientFactory.createClient()

2022-08-29 Thread Josh Rosen (Jira)
Josh Rosen created SPARK-40263: -- Summary: Use interruptible lock instead of synchronized in TransportClientFactory.createClient() Key: SPARK-40263 URL: https://issues.apache.org/jira/browse/SPARK-40263

[jira] [Created] (SPARK-40262) Expensive UDF evaluation pushed down past a join leads to performance issues

2022-08-29 Thread Shardul Mahadik (Jira)
Shardul Mahadik created SPARK-40262: --- Summary: Expensive UDF evaluation pushed down past a join leads to performance issues Key: SPARK-40262 URL: https://issues.apache.org/jira/browse/SPARK-40262

[jira] [Assigned] (SPARK-40261) TaskResult meta should not be counted into result size

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40261: Assignee: (was: Apache Spark) > TaskResult meta should not be counted into result

[jira] [Commented] (SPARK-40261) TaskResult meta should not be counted into result size

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597399#comment-17597399 ] Apache Spark commented on SPARK-40261: -- User 'liuzqt' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40261) TaskResult meta should not be counted into result size

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40261: Assignee: Apache Spark > TaskResult meta should not be counted into result size >

[jira] [Resolved] (SPARK-38648) SPIP: Simplified API for DL Inferencing

2022-08-29 Thread Lee Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lee Yang resolved SPARK-38648. -- Resolution: Won't Fix > SPIP: Simplified API for DL Inferencing >

[jira] [Commented] (SPARK-38648) SPIP: Simplified API for DL Inferencing

2022-08-29 Thread Lee Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597397#comment-17597397 ] Lee Yang commented on SPARK-38648: -- Agreed, closing. > SPIP: Simplified API for DL Inferencing >

[jira] [Updated] (SPARK-40261) TaskResult meta should not be counted into result size

2022-08-29 Thread Ziqi Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ziqi Liu updated SPARK-40261: - Description: This issue exists for a long time (since

[jira] [Created] (SPARK-40261) TaskResult meta should not be counted into result size

2022-08-29 Thread Ziqi Liu (Jira)
Ziqi Liu created SPARK-40261: Summary: TaskResult meta should not be counted into result size Key: SPARK-40261 URL: https://issues.apache.org/jira/browse/SPARK-40261 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40254) Upgrade netty from 4.1.77 to 4.1.80

2022-08-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40254: - Assignee: Yang Jie > Upgrade netty from 4.1.77 to 4.1.80 >

[jira] [Resolved] (SPARK-40254) Upgrade netty from 4.1.77 to 4.1.80

2022-08-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40254. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37703

[jira] [Updated] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

2022-08-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40260: - Description: Migrate the following errors in QueryCompilationErrors: *

[jira] [Assigned] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

2022-08-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40260: Assignee: Max Gekk (was: Apache Spark) > Use error classes in the compilation errors of GROUP

[jira] [Updated] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

2022-08-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40260: - Fix Version/s: (was: 3.3.0) > Use error classes in the compilation errors of GROUP BY a position >

[jira] [Created] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

2022-08-29 Thread Max Gekk (Jira)
Max Gekk created SPARK-40260: Summary: Use error classes in the compilation errors of GROUP BY a position Key: SPARK-40260 URL: https://issues.apache.org/jira/browse/SPARK-40260 Project: Spark

[jira] [Updated] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

2022-08-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40260: - Affects Version/s: 3.4.0 (was: 3.3.0) > Use error classes in the compilation

[jira] [Updated] (SPARK-40259) Support Parquet DSv2 in subquery plan merge

2022-08-29 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-40259: --- Description: We could improve SPARK-34079 with DSv2 support. (was: We could improve SPARK-34079 to

[jira] [Assigned] (SPARK-40259) Support Parquet DSv2 in subquery plan merge

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40259: Assignee: (was: Apache Spark) > Support Parquet DSv2 in subquery plan merge >

[jira] [Commented] (SPARK-40259) Support Parquet DSv2 in subquery plan merge

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597296#comment-17597296 ] Apache Spark commented on SPARK-40259: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-40259) Support Parquet DSv2 in subquery plan merge

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40259: Assignee: Apache Spark > Support Parquet DSv2 in subquery plan merge >

[jira] [Created] (SPARK-40259) Support Parquet DSv2 in subquery plan merge

2022-08-29 Thread Peter Toth (Jira)
Peter Toth created SPARK-40259: -- Summary: Support Parquet DSv2 in subquery plan merge Key: SPARK-40259 URL: https://issues.apache.org/jira/browse/SPARK-40259 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40245) Fix FileScan equality check when partition or data filter columns are not read

2022-08-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40245. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37693

[jira] [Assigned] (SPARK-40245) Fix FileScan equality check when partition or data filter columns are not read

2022-08-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40245: --- Assignee: Peter Toth > Fix FileScan equality check when partition or data filter columns

[jira] [Commented] (SPARK-40156) url_decode() exposes a Java error

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597244#comment-17597244 ] Apache Spark commented on SPARK-40156: -- User 'ming95' has created a pull request for this

[jira] [Updated] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread jacky (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacky updated SPARK-40258: -- Description: Spark does not support pagination when I use the sql:select *from test11 limt 2,5

[jira] [Updated] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread jacky (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacky updated SPARK-40258: -- Attachment: (was: image-2022-08-29-20-14-12-949.png) > Spark does not support pagination >

[jira] [Updated] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread jacky (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacky updated SPARK-40258: -- Description: Spark does not support pagination when I use the sql:select *from test1 limt 2,5

[jira] [Updated] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread jacky (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacky updated SPARK-40258: -- Attachment: (was: image-2022-08-29-20-14-49-106.png) > Spark does not support pagination >

[jira] [Updated] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread jacky (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacky updated SPARK-40258: -- Attachment: image-2022-08-29-20-15-51-309.png > Spark does not support pagination >

[jira] [Updated] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread jacky (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacky updated SPARK-40258: -- Attachment: image-2022-08-29-20-14-49-106.png > Spark does not support pagination >

[jira] [Updated] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread jacky (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacky updated SPARK-40258: -- Description: Spark does not support pagination when I use the sql:select *from test1 limt 2,5

[jira] [Updated] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread jacky (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacky updated SPARK-40258: -- Attachment: image-2022-08-29-20-14-12-949.png > Spark does not support pagination >

[jira] [Created] (SPARK-40258) Spark does not support pagination

2022-08-29 Thread jacky (Jira)
jacky created SPARK-40258: - Summary: Spark does not support pagination Key: SPARK-40258 URL: https://issues.apache.org/jira/browse/SPARK-40258 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-40152) Codegen compilation error when using split_part

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597168#comment-17597168 ] Apache Spark commented on SPARK-40152: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-40257) Remove since usage in streaming/query.py and window.py

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597161#comment-17597161 ] Apache Spark commented on SPARK-40257: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-40257) Remove since usage in streaming/query.py and window.py

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40257: Assignee: (was: Apache Spark) > Remove since usage in streaming/query.py and

[jira] [Assigned] (SPARK-40257) Remove since usage in streaming/query.py and window.py

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40257: Assignee: Apache Spark > Remove since usage in streaming/query.py and window.py >

[jira] [Commented] (SPARK-40257) Remove since usage in streaming/query.py and window.py

2022-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17597160#comment-17597160 ] Apache Spark commented on SPARK-40257: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-40257) Remove since usage in streaming/query.py and window.py

2022-08-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-40257: Summary: Remove since usage in streaming/query.py and window.py Key: SPARK-40257 URL: https://issues.apache.org/jira/browse/SPARK-40257 Project: Spark Issue

  1   2   >