[jira] [Created] (SPARK-40272) Support service port custom with range

XiaoLong Wu created SPARK-40272: --- Summary: Support service port custom with range Key: SPARK-40272 URL: https://issues.apache.org/jira/browse/SPARK-40272 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597573#comment-17597573 ] comet commented on SPARK-38330: --- any update on this ticket? Anyone tested this one the lat

[jira] [Commented] (SPARK-40271) Support list type for spark.sql.functions.lit

[ https://issues.apache.org/jira/browse/SPARK-40271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597571#comment-17597571 ] Haejoon Lee commented on SPARK-40271: - I'm working on it > Support list type for sp

[jira] [Created] (SPARK-40271) Support list type for spark.sql.functions.lit

Haejoon Lee created SPARK-40271: --- Summary: Support list type for spark.sql.functions.lit Key: SPARK-40271 URL: https://issues.apache.org/jira/browse/SPARK-40271 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40260: Assignee: Max Gekk (was: Apache Spark) > Use error classes in the compilation errors of

[jira] [Updated] (SPARK-40265) Fix the inconsistent behavior for Index.intersection.

[ https://issues.apache.org/jira/browse/SPARK-40265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40265: Description: There is inconsistent behavior on `Index.intersection` when `other` is list of tuple

[jira] [Commented] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597570#comment-17597570 ] Apache Spark commented on SPARK-40260: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40260: Assignee: Apache Spark (was: Max Gekk) > Use error classes in the compilation errors of

[jira] [Updated] (SPARK-40265) Fix the inconsistent behavior for Index.intersection.

[ https://issues.apache.org/jira/browse/SPARK-40265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40265: Description: There is inconsistent behavior on Index.intersection for pandas API on Spark as belo

[jira] [Updated] (SPARK-40265) Fix the inconsistent behavior for Index.intersection.

[ https://issues.apache.org/jira/browse/SPARK-40265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40265: Description: There is inconsistent behavior on Index.intersection for pandas API on Spark as belo

[jira] [Commented] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597564#comment-17597564 ] Apache Spark commented on SPARK-40266: -- User 'pacificlion' has created a pull reque

[jira] [Commented] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597563#comment-17597563 ] Apache Spark commented on SPARK-40266: -- User 'pacificlion' has created a pull reque

[jira] [Updated] (SPARK-39971) ANALYZE TABLE makes some queries run forever

[ https://issues.apache.org/jira/browse/SPARK-39971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felipe updated SPARK-39971: --- Attachment: explainMode-cost.zip > ANALYZE TABLE makes some queries run forever > --

[jira] [Updated] (SPARK-39971) ANALYZE TABLE makes some queries run forever

[ https://issues.apache.org/jira/browse/SPARK-39971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felipe updated SPARK-39971: --- Attachment: (was: explainMode-cost.zip) > ANALYZE TABLE makes some queries run forever > ---

[jira] [Assigned] (SPARK-40135) Support ps.Index in DataFrame creation

[ https://issues.apache.org/jira/browse/SPARK-40135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40135: - Assignee: Ruifeng Zheng > Support ps.Index in DataFrame creation >

[jira] [Resolved] (SPARK-40135) Support ps.Index in DataFrame creation

[ https://issues.apache.org/jira/browse/SPARK-40135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40135. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37564 [https://

[jira] [Commented] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597548#comment-17597548 ] Apache Spark commented on SPARK-40270: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40270: Assignee: Apache Spark > Make compute.max_rows as None working in DataFrame.style > -

[jira] [Commented] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597546#comment-17597546 ] Apache Spark commented on SPARK-40270: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40270: Assignee: (was: Apache Spark) > Make compute.max_rows as None working in DataFrame.st

[jira] [Commented] (SPARK-39616) Upgrade Breeze to 2.0

[ https://issues.apache.org/jira/browse/SPARK-39616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597543#comment-17597543 ] Apache Spark commented on SPARK-39616: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-39616) Upgrade Breeze to 2.0

[ https://issues.apache.org/jira/browse/SPARK-39616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597544#comment-17597544 ] Apache Spark commented on SPARK-39616: -- User 'zhengruifeng' has created a pull requ

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:39 AM: ---

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:38 AM: ---

[jira] [Assigned] (SPARK-40269) Randomize the orders of peer in BlockManagerDecommissioner

[ https://issues.apache.org/jira/browse/SPARK-40269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40269: Assignee: (was: Apache Spark) > Randomize the orders of peer in BlockManagerDecommiss

[jira] [Commented] (SPARK-40269) Randomize the orders of peer in BlockManagerDecommissioner

[ https://issues.apache.org/jira/browse/SPARK-40269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597542#comment-17597542 ] Apache Spark commented on SPARK-40269: -- User 'warrenzhu25' has created a pull reque

[jira] [Assigned] (SPARK-40269) Randomize the orders of peer in BlockManagerDecommissioner

[ https://issues.apache.org/jira/browse/SPARK-40269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40269: Assignee: Apache Spark > Randomize the orders of peer in BlockManagerDecommissioner > ---

[jira] [Created] (SPARK-40270) Support compute.max_rows as None in DataFrame.style

Hyukjin Kwon created SPARK-40270: Summary: Support compute.max_rows as None in DataFrame.style Key: SPARK-40270 URL: https://issues.apache.org/jira/browse/SPARK-40270 Project: Spark Issue Typ

[jira] [Updated] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40270: - Fix Version/s: 3.1.4 3.4.0 3.3.1 3.2.3

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:34 AM: ---

[jira] [Updated] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40270: - Priority: Minor (was: Major) > Make compute.max_rows as None working in DataFrame.style > -

[jira] [Updated] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style

[ https://issues.apache.org/jira/browse/SPARK-40270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40270: - Summary: Make compute.max_rows as None working in DataFrame.style (was: Support compute.max_row

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:32 AM: ---

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:32 AM: ---

[jira] [Created] (SPARK-40269) Randomize the orders of peer in BlockManagerDecommissioner

Zhongwei Zhu created SPARK-40269: Summary: Randomize the orders of peer in BlockManagerDecommissioner Key: SPARK-40269 URL: https://issues.apache.org/jira/browse/SPARK-40269 Project: Spark Is

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:31 AM: ---

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597539#comment-17597539 ] Pankaj Nagla edited comment on SPARK-22588 at 8/30/22 5:29 AM: ---

[jira] [Commented] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597539#comment-17597539 ] Pankaj Nagla commented on SPARK-22588: -- Thank you for sharing the information. [Vlo

[jira] [Commented] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597537#comment-17597537 ] BingKun Pan commented on SPARK-40056: - I will fix it. > Upgrade mvn-scalafmt from 1

[jira] [Updated] (SPARK-39971) ANALYZE TABLE makes some queries run forever

[ https://issues.apache.org/jira/browse/SPARK-39971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felipe updated SPARK-39971: --- Attachment: explainMode-cost.zip > ANALYZE TABLE makes some queries run forever > --

[jira] [Commented] (SPARK-39971) ANALYZE TABLE makes some queries run forever

[ https://issues.apache.org/jira/browse/SPARK-39971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597528#comment-17597528 ] Felipe commented on SPARK-39971: [~yumwang] I uploaded the plans > ANALYZE TABLE makes

[jira] [Resolved] (SPARK-34777) [UI] StagePage input size/records not show when records greater than zero

[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-34777. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35498 [https://gith

[jira] [Assigned] (SPARK-34777) [UI] StagePage input size/records not show when records greater than zero

[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-34777: --- Assignee: Zhongwei Zhu > [UI] StagePage input size/records not show when records greater th

[jira] [Assigned] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40056: Assignee: (was: Apache Spark) > Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f4

[jira] [Assigned] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40056: Assignee: Apache Spark > Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9 >

[jira] [Updated] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40056: - Fix Version/s: (was: 3.4.0) > Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9 > --

[jira] [Reopened] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-40056: -- Assignee: (was: BingKun Pan) > Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

[jira] [Commented] (SPARK-40056) Upgrade mvn-scalafmt from 1.0.4 to 1.1.1640084764.9f463a9

[ https://issues.apache.org/jira/browse/SPARK-40056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597512#comment-17597512 ] Hyukjin Kwon commented on SPARK-40056: -- Reverted in https://github.com/apache/spar

[jira] [Resolved] (SPARK-40221) Not able to format using scalafmt

[ https://issues.apache.org/jira/browse/SPARK-40221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40221. -- Fix Version/s: 3.4.0 Assignee: Hyukjin Kwon Resolution: Fixed > Not able to fo

[jira] [Commented] (SPARK-40221) Not able to format using scalafmt

[ https://issues.apache.org/jira/browse/SPARK-40221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597511#comment-17597511 ] Hyukjin Kwon commented on SPARK-40221: -- Fixed in https://github.com/apache/spark/c

[jira] [Commented] (SPARK-40221) Not able to format using scalafmt

[ https://issues.apache.org/jira/browse/SPARK-40221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597509#comment-17597509 ] Hyukjin Kwon commented on SPARK-40221: -- Seems like SPARK-40056 caused this. I am re

[jira] [Created] (SPARK-40268) Test decimal128 in UDF

jiaan.geng created SPARK-40268: -- Summary: Test decimal128 in UDF Key: SPARK-40268 URL: https://issues.apache.org/jira/browse/SPARK-40268 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-40253) Data read exception in orc format

[ https://issues.apache.org/jira/browse/SPARK-40253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597500#comment-17597500 ] Hyukjin Kwon commented on SPARK-40253: -- Is this still an issue in Spark 3.1+? Spark

[jira] [Resolved] (SPARK-40258) Spark does not support pagination

[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40258. -- Resolution: Duplicate > Spark does not support pagination > -

[jira] [Commented] (SPARK-40258) Spark does not support pagination

[ https://issues.apache.org/jira/browse/SPARK-40258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597498#comment-17597498 ] Hyukjin Kwon commented on SPARK-40258: -- We support it now, see SPARK-28330 > Spark

[jira] [Created] (SPARK-40267) Add description for ExecutorAllocationManager metrics

Zhongwei Zhu created SPARK-40267: Summary: Add description for ExecutorAllocationManager metrics Key: SPARK-40267 URL: https://issues.apache.org/jira/browse/SPARK-40267 Project: Spark Issue T

[jira] [Assigned] (SPARK-40257) Remove since usage in streaming/query.py and window.py

[ https://issues.apache.org/jira/browse/SPARK-40257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40257: Assignee: Hyukjin Kwon > Remove since usage in streaming/query.py and window.py > ---

[jira] [Resolved] (SPARK-40257) Remove since usage in streaming/query.py and window.py

[ https://issues.apache.org/jira/browse/SPARK-40257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40257. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37707 [https://gi

[jira] [Assigned] (SPARK-40252) Replace `Stream.collect(Collectors.joining(delimiter))` with `StringJoiner` Api

[ https://issues.apache.org/jira/browse/SPARK-40252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40252: Assignee: Yang Jie > Replace `Stream.collect(Collectors.joining(delimiter))` with `String

[jira] [Resolved] (SPARK-40252) Replace `Stream.collect(Collectors.joining(delimiter))` with `StringJoiner` Api

[ https://issues.apache.org/jira/browse/SPARK-40252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40252. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37701 [https://gi

[jira] [Updated] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Singh updated SPARK-40266: --- Description: h3. What changes were proposed in this pull request? Corrected datatype output

[jira] [Updated] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Singh updated SPARK-40266: --- Description: ### What changes were proposed in this pull request? Corrected datatype outpu

[jira] [Assigned] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40266: Assignee: Apache Spark > Corrected console output in quick-start - Datatype Integer ins

[jira] [Assigned] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40266: Assignee: (was: Apache Spark) > Corrected console output in quick-start - Datatype

[jira] [Commented] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597469#comment-17597469 ] Apache Spark commented on SPARK-40266: -- User 'pacificlion' has created a pull reque

[jira] [Created] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

Prashant Singh created SPARK-40266: -- Summary: Corrected console output in quick-start - Datatype Integer instead of Long Key: SPARK-40266 URL: https://issues.apache.org/jira/browse/SPARK-40266 Proj

[jira] [Updated] (SPARK-40266) Corrected console output in quick-start - Datatype Integer instead of Long

[ https://issues.apache.org/jira/browse/SPARK-40266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Singh updated SPARK-40266: --- Priority: Minor (was: Major) > Corrected console output in quick-start - Datatype Integer

[jira] [Resolved] (SPARK-40160) Make pyspark.broadcast examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40160. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37629 [https://gi

[jira] [Assigned] (SPARK-40160) Make pyspark.broadcast examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40160: Assignee: Qian Sun > Make pyspark.broadcast examples self-contained > ---

[jira] [Resolved] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40012. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37702 [https://gi

[jira] [Assigned] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40012: Assignee: Hyukjin Kwon > Make pyspark.sql.dataframe examples self-contained > ---

[jira] [Commented] (SPARK-40265) Fix the inconsistent behavior for Index.intersection.

[ https://issues.apache.org/jira/browse/SPARK-40265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597439#comment-17597439 ] Haejoon Lee commented on SPARK-40265: - I'm working on it > Fix the inconsistent beh

[jira] [Created] (SPARK-40265) Fix the inconsistent behavior for Index.intersection.

Haejoon Lee created SPARK-40265: --- Summary: Fix the inconsistent behavior for Index.intersection. Key: SPARK-40265 URL: https://issues.apache.org/jira/browse/SPARK-40265 Project: Spark Issue Typ

[jira] [Commented] (SPARK-40262) Expensive UDF evaluation pushed down past a join leads to performance issues

[ https://issues.apache.org/jira/browse/SPARK-40262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597436#comment-17597436 ] Shardul Mahadik commented on SPARK-40262: - cc: [~cloud_fan] [~xkrogen] [~mridulm

[jira] [Updated] (SPARK-40261) DirectTaskResult meta should not be counted into result size

[ https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ziqi Liu updated SPARK-40261: - Summary: DirectTaskResult meta should not be counted into result size (was: TaskResult meta should not

[jira] [Resolved] (SPARK-40235) Use interruptible lock instead of synchronized in Executor.updateDependencies()

[ https://issues.apache.org/jira/browse/SPARK-40235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-40235. Fix Version/s: 3.4.0 Resolution: Fixed Fixed by [https://github.com/apache/spark/pull/37681

[jira] [Created] (SPARK-40264) Add helper function for DL model inference in pyspark.ml.functions

Lee Yang created SPARK-40264: Summary: Add helper function for DL model inference in pyspark.ml.functions Key: SPARK-40264 URL: https://issues.apache.org/jira/browse/SPARK-40264 Project: Spark I

[jira] [Created] (SPARK-40263) Use interruptible lock instead of synchronized in TransportClientFactory.createClient()

Josh Rosen created SPARK-40263: -- Summary: Use interruptible lock instead of synchronized in TransportClientFactory.createClient() Key: SPARK-40263 URL: https://issues.apache.org/jira/browse/SPARK-40263 P

[jira] [Created] (SPARK-40262) Expensive UDF evaluation pushed down past a join leads to performance issues

Shardul Mahadik created SPARK-40262: --- Summary: Expensive UDF evaluation pushed down past a join leads to performance issues Key: SPARK-40262 URL: https://issues.apache.org/jira/browse/SPARK-40262 P

[jira] [Assigned] (SPARK-40261) TaskResult meta should not be counted into result size

[ https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40261: Assignee: (was: Apache Spark) > TaskResult meta should not be counted into result siz

[jira] [Commented] (SPARK-40261) TaskResult meta should not be counted into result size

[ https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597399#comment-17597399 ] Apache Spark commented on SPARK-40261: -- User 'liuzqt' has created a pull request fo

[jira] [Assigned] (SPARK-40261) TaskResult meta should not be counted into result size

[ https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40261: Assignee: Apache Spark > TaskResult meta should not be counted into result size > ---

[jira] [Resolved] (SPARK-38648) SPIP: Simplified API for DL Inferencing

[ https://issues.apache.org/jira/browse/SPARK-38648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lee Yang resolved SPARK-38648. -- Resolution: Won't Fix > SPIP: Simplified API for DL Inferencing >

[jira] [Commented] (SPARK-38648) SPIP: Simplified API for DL Inferencing

[ https://issues.apache.org/jira/browse/SPARK-38648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597397#comment-17597397 ] Lee Yang commented on SPARK-38648: -- Agreed, closing. > SPIP: Simplified API for DL Inf

[jira] [Updated] (SPARK-40261) TaskResult meta should not be counted into result size

[ https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ziqi Liu updated SPARK-40261: - Description: This issue exists for a long time (since [https://github.com/liuzqt/spark/commit/c33e55008

[jira] [Created] (SPARK-40261) TaskResult meta should not be counted into result size

Ziqi Liu created SPARK-40261: Summary: TaskResult meta should not be counted into result size Key: SPARK-40261 URL: https://issues.apache.org/jira/browse/SPARK-40261 Project: Spark Issue Type: Bu

[jira] [Assigned] (SPARK-40254) Upgrade netty from 4.1.77 to 4.1.80

[ https://issues.apache.org/jira/browse/SPARK-40254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40254: - Assignee: Yang Jie > Upgrade netty from 4.1.77 to 4.1.80 >

[jira] [Resolved] (SPARK-40254) Upgrade netty from 4.1.77 to 4.1.80

[ https://issues.apache.org/jira/browse/SPARK-40254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40254. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37703 [https://

[jira] [Updated] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40260: - Description: Migrate the following errors in QueryCompilationErrors: * groupByPositionRefersToAggregateF

[jira] [Assigned] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40260: Assignee: Max Gekk (was: Apache Spark) > Use error classes in the compilation errors of GROUP BY

[jira] [Updated] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40260: - Fix Version/s: (was: 3.3.0) > Use error classes in the compilation errors of GROUP BY a position > -

[jira] [Created] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

Max Gekk created SPARK-40260: Summary: Use error classes in the compilation errors of GROUP BY a position Key: SPARK-40260 URL: https://issues.apache.org/jira/browse/SPARK-40260 Project: Spark I

[jira] [Updated] (SPARK-40260) Use error classes in the compilation errors of GROUP BY a position

[ https://issues.apache.org/jira/browse/SPARK-40260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40260: - Affects Version/s: 3.4.0 (was: 3.3.0) > Use error classes in the compilation

[jira] [Updated] (SPARK-40259) Support Parquet DSv2 in subquery plan merge

[ https://issues.apache.org/jira/browse/SPARK-40259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-40259: --- Description: We could improve SPARK-34079 with DSv2 support. (was: We could improve SPARK-34079 to

[jira] [Assigned] (SPARK-40259) Support Parquet DSv2 in subquery plan merge

[ https://issues.apache.org/jira/browse/SPARK-40259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40259: Assignee: (was: Apache Spark) > Support Parquet DSv2 in subquery plan merge > ---

[jira] [Commented] (SPARK-40259) Support Parquet DSv2 in subquery plan merge

[ https://issues.apache.org/jira/browse/SPARK-40259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597296#comment-17597296 ] Apache Spark commented on SPARK-40259: -- User 'peter-toth' has created a pull reques

[jira] [Assigned] (SPARK-40259) Support Parquet DSv2 in subquery plan merge

[ https://issues.apache.org/jira/browse/SPARK-40259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40259: Assignee: Apache Spark > Support Parquet DSv2 in subquery plan merge > --

[jira] [Created] (SPARK-40259) Support Parquet DSv2 in subquery plan merge

Peter Toth created SPARK-40259: -- Summary: Support Parquet DSv2 in subquery plan merge Key: SPARK-40259 URL: https://issues.apache.org/jira/browse/SPARK-40259 Project: Spark Issue Type: Improveme

[jira] [Resolved] (SPARK-40245) Fix FileScan equality check when partition or data filter columns are not read

[ https://issues.apache.org/jira/browse/SPARK-40245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40245. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37693 [https://gith

[jira] [Assigned] (SPARK-40245) Fix FileScan equality check when partition or data filter columns are not read

[ https://issues.apache.org/jira/browse/SPARK-40245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40245: --- Assignee: Peter Toth > Fix FileScan equality check when partition or data filter columns ar

  1   2   >