[jira] [Assigned] (SPARK-42585) Streaming createDataFrame implementation

[ https://issues.apache.org/jira/browse/SPARK-42585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42585: Assignee: Max Gekk > Streaming createDataFrame implementation >

[jira] [Commented] (SPARK-40082) DAGScheduler may not schduler new stage in condition of push-based shuffle enabled

[ https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698769#comment-17698769 ] Fencheng Mei commented on SPARK-40082: -- I also encountered this problem on our production

[jira] [Commented] (SPARK-42742) access apiserver by pod env

[ https://issues.apache.org/jira/browse/SPARK-42742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698760#comment-17698760 ] Hu Ziqian commented on SPARK-42742: --- Created PR [https://github.com/apache/spark/pull/40361] for this

[jira] [Created] (SPARK-42742) access apiserver by pod env

Hu Ziqian created SPARK-42742: - Summary: access apiserver by pod env Key: SPARK-42742 URL: https://issues.apache.org/jira/browse/SPARK-42742 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-42741) Do not unwrap casts in binary comparison when literal is null

[ https://issues.apache.org/jira/browse/SPARK-42741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698750#comment-17698750 ] Apache Spark commented on SPARK-42741: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42741) Do not unwrap casts in binary comparison when literal is null

[ https://issues.apache.org/jira/browse/SPARK-42741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42741: Assignee: (was: Apache Spark) > Do not unwrap casts in binary comparison when

[jira] [Assigned] (SPARK-42741) Do not unwrap casts in binary comparison when literal is null

[ https://issues.apache.org/jira/browse/SPARK-42741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42741: Assignee: Apache Spark > Do not unwrap casts in binary comparison when literal is null >

[jira] [Commented] (SPARK-42741) Do not unwrap casts in binary comparison when literal is null

[ https://issues.apache.org/jira/browse/SPARK-42741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698749#comment-17698749 ] Apache Spark commented on SPARK-42741: -- User 'wangyum' has created a pull request for this issue:

[jira] [Created] (SPARK-42741) Do not unwrap casts in binary comparison when literal is null

Yuming Wang created SPARK-42741: --- Summary: Do not unwrap casts in binary comparison when literal is null Key: SPARK-42741 URL: https://issues.apache.org/jira/browse/SPARK-42741 Project: Spark

[jira] [Assigned] (SPARK-42740) Fix the bug that pushdown offset or paging is invalid for some built-in dialect

[ https://issues.apache.org/jira/browse/SPARK-42740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42740: Assignee: (was: Apache Spark) > Fix the bug that pushdown offset or paging is

[jira] [Commented] (SPARK-42740) Fix the bug that pushdown offset or paging is invalid for some built-in dialect

[ https://issues.apache.org/jira/browse/SPARK-42740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698742#comment-17698742 ] Apache Spark commented on SPARK-42740: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42740) Fix the bug that pushdown offset or paging is invalid for some built-in dialect

[ https://issues.apache.org/jira/browse/SPARK-42740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42740: Assignee: Apache Spark > Fix the bug that pushdown offset or paging is invalid for some

[jira] [Created] (SPARK-42740) Fix the bug that pushdown offset or paging is invalid for some built-in dialect

jiaan.geng created SPARK-42740: -- Summary: Fix the bug that pushdown offset or paging is invalid for some built-in dialect Key: SPARK-42740 URL: https://issues.apache.org/jira/browse/SPARK-42740

[jira] [Commented] (SPARK-42733) df.write.format().save() should support calling with no path or table name

[ https://issues.apache.org/jira/browse/SPARK-42733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698729#comment-17698729 ] Apache Spark commented on SPARK-42733: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42739) Ensure release tag to be pushed to release branch

[ https://issues.apache.org/jira/browse/SPARK-42739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42739. -- Fix Version/s: 3.5.0 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-42739) Ensure release tag to be pushed to release branch

[ https://issues.apache.org/jira/browse/SPARK-42739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-42739: Assignee: Xinrong Meng > Ensure release tag to be pushed to release branch >

[jira] [Resolved] (SPARK-42734) deal with timestamp partition column when spark.sql.storeAssignmentPolicy=LEGACY

[ https://issues.apache.org/jira/browse/SPARK-42734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo resolved SPARK-42734. -- Resolution: Abandoned > deal with timestamp partition column when >

[jira] [Commented] (SPARK-42734) deal with timestamp partition column when spark.sql.storeAssignmentPolicy=LEGACY

[ https://issues.apache.org/jira/browse/SPARK-42734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698705#comment-17698705 ] Liu Shuo commented on SPARK-42734: -- The following PR has fixed this issue [SPARK-40798][SQL] Alter

[jira] [Resolved] (SPARK-42623) parameter markers not blocked in DDL

[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42623. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40333

[jira] [Assigned] (SPARK-42623) parameter markers not blocked in DDL

[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42623: --- Assignee: Wenchen Fan > parameter markers not blocked in DDL >

[jira] [Assigned] (SPARK-42725) Make LiteralExpression support array

[ https://issues.apache.org/jira/browse/SPARK-42725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42725: - Assignee: Ruifeng Zheng > Make LiteralExpression support array >

[jira] [Resolved] (SPARK-42725) Make LiteralExpression support array

[ https://issues.apache.org/jira/browse/SPARK-42725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42725. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40349

[jira] [Assigned] (SPARK-42702) Support parameterized CTE

[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42702: Assignee: Max Gekk (was: Apache Spark) > Support parameterized CTE >

[jira] [Assigned] (SPARK-42702) Support parameterized CTE

[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42702: Assignee: Apache Spark (was: Max Gekk) > Support parameterized CTE >

[jira] [Updated] (SPARK-42702) Support parameterized CTE

[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42702: - Fix Version/s: (was: 3.4.0) > Support parameterized CTE > - > >

[jira] [Commented] (SPARK-42702) Support parameterized CTE

[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698691#comment-17698691 ] Hyukjin Kwon commented on SPARK-42702: -- Reverted in

[jira] [Commented] (SPARK-42623) parameter markers not blocked in DDL

[ https://issues.apache.org/jira/browse/SPARK-42623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698692#comment-17698692 ] Hyukjin Kwon commented on SPARK-42623: -- Reverted in

[jira] [Reopened] (SPARK-42702) Support parameterized CTE

[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-42702: -- > Support parameterized CTE > - > > Key: SPARK-42702 >

[jira] [Resolved] (SPARK-42702) Support parameterized CTE

[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42702. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40333

[jira] [Resolved] (SPARK-42686) TaskMemoryManager debug logging is expensive

[ https://issues.apache.org/jira/browse/SPARK-42686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42686. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40302

[jira] [Assigned] (SPARK-42686) TaskMemoryManager debug logging is expensive

[ https://issues.apache.org/jira/browse/SPARK-42686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42686: Assignee: Alkis Evlogimenos > TaskMemoryManager debug logging is expensive >

[jira] [Resolved] (SPARK-42726) Implement `DataFrame.mapInArrow`

[ https://issues.apache.org/jira/browse/SPARK-42726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42726. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40350

[jira] [Assigned] (SPARK-42726) Implement `DataFrame.mapInArrow`

[ https://issues.apache.org/jira/browse/SPARK-42726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42726: Assignee: Xinrong Meng > Implement `DataFrame.mapInArrow` >

[jira] [Resolved] (SPARK-42733) df.write.format().save() should support calling with no path or table name

[ https://issues.apache.org/jira/browse/SPARK-42733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42733. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40356

[jira] [Commented] (SPARK-42739) Ensure release tag to be pushed to release branch

[ https://issues.apache.org/jira/browse/SPARK-42739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698663#comment-17698663 ] Apache Spark commented on SPARK-42739: -- User 'xinrong-meng' has created a pull request for this

[jira] [Commented] (SPARK-42739) Ensure release tag to be pushed to release branch

[ https://issues.apache.org/jira/browse/SPARK-42739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698662#comment-17698662 ] Apache Spark commented on SPARK-42739: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42739) Ensure release tag to be pushed to release branch

[ https://issues.apache.org/jira/browse/SPARK-42739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42739: Assignee: (was: Apache Spark) > Ensure release tag to be pushed to release branch >

[jira] [Assigned] (SPARK-42739) Ensure release tag to be pushed to release branch

[ https://issues.apache.org/jira/browse/SPARK-42739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42739: Assignee: Apache Spark > Ensure release tag to be pushed to release branch >

[jira] [Created] (SPARK-42739) Ensure release tag to be pushed to release branch

Xinrong Meng created SPARK-42739: Summary: Ensure release tag to be pushed to release branch Key: SPARK-42739 URL: https://issues.apache.org/jira/browse/SPARK-42739 Project: Spark Issue

[jira] [Commented] (SPARK-42720) Refactor the withSequenceColumn

[ https://issues.apache.org/jira/browse/SPARK-42720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698655#comment-17698655 ] Haejoon Lee commented on SPARK-42720: - I'm workin on it > Refactor the withSequenceColumn >

[jira] [Commented] (SPARK-42733) df.write.format().save() should support calling with no path or table name

[ https://issues.apache.org/jira/browse/SPARK-42733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698608#comment-17698608 ] Apache Spark commented on SPARK-42733: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42733) df.write.format().save() should support calling with no path or table name

[ https://issues.apache.org/jira/browse/SPARK-42733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42733: Assignee: Apache Spark > df.write.format().save() should support calling with no path or

[jira] [Assigned] (SPARK-42733) df.write.format().save() should support calling with no path or table name

[ https://issues.apache.org/jira/browse/SPARK-42733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42733: Assignee: (was: Apache Spark) > df.write.format().save() should support calling with

[jira] [Resolved] (SPARK-38735) Test the error class: INTERNAL_ERROR

[ https://issues.apache.org/jira/browse/SPARK-38735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38735. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40236

[jira] [Assigned] (SPARK-38735) Test the error class: INTERNAL_ERROR

[ https://issues.apache.org/jira/browse/SPARK-38735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38735: Assignee: Eugene Gusev > Test the error class: INTERNAL_ERROR >

[jira] [Updated] (SPARK-42733) df.write.format().save() should support calling with no path or table name

[ https://issues.apache.org/jira/browse/SPARK-42733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-42733: -- Parent: SPARK-41284 Issue Type: Sub-task (was: Bug) > df.write.format().save()

[jira] [Resolved] (SPARK-42719) `MapOutputTracker#getMapLocation` should respect `spark.shuffle.reduceLocality.enabled`

[ https://issues.apache.org/jira/browse/SPARK-42719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-42719. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-42719) `MapOutputTracker#getMapLocation` should respect `spark.shuffle.reduceLocality.enabled`

[ https://issues.apache.org/jira/browse/SPARK-42719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-42719: --- Assignee: He Qi > `MapOutputTracker#getMapLocation` should respect >

[jira] [Created] (SPARK-42738) BlockManagerMaster requests removal of non-existent executor after executor has already gracefully decommissioned

Yeachan Park created SPARK-42738: Summary: BlockManagerMaster requests removal of non-existent executor after executor has already gracefully decommissioned Key: SPARK-42738 URL:

[jira] [Created] (SPARK-42737) Shuffle files lost with graceful decommission fallback storage enabled

Yeachan Park created SPARK-42737: Summary: Shuffle files lost with graceful decommission fallback storage enabled Key: SPARK-42737 URL: https://issues.apache.org/jira/browse/SPARK-42737 Project:

[jira] (SPARK-42604) Implement functions.typedlit

[ https://issues.apache.org/jira/browse/SPARK-42604 ] jiaan.geng deleted comment on SPARK-42604: was (Author: beliefer): I'm working on. > Implement functions.typedlit > > > Key: SPARK-42604 >

[jira] [Commented] (SPARK-42604) Implement functions.typedlit

[ https://issues.apache.org/jira/browse/SPARK-42604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698434#comment-17698434 ] Apache Spark commented on SPARK-42604: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42604) Implement functions.typedlit

[ https://issues.apache.org/jira/browse/SPARK-42604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42604: Assignee: (was: Apache Spark) > Implement functions.typedlit >

[jira] [Assigned] (SPARK-42604) Implement functions.typedlit

[ https://issues.apache.org/jira/browse/SPARK-42604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42604: Assignee: Apache Spark > Implement functions.typedlit > > >

[jira] [Commented] (SPARK-42735) Allow passing additional confs to server in RemoteSparkSession

[ https://issues.apache.org/jira/browse/SPARK-42735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698427#comment-17698427 ] Apache Spark commented on SPARK-42735: -- User 'tomvanbussel' has created a pull request for this

[jira] [Assigned] (SPARK-42735) Allow passing additional confs to server in RemoteSparkSession

[ https://issues.apache.org/jira/browse/SPARK-42735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42735: Assignee: Apache Spark > Allow passing additional confs to server in RemoteSparkSession

[jira] [Assigned] (SPARK-42735) Allow passing additional confs to server in RemoteSparkSession

[ https://issues.apache.org/jira/browse/SPARK-42735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42735: Assignee: (was: Apache Spark) > Allow passing additional confs to server in

[jira] [Updated] (SPARK-42736) Display executor remove reason statistics for clusters which don't have dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-42736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeachan Park updated SPARK-42736: - Description: The remove reason statistics do not seem to be enabled for clusters which do not

[jira] [Updated] (SPARK-42736) Display executor remove reason statistics for clusters which don't have dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-42736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeachan Park updated SPARK-42736: - Description: The remove reason statistics do not seem to be enabled for clusters which do not

[jira] [Created] (SPARK-42736) Display executor remove reason statistics for clusters which don't have dynamic allocation

Yeachan Park created SPARK-42736: Summary: Display executor remove reason statistics for clusters which don't have dynamic allocation Key: SPARK-42736 URL: https://issues.apache.org/jira/browse/SPARK-42736

[jira] [Resolved] (SPARK-42706) Document the Spark SQL error classes in user-facing documentation.

[ https://issues.apache.org/jira/browse/SPARK-42706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42706. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40336

[jira] [Assigned] (SPARK-42706) Document the Spark SQL error classes in user-facing documentation.

[ https://issues.apache.org/jira/browse/SPARK-42706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42706: Assignee: Haejoon Lee > Document the Spark SQL error classes in user-facing documentation. >

[jira] [Created] (SPARK-42735) Allow passing additional confs to server in RemoteSparkSession

Tom van Bussel created SPARK-42735: -- Summary: Allow passing additional confs to server in RemoteSparkSession Key: SPARK-42735 URL: https://issues.apache.org/jira/browse/SPARK-42735 Project: Spark

[jira] [Updated] (SPARK-42735) Allow passing additional confs to server in RemoteSparkSession

[ https://issues.apache.org/jira/browse/SPARK-42735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom van Bussel updated SPARK-42735: --- Issue Type: Improvement (was: New Feature) > Allow passing additional confs to server in

[jira] [Updated] (SPARK-42734) deal with timestamp partition column when spark.sql.storeAssignmentPolicy=LEGACY

[ https://issues.apache.org/jira/browse/SPARK-42734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-42734: - Description: We create a table which has a partition column with timestamp type, when we execute

[jira] [Created] (SPARK-42734) deal with timestamp partition column when spark.sql.storeAssignmentPolicy=LEGACY

Liu Shuo created SPARK-42734: Summary: deal with timestamp partition column when spark.sql.storeAssignmentPolicy=LEGACY Key: SPARK-42734 URL: https://issues.apache.org/jira/browse/SPARK-42734 Project:

[jira] [Created] (SPARK-42733) df.write.format().save() should support calling with no path or table name

Martin Grund created SPARK-42733: Summary: df.write.format().save() should support calling with no path or table name Key: SPARK-42733 URL: https://issues.apache.org/jira/browse/SPARK-42733 Project:

[jira] [Commented] (SPARK-42732) Support spark connect session getActiveSession

[ https://issues.apache.org/jira/browse/SPARK-42732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698337#comment-17698337 ] Apache Spark commented on SPARK-42732: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-42732) Support spark connect session getActiveSession

[ https://issues.apache.org/jira/browse/SPARK-42732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42732: Assignee: Apache Spark > Support spark connect session getActiveSession >

[jira] [Commented] (SPARK-42732) Support spark connect session getActiveSession

[ https://issues.apache.org/jira/browse/SPARK-42732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698334#comment-17698334 ] Apache Spark commented on SPARK-42732: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-42732) Support spark connect session getActiveSession

[ https://issues.apache.org/jira/browse/SPARK-42732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42732: Assignee: (was: Apache Spark) > Support spark connect session getActiveSession >

[jira] [Created] (SPARK-42732) Support spark connect session getActiveSession

Weichen Xu created SPARK-42732: -- Summary: Support spark connect session getActiveSession Key: SPARK-42732 URL: https://issues.apache.org/jira/browse/SPARK-42732 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-42664) Support bloomFilter for DataFrameStatFunctions

[ https://issues.apache.org/jira/browse/SPARK-42664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698332#comment-17698332 ] Apache Spark commented on SPARK-42664: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42664) Support bloomFilter for DataFrameStatFunctions

[ https://issues.apache.org/jira/browse/SPARK-42664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42664: Assignee: (was: Apache Spark) > Support bloomFilter for DataFrameStatFunctions >

[jira] [Commented] (SPARK-42664) Support bloomFilter for DataFrameStatFunctions

[ https://issues.apache.org/jira/browse/SPARK-42664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698331#comment-17698331 ] Apache Spark commented on SPARK-42664: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42664) Support bloomFilter for DataFrameStatFunctions

[ https://issues.apache.org/jira/browse/SPARK-42664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42664: Assignee: Apache Spark > Support bloomFilter for DataFrameStatFunctions >

[jira] [Updated] (SPARK-42730) Update Spark Standalone Mode - Starting a Cluster Manually

[ https://issues.apache.org/jira/browse/SPARK-42730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42730: - Description: https://spark.apache.org/docs/latest/spark-standalone.html Add

[jira] [Updated] (SPARK-42731) Update Spark Configuration

[ https://issues.apache.org/jira/browse/SPARK-42731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42731: - Description: https://spark.apache.org/docs/latest/configuration.html Add a section for Spark

[jira] [Updated] (SPARK-42729) Update Submitting Applications page for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-42729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42729: - Component/s: Documentation > Update Submitting Applications page for Spark Connect >

[jira] [Created] (SPARK-42731) Update Spark Configuration

Hyukjin Kwon created SPARK-42731: Summary: Update Spark Configuration Key: SPARK-42731 URL: https://issues.apache.org/jira/browse/SPARK-42731 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-42730) Update Spark Standalone Mode - Starting a Cluster Manually

Hyukjin Kwon created SPARK-42730: Summary: Update Spark Standalone Mode - Starting a Cluster Manually Key: SPARK-42730 URL: https://issues.apache.org/jira/browse/SPARK-42730 Project: Spark

[jira] [Updated] (SPARK-42496) Introduction Spark Connect at main page

[ https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42496: - Summary: Introduction Spark Connect at main page (was: Introduction Spark Connect at main

[jira] [Created] (SPARK-42729) Update Submitting Applications page for Spark Connect

Hyukjin Kwon created SPARK-42729: Summary: Update Submitting Applications page for Spark Connect Key: SPARK-42729 URL: https://issues.apache.org/jira/browse/SPARK-42729 Project: Spark Issue

[jira] [Assigned] (SPARK-42630) Make `parse_data_type` use new proto message `DDLParse`

[ https://issues.apache.org/jira/browse/SPARK-42630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42630: Assignee: Ruifeng Zheng > Make `parse_data_type` use new proto message `DDLParse` >

[jira] [Resolved] (SPARK-42630) Make `parse_data_type` use new proto message `DDLParse`

[ https://issues.apache.org/jira/browse/SPARK-42630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42630. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40260

[jira] [Comment Edited] (SPARK-42604) Implement functions.typedlit

[ https://issues.apache.org/jira/browse/SPARK-42604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695964#comment-17695964 ] jiaan.geng edited comment on SPARK-42604 at 3/9/23 10:43 AM: - I'm working

[jira] [Updated] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

[ https://issues.apache.org/jira/browse/SPARK-42728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42728: -- Description: *spark config :*  spark.sql.adaptive.enabled true

[jira] [Updated] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

[ https://issues.apache.org/jira/browse/SPARK-42728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42728: -- Description: spark config :  spark.sql.adaptive.enabled true

[jira] [Updated] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

[ https://issues.apache.org/jira/browse/SPARK-42728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42728: -- Attachment: image-2023-03-09-17-34-26-428.png > when enable AQE update or drop a small iceberg table

[jira] [Created] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

kevinshin created SPARK-42728: - Summary: when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config Key: SPARK-42728

[jira] [Commented] (SPARK-42727) Support executing spark commands in the root directory when local mode is specified

[ https://issues.apache.org/jira/browse/SPARK-42727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698279#comment-17698279 ] Apache Spark commented on SPARK-42727: -- User 'huangxiaopingRD' has created a pull request for this

[jira] [Assigned] (SPARK-42727) Support executing spark commands in the root directory when local mode is specified

[ https://issues.apache.org/jira/browse/SPARK-42727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42727: Assignee: Apache Spark > Support executing spark commands in the root directory when

[jira] [Commented] (SPARK-42727) Support executing spark commands in the root directory when local mode is specified

[ https://issues.apache.org/jira/browse/SPARK-42727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698277#comment-17698277 ] Apache Spark commented on SPARK-42727: -- User 'huangxiaopingRD' has created a pull request for this

[jira] [Assigned] (SPARK-42727) Support executing spark commands in the root directory when local mode is specified

[ https://issues.apache.org/jira/browse/SPARK-42727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42727: Assignee: (was: Apache Spark) > Support executing spark commands in the root

[jira] [Assigned] (SPARK-42726) Implement `DataFrame.mapInArrow`

[ https://issues.apache.org/jira/browse/SPARK-42726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42726: Assignee: Apache Spark > Implement `DataFrame.mapInArrow` >

[jira] [Assigned] (SPARK-42726) Implement `DataFrame.mapInArrow`

[ https://issues.apache.org/jira/browse/SPARK-42726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42726: Assignee: (was: Apache Spark) > Implement `DataFrame.mapInArrow` >

[jira] [Commented] (SPARK-42726) Implement `DataFrame.mapInArrow`

[ https://issues.apache.org/jira/browse/SPARK-42726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698273#comment-17698273 ] Apache Spark commented on SPARK-42726: -- User 'xinrong-meng' has created a pull request for this

[jira] [Created] (SPARK-42727) Support executing spark commands in the root directory when local mode is specified

xiaoping.huang created SPARK-42727: -- Summary: Support executing spark commands in the root directory when local mode is specified Key: SPARK-42727 URL: https://issues.apache.org/jira/browse/SPARK-42727

[jira] [Commented] (SPARK-42710) Rename FrameMap proto to MapPartitions

[ https://issues.apache.org/jira/browse/SPARK-42710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698271#comment-17698271 ] Apache Spark commented on SPARK-42710: -- User 'xinrong-meng' has created a pull request for this

[jira] [Created] (SPARK-42726) Implement `DataFrame.mapInArrow`

Xinrong Meng created SPARK-42726: Summary: Implement `DataFrame.mapInArrow` Key: SPARK-42726 URL: https://issues.apache.org/jira/browse/SPARK-42726 Project: Spark Issue Type: Sub-task

  1   2   >