[jira] [Updated] (SPARK-40014) Support cast of decimals to ANSI intervals

[ https://issues.apache.org/jira/browse/SPARK-40014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40014: - Description: Support casts of decimal to ANSI intervals, and preserve the fractional parts of seconds

[jira] [Created] (SPARK-40014) Support cast of decimals to ANSI intervals

Max Gekk created SPARK-40014: Summary: Support cast of decimals to ANSI intervals Key: SPARK-40014 URL: https://issues.apache.org/jira/browse/SPARK-40014 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-40014) Support cast of decimals to ANSI intervals

[ https://issues.apache.org/jira/browse/SPARK-40014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40014: Assignee: (was: Max Gekk) > Support cast of decimals to ANSI intervals >

[jira] [Updated] (SPARK-39470) Support cast of ANSI intervals to decimals

[ https://issues.apache.org/jira/browse/SPARK-39470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39470: - Parent: SPARK-27790 Issue Type: Sub-task (was: New Feature) > Support cast of ANSI intervals

[jira] [Updated] (SPARK-39451) Support casting intervals to integrals in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-39451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39451: - Parent: SPARK-27790 Issue Type: Sub-task (was: New Feature) > Support casting intervals to

[jira] [Updated] (SPARK-40008) Support casting integrals to intervals in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-40008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40008: - Parent: SPARK-27790 Issue Type: Sub-task (was: New Feature) > Support casting integrals to

[jira] [Resolved] (SPARK-40008) Support casting integrals to intervals in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-40008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40008. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37442

[jira] [Resolved] (SPARK-40013) DS V2 expressions should have the default implementation of toString

[ https://issues.apache.org/jira/browse/SPARK-40013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-40013. Resolution: Won't Fix > DS V2 expressions should have the default implementation of toString >

[jira] [Assigned] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40012: Assignee: Apache Spark > Make pyspark.sql.dataframe examples self-contained >

[jira] [Commented] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577127#comment-17577127 ] Apache Spark commented on SPARK-40012: -- User 'Transurgeon' has created a pull request for this

[jira] [Assigned] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40012: Assignee: (was: Apache Spark) > Make pyspark.sql.dataframe examples self-contained >

[jira] [Created] (SPARK-40013) DS V2 expressions should have the default implementation of toString

jiaan.geng created SPARK-40013: -- Summary: DS V2 expressions should have the default implementation of toString Key: SPARK-40013 URL: https://issues.apache.org/jira/browse/SPARK-40013 Project: Spark

[jira] [Updated] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Zijie Zhang updated SPARK-40012: Priority: Major (was: Minor) > Make pyspark.sql.dataframe examples

[jira] [Updated] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Zijie Zhang updated SPARK-40012: Component/s: PySpark > Make pyspark.sql.dataframe examples self-contained >

[jira] [Updated] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Zijie Zhang updated SPARK-40012: Affects Version/s: 3.4.0 (was: 3.3.0) > Make

[jira] [Created] (SPARK-40012) Make pyspark.sql.group examples self-contained

William Zijie Zhang created SPARK-40012: --- Summary: Make pyspark.sql.group examples self-contained Key: SPARK-40012 URL: https://issues.apache.org/jira/browse/SPARK-40012 Project: Spark

[jira] [Updated] (SPARK-40012) Make pyspark.sql.dataframe examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Zijie Zhang updated SPARK-40012: Summary: Make pyspark.sql.dataframe examples self-contained (was: Make

[jira] [Resolved] (SPARK-39819) DS V2 aggregate push down can work with Top N or Paging (Sort with group expressions)

[ https://issues.apache.org/jira/browse/SPARK-39819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39819. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37320

[jira] [Assigned] (SPARK-39819) DS V2 aggregate push down can work with Top N or Paging (Sort with group expressions)

[ https://issues.apache.org/jira/browse/SPARK-39819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39819: --- Assignee: jiaan.geng > DS V2 aggregate push down can work with Top N or Paging (Sort with

[jira] [Updated] (SPARK-40010) Make pyspark.sql.window examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40010: - Summary: Make pyspark.sql.window examples self-contained (was: Make pyspark.sql.windown

[jira] [Created] (SPARK-40011) Pandas API on Spark requires Pandas

Daniel Oakley created SPARK-40011: - Summary: Pandas API on Spark requires Pandas Key: SPARK-40011 URL: https://issues.apache.org/jira/browse/SPARK-40011 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-40007) Add Mode to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40007. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37438

[jira] [Assigned] (SPARK-40007) Add Mode to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40007: - Assignee: Ruifeng Zheng > Add Mode to PySpark > --- > >

[jira] [Created] (SPARK-40010) Make pyspark.sql.windown examples self-contained

Qian Sun created SPARK-40010: Summary: Make pyspark.sql.windown examples self-contained Key: SPARK-40010 URL: https://issues.apache.org/jira/browse/SPARK-40010 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40006) Make pyspark.sql.group examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40006: Assignee: Hyukjin Kwon (was: Apache Spark) > Make pyspark.sql.group examples

[jira] [Resolved] (SPARK-40006) Make pyspark.sql.group examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40006. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37437

[jira] [Assigned] (SPARK-40006) Make pyspark.sql.group examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40006: Assignee: Apache Spark > Make pyspark.sql.group examples self-contained >

[jira] [Resolved] (SPARK-40002) Limit improperly pushed down through window using ntile function

[ https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40002. -- Fix Version/s: 3.3.1 3.2.3 3.4.0 Resolution:

[jira] [Commented] (SPARK-39994) How to write (save) PySpark dataframe containing vector column?

[ https://issues.apache.org/jira/browse/SPARK-39994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577096#comment-17577096 ] Hyukjin Kwon commented on SPARK-39994: -- It has to be included hadoop instead of spark. > How to

[jira] [Assigned] (SPARK-40002) Limit improperly pushed down through window using ntile function

[ https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40002: Assignee: Bruce Robbins > Limit improperly pushed down through window using ntile

[jira] [Comment Edited] (SPARK-39995) PySpark installation doesn't support Scala 2.13 binaries

[ https://issues.apache.org/jira/browse/SPARK-39995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577057#comment-17577057 ] Haejoon Lee edited comment on SPARK-39995 at 8/9/22 12:37 AM: -- Let me take

[jira] [Commented] (SPARK-39995) PySpark installation doesn't support Scala 2.13 binaries

[ https://issues.apache.org/jira/browse/SPARK-39995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577057#comment-17577057 ] Haejoon Lee commented on SPARK-39995: - Let ma take a look > PySpark installation doesn't support

[jira] [Assigned] (SPARK-40003) Add median to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40003: - Assignee: Ruifeng Zheng > Add median to PySpark > - > >

[jira] [Resolved] (SPARK-40003) Add median to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40003. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37434

[jira] [Commented] (SPARK-40002) Limit improperly pushed down through window using ntile function

[ https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576973#comment-17576973 ] Apache Spark commented on SPARK-40002: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-40002) Limit improperly pushed down through window using ntile function

[ https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40002: Assignee: Apache Spark > Limit improperly pushed down through window using ntile

[jira] [Assigned] (SPARK-40002) Limit improperly pushed down through window using ntile function

[ https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40002: Assignee: (was: Apache Spark) > Limit improperly pushed down through window using

[jira] [Updated] (SPARK-40002) Limit improperly pushed down through window using ntile function

[ https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40002: -- Labels: correctness (was: ) > Limit improperly pushed down through window using ntile

[jira] [Updated] (SPARK-40002) Limit improperly pushed down through window using ntile function

[ https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40002: -- Summary: Limit improperly pushed down through window using ntile function (was: Limit pushed

[jira] [Resolved] (SPARK-40004) Redundant `LevelDB.get` in `RemoteBlockPushResolver`

[ https://issues.apache.org/jira/browse/SPARK-40004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40004. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-40004) Redundant `LevelDB.get` in `RemoteBlockPushResolver`

[ https://issues.apache.org/jira/browse/SPARK-40004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40004: --- Assignee: Yang Jie > Redundant `LevelDB.get` in `RemoteBlockPushResolver`

[jira] [Updated] (SPARK-39993) Spark on Kubernetes doesn't filter data by date

[ https://issues.apache.org/jira/browse/SPARK-39993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanna Liashchuk updated SPARK-39993: Description: I'm creating a Dataset with type date and saving it into s3. When I read it

[jira] [Commented] (SPARK-40009) Add doc string to DataFrame union and unionAll

[ https://issues.apache.org/jira/browse/SPARK-40009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576933#comment-17576933 ] Apache Spark commented on SPARK-40009: -- User 'khalidmammadov' has created a pull request for this

[jira] [Assigned] (SPARK-40009) Add doc string to DataFrame union and unionAll

[ https://issues.apache.org/jira/browse/SPARK-40009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40009: Assignee: Apache Spark > Add doc string to DataFrame union and unionAll >

[jira] [Assigned] (SPARK-40009) Add doc string to DataFrame union and unionAll

[ https://issues.apache.org/jira/browse/SPARK-40009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40009: Assignee: (was: Apache Spark) > Add doc string to DataFrame union and unionAll >

[jira] [Created] (SPARK-40009) Add doc string to DataFrame union and unionAll

Khalid Mammadov created SPARK-40009: --- Summary: Add doc string to DataFrame union and unionAll Key: SPARK-40009 URL: https://issues.apache.org/jira/browse/SPARK-40009 Project: Spark Issue

[jira] [Updated] (SPARK-39993) Spark on Kubernetes doesn't filter data by date

[ https://issues.apache.org/jira/browse/SPARK-39993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanna Liashchuk updated SPARK-39993: Description: I'm creating a Dataset with type date and saving it into s3. When I read it

[jira] [Resolved] (SPARK-39965) Skip PVC cleanup when driver doesn't own PVCs

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39965. --- Fix Version/s: 3.3.1 3.2.3 3.4.0 Resolution:

[jira] [Assigned] (SPARK-40008) Support casting integrals to intervals in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-40008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40008: Assignee: Max Gekk (was: Apache Spark) > Support casting integrals to intervals in ANSI

[jira] [Commented] (SPARK-40008) Support casting integrals to intervals in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-40008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576886#comment-17576886 ] Apache Spark commented on SPARK-40008: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40008) Support casting integrals to intervals in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-40008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40008: Assignee: Apache Spark (was: Max Gekk) > Support casting integrals to intervals in ANSI

[jira] [Created] (SPARK-40008) Support casting integrals to intervals in ANSI mode

Max Gekk created SPARK-40008: Summary: Support casting integrals to intervals in ANSI mode Key: SPARK-40008 URL: https://issues.apache.org/jira/browse/SPARK-40008 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-40008) Support casting integrals to intervals in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-40008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40008: - Fix Version/s: (was: 3.4.0) > Support casting integrals to intervals in ANSI mode >

[jira] [Assigned] (SPARK-39828) Catalog.listTables() should respect currentCatalog

[ https://issues.apache.org/jira/browse/SPARK-39828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39828: --- Assignee: Wenchen Fan > Catalog.listTables() should respect currentCatalog >

[jira] [Resolved] (SPARK-39912) Refine CatalogImpl

[ https://issues.apache.org/jira/browse/SPARK-39912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39912. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37287

[jira] [Resolved] (SPARK-39828) Catalog.listTables() should respect currentCatalog

[ https://issues.apache.org/jira/browse/SPARK-39828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39828. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37287

[jira] [Assigned] (SPARK-39912) Refine CatalogImpl

[ https://issues.apache.org/jira/browse/SPARK-39912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39912: --- Assignee: Wenchen Fan > Refine CatalogImpl > -- > > Key:

[jira] [Commented] (SPARK-35304) [k8s] Though finishing a job, the driver pod is running infinitely

[ https://issues.apache.org/jira/browse/SPARK-35304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576866#comment-17576866 ] Emilie Lin commented on SPARK-35304: Hi [~ocworld] do you have any updates for this issue? > [k8s]

[jira] [Commented] (SPARK-39994) How to write (save) PySpark dataframe containing vector column?

[ https://issues.apache.org/jira/browse/SPARK-39994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576853#comment-17576853 ] Muhammad Kaleem Ullah commented on SPARK-39994: --- I would like to request that it should be

[jira] [Commented] (SPARK-39994) How to write (save) PySpark dataframe containing vector column?

[ https://issues.apache.org/jira/browse/SPARK-39994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576851#comment-17576851 ] Muhammad Kaleem Ullah commented on SPARK-39994: --- Hi [~hyukjin.kwon], here is the full

[jira] [Commented] (SPARK-39965) Skip PVC cleanup when driver doesn't own PVCs

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576793#comment-17576793 ] pralabhkumar commented on SPARK-39965: -- [~dongjoon] Thx for taking this .  This is really helpful

[jira] [Updated] (SPARK-39976) NULL check in ArrayIntersect adds extraneous null from first param

[ https://issues.apache.org/jira/browse/SPARK-39976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-39976: -- Labels: correctness (was: ) > NULL check in ArrayIntersect adds extraneous null from first

[jira] [Commented] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576761#comment-17576761 ] Apache Spark commented on SPARK-36663: -- User 'mcdull-zhang' has created a pull request for this

[jira] [Commented] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576759#comment-17576759 ] Apache Spark commented on SPARK-36663: -- User 'mcdull-zhang' has created a pull request for this

[jira] [Assigned] (SPARK-39896) The structural integrity of the plan is broken after UnwrapCastInBinaryComparison

[ https://issues.apache.org/jira/browse/SPARK-39896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39896: Assignee: (was: Apache Spark) > The structural integrity of the plan is broken after

[jira] [Assigned] (SPARK-39896) The structural integrity of the plan is broken after UnwrapCastInBinaryComparison

[ https://issues.apache.org/jira/browse/SPARK-39896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39896: Assignee: Apache Spark > The structural integrity of the plan is broken after >

[jira] [Commented] (SPARK-39896) The structural integrity of the plan is broken after UnwrapCastInBinaryComparison

[ https://issues.apache.org/jira/browse/SPARK-39896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576754#comment-17576754 ] Apache Spark commented on SPARK-39896: -- User 'cfmcgrady' has created a pull request for this issue:

[jira] [Commented] (SPARK-40007) Add Mode to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576747#comment-17576747 ] Apache Spark commented on SPARK-40007: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40007) Add Mode to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40007: Assignee: (was: Apache Spark) > Add Mode to PySpark > --- > >

[jira] [Assigned] (SPARK-40007) Add Mode to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40007: Assignee: Apache Spark > Add Mode to PySpark > --- > >

[jira] [Commented] (SPARK-40007) Add Mode to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576746#comment-17576746 ] Apache Spark commented on SPARK-40007: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-40007) Add Mode to PySpark

Ruifeng Zheng created SPARK-40007: - Summary: Add Mode to PySpark Key: SPARK-40007 URL: https://issues.apache.org/jira/browse/SPARK-40007 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-40006) Make pyspark.sql.group examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40006: Assignee: (was: Apache Spark) > Make pyspark.sql.group examples self-contained >

[jira] [Commented] (SPARK-40006) Make pyspark.sql.group examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576744#comment-17576744 ] Apache Spark commented on SPARK-40006: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-40006) Make pyspark.sql.group examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40006: Assignee: Apache Spark > Make pyspark.sql.group examples self-contained >

[jira] [Updated] (SPARK-40005) Self-contained examples with parameter descriptions in PySpark documentation

[ https://issues.apache.org/jira/browse/SPARK-40005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40005: - Target Version/s: 3.4.0 > Self-contained examples with parameter descriptions in PySpark

[jira] [Commented] (SPARK-39995) PySpark installation doesn't support Scala 2.13 binaries

[ https://issues.apache.org/jira/browse/SPARK-39995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576731#comment-17576731 ] Oleksandr Shevchenko commented on SPARK-39995: -- Thanks [~hyukjin.kwon] for your reply.

[jira] [Assigned] (SPARK-39976) NULL check in ArrayIntersect adds extraneous null from first param

[ https://issues.apache.org/jira/browse/SPARK-39976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39976: Assignee: Apache Spark > NULL check in ArrayIntersect adds extraneous null from first

[jira] [Commented] (SPARK-39976) NULL check in ArrayIntersect adds extraneous null from first param

[ https://issues.apache.org/jira/browse/SPARK-39976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576730#comment-17576730 ] Apache Spark commented on SPARK-39976: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-39976) NULL check in ArrayIntersect adds extraneous null from first param

[ https://issues.apache.org/jira/browse/SPARK-39976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39976: Assignee: (was: Apache Spark) > NULL check in ArrayIntersect adds extraneous null

[jira] [Commented] (SPARK-39976) NULL check in ArrayIntersect adds extraneous null from first param

[ https://issues.apache.org/jira/browse/SPARK-39976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576729#comment-17576729 ] Apache Spark commented on SPARK-39976: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-40006) Make pyspark.sql.group examples self-contained

Hyukjin Kwon created SPARK-40006: Summary: Make pyspark.sql.group examples self-contained Key: SPARK-40006 URL: https://issues.apache.org/jira/browse/SPARK-40006 Project: Spark Issue Type:

[jira] [Created] (SPARK-40005) Self-contained examples with parameter descriptions in PySpark documentation

Hyukjin Kwon created SPARK-40005: Summary: Self-contained examples with parameter descriptions in PySpark documentation Key: SPARK-40005 URL: https://issues.apache.org/jira/browse/SPARK-40005

[jira] [Resolved] (SPARK-39973) Avoid noisy warnings logs when spark.scheduler.listenerbus.metrics.maxListenerClassesTimed = 0

[ https://issues.apache.org/jira/browse/SPARK-39973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39973. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37432

[jira] [Assigned] (SPARK-39973) Avoid noisy warnings logs when spark.scheduler.listenerbus.metrics.maxListenerClassesTimed = 0

[ https://issues.apache.org/jira/browse/SPARK-39973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39973: Assignee: Hyukjin Kwon > Avoid noisy warnings logs when >

[jira] [Commented] (SPARK-39753) Broadcast joins should pushdown join constraints as Filter to the larger relation

[ https://issues.apache.org/jira/browse/SPARK-39753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576643#comment-17576643 ] Nick Dimiduk commented on SPARK-39753: -- Linking to the original issue. > Broadcast joins should

[jira] [Assigned] (SPARK-40004) Redundant `LevelDB.get` in `RemoteBlockPushResolver`

[ https://issues.apache.org/jira/browse/SPARK-40004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40004: Assignee: (was: Apache Spark) > Redundant `LevelDB.get` in `RemoteBlockPushResolver`

[jira] [Assigned] (SPARK-40004) Redundant `LevelDB.get` in `RemoteBlockPushResolver`

[ https://issues.apache.org/jira/browse/SPARK-40004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40004: Assignee: Apache Spark > Redundant `LevelDB.get` in `RemoteBlockPushResolver` >

[jira] [Commented] (SPARK-40004) Redundant `LevelDB.get` in `RemoteBlockPushResolver`

[ https://issues.apache.org/jira/browse/SPARK-40004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576639#comment-17576639 ] Apache Spark commented on SPARK-40004: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-40004) Redundant `LevelDB.get` in `RemoteBlockPushResolver`

Yang Jie created SPARK-40004: Summary: Redundant `LevelDB.get` in `RemoteBlockPushResolver` Key: SPARK-40004 URL: https://issues.apache.org/jira/browse/SPARK-40004 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40003) Add median to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40003: Assignee: Apache Spark > Add median to PySpark > - > >

[jira] [Assigned] (SPARK-40003) Add median to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40003: Assignee: (was: Apache Spark) > Add median to PySpark > - > >

[jira] [Commented] (SPARK-40003) Add median to PySpark

[ https://issues.apache.org/jira/browse/SPARK-40003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576617#comment-17576617 ] Apache Spark commented on SPARK-40003: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-40003) Add median to PySpark

Ruifeng Zheng created SPARK-40003: - Summary: Add median to PySpark Key: SPARK-40003 URL: https://issues.apache.org/jira/browse/SPARK-40003 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-39965) Skip PVC cleanup when driver doesn't own PVCs

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39965: -- Summary: Skip PVC cleanup when driver doesn't own PVCs (was: Spark on K8s delete pvc even

[jira] [Assigned] (SPARK-39965) Skip PVC cleanup when driver doesn't own PVCs

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39965: - Assignee: pralabhkumar > Skip PVC cleanup when driver doesn't own PVCs >

[jira] [Commented] (SPARK-39965) Spark on K8s delete pvc even though it's not being used.

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576558#comment-17576558 ] Apache Spark commented on SPARK-39965: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39965) Spark on K8s delete pvc even though it's not being used.

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39965: Assignee: (was: Apache Spark) > Spark on K8s delete pvc even though it's not being

[jira] [Commented] (SPARK-39965) Spark on K8s delete pvc even though it's not being used.

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576557#comment-17576557 ] Apache Spark commented on SPARK-39965: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39965) Spark on K8s delete pvc even though it's not being used.

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39965: Assignee: Apache Spark > Spark on K8s delete pvc even though it's not being used. >

  1   2   >