[jira] [Updated] (SPARK-37512) Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype

[ https://issues.apache.org/jira/browse/SPARK-37512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-37512: - Summary: Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype (was:

[jira] [Commented] (SPARK-36396) Implement DataFrame.cov

[ https://issues.apache.org/jira/browse/SPARK-36396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452194#comment-17452194 ] Apache Spark commented on SPARK-36396: -- User 'dchvn' has created a pull request for this issue:

[jira] [Commented] (SPARK-37326) Support TimestampNTZ in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-37326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452178#comment-17452178 ] Apache Spark commented on SPARK-37326: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Commented] (SPARK-37326) Support TimestampNTZ in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-37326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452177#comment-17452177 ] Apache Spark commented on SPARK-37326: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Commented] (SPARK-37512) Support TimedeltaIndex creation given a timedelta Series/Index

[ https://issues.apache.org/jira/browse/SPARK-37512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452175#comment-17452175 ] Apache Spark commented on SPARK-37512: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-37512) Support TimedeltaIndex creation given a timedelta Series/Index

[ https://issues.apache.org/jira/browse/SPARK-37512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37512: Assignee: (was: Apache Spark) > Support TimedeltaIndex creation given a timedelta

[jira] [Assigned] (SPARK-37512) Support TimedeltaIndex creation given a timedelta Series/Index

[ https://issues.apache.org/jira/browse/SPARK-37512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37512: Assignee: Apache Spark > Support TimedeltaIndex creation given a timedelta Series/Index

[jira] [Commented] (SPARK-37512) Support TimedeltaIndex creation given a timedelta Series/Index

[ https://issues.apache.org/jira/browse/SPARK-37512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452174#comment-17452174 ] Apache Spark commented on SPARK-37512: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-37511) Introduce TimedeltaIndex to pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452172#comment-17452172 ] Apache Spark commented on SPARK-37511: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37516) Uses Python's standard string formatter for SQL API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-37516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37516: Assignee: Apache Spark > Uses Python's standard string formatter for SQL API in PySpark

[jira] [Commented] (SPARK-37516) Uses Python's standard string formatter for SQL API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-37516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452171#comment-17452171 ] Apache Spark commented on SPARK-37516: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-37516) Uses Python's standard string formatter for SQL API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-37516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452170#comment-17452170 ] Apache Spark commented on SPARK-37516: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37516) Uses Python's standard string formatter for SQL API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-37516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37516: Assignee: (was: Apache Spark) > Uses Python's standard string formatter for SQL API

[jira] [Created] (SPARK-37516) Uses Python's standard string formatter for SQL API in PySpark

Hyukjin Kwon created SPARK-37516: Summary: Uses Python's standard string formatter for SQL API in PySpark Key: SPARK-37516 URL: https://issues.apache.org/jira/browse/SPARK-37516 Project: Spark

[jira] [Resolved] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command

[ https://issues.apache.org/jira/browse/SPARK-37494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37494. - Resolution: Fixed Issue resolved by pull request 34753

[jira] [Assigned] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command

[ https://issues.apache.org/jira/browse/SPARK-37494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37494: --- Assignee: PengLei > Unify v1 and v2 options output of `SHOW CREATE TABLE` command >

[jira] [Commented] (SPARK-33898) Support SHOW CREATE TABLE in v2

[ https://issues.apache.org/jira/browse/SPARK-33898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452164#comment-17452164 ] Apache Spark commented on SPARK-33898: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Commented] (SPARK-37476) udaf doesnt work with nullable (or option of) case class result

[ https://issues.apache.org/jira/browse/SPARK-37476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452118#comment-17452118 ] koert kuipers commented on SPARK-37476: --- note that changing my case class to: {code:java} case

[jira] [Assigned] (SPARK-37514) Remove workarounds due to older pandas

[ https://issues.apache.org/jira/browse/SPARK-37514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37514: Assignee: Takuya Ueshin > Remove workarounds due to older pandas >

[jira] [Resolved] (SPARK-37514) Remove workarounds due to older pandas

[ https://issues.apache.org/jira/browse/SPARK-37514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37514. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34772

[jira] [Commented] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py

[ https://issues.apache.org/jira/browse/SPARK-37430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452114#comment-17452114 ] Jyoti Singh commented on SPARK-37430: - Sure, I’ll check the other one first. > Inline type hints

[jira] [Commented] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py

[ https://issues.apache.org/jira/browse/SPARK-37430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452110#comment-17452110 ] Maciej Szymkiewicz commented on SPARK-37430: Thank you [~jyoti_08], but please keep in mind

[jira] [Comment Edited] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py

[ https://issues.apache.org/jira/browse/SPARK-37430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452110#comment-17452110 ] Maciej Szymkiewicz edited comment on SPARK-37430 at 12/2/21, 1:35 AM:

[jira] [Commented] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py

[ https://issues.apache.org/jira/browse/SPARK-37430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452103#comment-17452103 ] Jyoti Singh commented on SPARK-37430: - I can start working on this issue. > Inline type hints for

[jira] [Comment Edited] (SPARK-37476) udaf doesnt work with nullable (or option of) case class result

[ https://issues.apache.org/jira/browse/SPARK-37476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452101#comment-17452101 ] koert kuipers edited comment on SPARK-37476 at 12/2/21, 12:58 AM: -- i

[jira] [Commented] (SPARK-37476) udaf doesnt work with nullable (or option of) case class result

[ https://issues.apache.org/jira/browse/SPARK-37476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452101#comment-17452101 ] koert kuipers commented on SPARK-37476: --- i get that scala Double cannot be null. however i dont

[jira] [Commented] (SPARK-37476) udaf doesnt work with nullable (or option of) case class result

[ https://issues.apache.org/jira/browse/SPARK-37476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452099#comment-17452099 ] Hyukjin Kwon commented on SPARK-37476: -- Awesome! In Scala, their double cannot be null: {code}

[jira] [Commented] (SPARK-37515) minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds)

[ https://issues.apache.org/jira/browse/SPARK-37515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452097#comment-17452097 ] Sungpeo Kook commented on SPARK-37515: -- I couldn't find the proper JIRA's components for Kafka

[jira] [Assigned] (SPARK-37515) minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds)

[ https://issues.apache.org/jira/browse/SPARK-37515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37515: Assignee: (was: Apache Spark) > minRatePerPartition works as "max messages per

[jira] [Assigned] (SPARK-37515) minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds)

[ https://issues.apache.org/jira/browse/SPARK-37515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37515: Assignee: Apache Spark > minRatePerPartition works as "max messages per partition per a

[jira] [Created] (SPARK-37515) minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds)

Sungpeo Kook created SPARK-37515: Summary: minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds) Key: SPARK-37515 URL: https://issues.apache.org/jira/browse/SPARK-37515

[jira] [Assigned] (SPARK-37514) Remove workarounds due to older pandas

[ https://issues.apache.org/jira/browse/SPARK-37514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37514: Assignee: Apache Spark > Remove workarounds due to older pandas >

[jira] [Assigned] (SPARK-37514) Remove workarounds due to older pandas

[ https://issues.apache.org/jira/browse/SPARK-37514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37514: Assignee: (was: Apache Spark) > Remove workarounds due to older pandas >

[jira] [Commented] (SPARK-37514) Remove workarounds due to older pandas

[ https://issues.apache.org/jira/browse/SPARK-37514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452092#comment-17452092 ] Apache Spark commented on SPARK-37514: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-37514) Remove workarounds due to older pandas

Takuya Ueshin created SPARK-37514: - Summary: Remove workarounds due to older pandas Key: SPARK-37514 URL: https://issues.apache.org/jira/browse/SPARK-37514 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26589) proper `median` method for spark dataframe

[ https://issues.apache.org/jira/browse/SPARK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452089#comment-17452089 ] Sean R. Owen commented on SPARK-26589: -- That approach ends up being about n log n and seems worse

[jira] [Assigned] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command

[ https://issues.apache.org/jira/browse/SPARK-37496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-37496: -- Assignee: Huaxin Gao > Migrate ReplaceTableAsSelectStatement to v2 command >

[jira] [Resolved] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command

[ https://issues.apache.org/jira/browse/SPARK-37496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37496. Resolution: Fixed > Migrate ReplaceTableAsSelectStatement to v2 command >

[jira] [Commented] (SPARK-26589) proper `median` method for spark dataframe

[ https://issues.apache.org/jira/browse/SPARK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452081#comment-17452081 ] Nicholas Chammas commented on SPARK-26589: -- [~srowen] - I'll ask for help on the dev list if

[jira] [Commented] (SPARK-26589) proper `median` method for spark dataframe

[ https://issues.apache.org/jira/browse/SPARK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451936#comment-17451936 ] Nicholas Chammas commented on SPARK-26589: -- Just for reference, Stack Overflow provides

[jira] [Updated] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate

[ https://issues.apache.org/jira/browse/SPARK-37480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37480: -- Affects Version/s: 3.2.0 (was: 3.3.0) > Configurations in

[jira] [Updated] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate

[ https://issues.apache.org/jira/browse/SPARK-37480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37480: -- Fix Version/s: 3.2.1 > Configurations in docs/running-on-kubernetes.md are not uptodate >

[jira] [Commented] (SPARK-37476) udaf doesnt work with nullable (or option of) case class result

[ https://issues.apache.org/jira/browse/SPARK-37476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451921#comment-17451921 ] koert kuipers commented on SPARK-37476: --- yes it works well     {code:java} import

[jira] [Comment Edited] (SPARK-37476) udaf doesnt work with nullable (or option of) case class result

[ https://issues.apache.org/jira/browse/SPARK-37476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451921#comment-17451921 ] koert kuipers edited comment on SPARK-37476 at 12/1/21, 4:57 PM: - yes it

[jira] [Commented] (SPARK-37326) Support TimestampNTZ in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-37326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451900#comment-17451900 ] Apache Spark commented on SPARK-37326: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-37326) Support TimestampNTZ in CSV data source

[ https://issues.apache.org/jira/browse/SPARK-37326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451899#comment-17451899 ] Apache Spark commented on SPARK-37326: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate

[ https://issues.apache.org/jira/browse/SPARK-37480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451882#comment-17451882 ] Apache Spark commented on SPARK-37480: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37501) CREATE/REPLACE TABLE should qualify location for v2 command

[ https://issues.apache.org/jira/browse/SPARK-37501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37501: --- Assignee: PengLei > CREATE/REPLACE TABLE should qualify location for v2 command >

[jira] [Resolved] (SPARK-37501) CREATE/REPLACE TABLE should qualify location for v2 command

[ https://issues.apache.org/jira/browse/SPARK-37501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37501. - Resolution: Fixed Issue resolved by pull request 34758

[jira] [Commented] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451767#comment-17451767 ] Apache Spark commented on SPARK-37463: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451766#comment-17451766 ] Apache Spark commented on SPARK-37463: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-11150) Dynamic partition pruning

[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451764#comment-17451764 ] Apache Spark commented on SPARK-11150: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37460) ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION command not documented

[ https://issues.apache.org/jira/browse/SPARK-37460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37460: --- Assignee: Yuto Akutsu > ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION command not

[jira] [Commented] (SPARK-11150) Dynamic partition pruning

[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451762#comment-17451762 ] Apache Spark commented on SPARK-11150: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37460) ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION command not documented

[ https://issues.apache.org/jira/browse/SPARK-37460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37460. - Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-37508) Add CONTAINS() function

[ https://issues.apache.org/jira/browse/SPARK-37508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-37508: Assignee: angerszhu > Add CONTAINS() function > --- > > Key:

[jira] [Resolved] (SPARK-37508) Add CONTAINS() function

[ https://issues.apache.org/jira/browse/SPARK-37508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-37508. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34761

[jira] [Assigned] (SPARK-37511) Introduce TimedeltaIndex to pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37511: Assignee: Xinrong Meng > Introduce TimedeltaIndex to pandas API on Spark >

[jira] [Resolved] (SPARK-37511) Introduce TimedeltaIndex to pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37511. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34657

[jira] [Comment Edited] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451620#comment-17451620 ] zhangyangyang edited comment on SPARK-35332 at 12/1/21, 8:49 AM: -

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451620#comment-17451620 ] zhangyangyang commented on SPARK-35332: --- https://issues.apache.org/jira/browse/MAPREDUCE-6944,

[jira] [Commented] (SPARK-37461) yarn-client mode client's appid value is null

[ https://issues.apache.org/jira/browse/SPARK-37461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451619#comment-17451619 ] Apache Spark commented on SPARK-37461: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-37512) Support TimedeltaIndex creation given a timedelta Series/Index

[ https://issues.apache.org/jira/browse/SPARK-37512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451610#comment-17451610 ] Xinrong Meng commented on SPARK-37512: -- I am working on this. > Support TimedeltaIndex creation

[jira] [Resolved] (SPARK-37513) date +/- interval with only day-time fields returns different data type between Spark3.2 and Spark3.1

[ https://issues.apache.org/jira/browse/SPARK-37513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37513. - Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-37513) date +/- interval with only day-time fields returns different data type between Spark3.2 and Spark3.1

[ https://issues.apache.org/jira/browse/SPARK-37513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37513: --- Assignee: jiaan.geng > date +/- interval with only day-time fields returns different data

[jira] [Assigned] (SPARK-37458) Remove unnecessary object serialization on foreachBatch

[ https://issues.apache.org/jira/browse/SPARK-37458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37458: - Assignee: Jungtaek Lim > Remove unnecessary object serialization on foreachBatch >

[jira] [Resolved] (SPARK-37458) Remove unnecessary object serialization on foreachBatch

[ https://issues.apache.org/jira/browse/SPARK-37458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37458. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34706