[jira] [Created] (SPARK-36900) "SPARK-36464: size returns correct positive number even with over 2GB data" will oom with JDK17

Yang Jie created SPARK-36900: Summary: "SPARK-36464: size returns correct positive number even with over 2GB data" will oom with JDK17 Key: SPARK-36900 URL: https://issues.apache.org/jira/browse/SPARK-36900

[jira] [Resolved] (SPARK-36899) Support ILIKE API on R

[ https://issues.apache.org/jira/browse/SPARK-36899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36899. Fix Version/s: 3.3.0 Assignee: Leona Yoda Resolution: Fixed Issue

[jira] [Assigned] (SPARK-36896) Return boolean for `dropTempView` and `dropGlobalTempView`

[ https://issues.apache.org/jira/browse/SPARK-36896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36896: Assignee: Xinrong Meng > Return boolean for `dropTempView` and `dropGlobalTempView` >

[jira] [Resolved] (SPARK-36896) Return boolean for `dropTempView` and `dropGlobalTempView`

[ https://issues.apache.org/jira/browse/SPARK-36896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36896. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34147

[jira] [Commented] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422533#comment-17422533 ] Gengliang Wang commented on SPARK-36892: [~zhouyejoe] Thank you! > Disable batch fetch for a

[jira] [Resolved] (SPARK-36893) upgrade mesos into 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-36893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36893. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34144

[jira] [Assigned] (SPARK-36893) upgrade mesos into 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-36893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36893: - Assignee: Zhongwei Zhu > upgrade mesos into 1.4.3 > > >

[jira] [Commented] (SPARK-36796) Make all unit tests pass on Java 17

[ https://issues.apache.org/jira/browse/SPARK-36796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422517#comment-17422517 ] Apache Spark commented on SPARK-36796: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-36796) Make all unit tests pass on Java 17

[ https://issues.apache.org/jira/browse/SPARK-36796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36796: Assignee: (was: Apache Spark) > Make all unit tests pass on Java 17 >

[jira] [Assigned] (SPARK-36796) Make all unit tests pass on Java 17

[ https://issues.apache.org/jira/browse/SPARK-36796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36796: Assignee: Apache Spark > Make all unit tests pass on Java 17 >

[jira] [Commented] (SPARK-36796) Make all unit tests pass on Java 17

[ https://issues.apache.org/jira/browse/SPARK-36796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422516#comment-17422516 ] Apache Spark commented on SPARK-36796: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-36899) Support ILIKE API on R

[ https://issues.apache.org/jira/browse/SPARK-36899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422507#comment-17422507 ] Apache Spark commented on SPARK-36899: -- User 'yoda-mon' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36899) Support ILIKE API on R

[ https://issues.apache.org/jira/browse/SPARK-36899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36899: Assignee: (was: Apache Spark) > Support ILIKE API on R > -- > >

[jira] [Commented] (SPARK-36899) Support ILIKE API on R

[ https://issues.apache.org/jira/browse/SPARK-36899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422506#comment-17422506 ] Apache Spark commented on SPARK-36899: -- User 'yoda-mon' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36899) Support ILIKE API on R

[ https://issues.apache.org/jira/browse/SPARK-36899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36899: Assignee: Apache Spark > Support ILIKE API on R > -- > >

[jira] [Assigned] (SPARK-36886) Inline type hints for python/pyspark/sql/context.py

[ https://issues.apache.org/jira/browse/SPARK-36886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36886: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/sql/context.py

[jira] [Commented] (SPARK-36886) Inline type hints for python/pyspark/sql/context.py

[ https://issues.apache.org/jira/browse/SPARK-36886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422503#comment-17422503 ] Apache Spark commented on SPARK-36886: -- User 'dgd-contributor' has created a pull request for this

[jira] [Assigned] (SPARK-36886) Inline type hints for python/pyspark/sql/context.py

[ https://issues.apache.org/jira/browse/SPARK-36886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36886: Assignee: Apache Spark > Inline type hints for python/pyspark/sql/context.py >

[jira] [Created] (SPARK-36899) Support ILIKE API on R

Leona Yoda created SPARK-36899: -- Summary: Support ILIKE API on R Key: SPARK-36899 URL: https://issues.apache.org/jira/browse/SPARK-36899 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36898) Make the shuffle hash join factor configurable

[ https://issues.apache.org/jira/browse/SPARK-36898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422499#comment-17422499 ] Apache Spark commented on SPARK-36898: -- User 'JkSelf' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36898) Make the shuffle hash join factor configurable

[ https://issues.apache.org/jira/browse/SPARK-36898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36898: Assignee: Apache Spark > Make the shuffle hash join factor configurable >

[jira] [Commented] (SPARK-36898) Make the shuffle hash join factor configurable

[ https://issues.apache.org/jira/browse/SPARK-36898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422498#comment-17422498 ] Apache Spark commented on SPARK-36898: -- User 'JkSelf' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36898) Make the shuffle hash join factor configurable

[ https://issues.apache.org/jira/browse/SPARK-36898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36898: Assignee: (was: Apache Spark) > Make the shuffle hash join factor configurable >

[jira] [Created] (SPARK-36898) Make the shuffle hash join factor configurable

Ke Jia created SPARK-36898: -- Summary: Make the shuffle hash join factor configurable Key: SPARK-36898 URL: https://issues.apache.org/jira/browse/SPARK-36898 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-36897) Replace collections.namedtuple() by typing.NamedTuple

Xinrong Meng created SPARK-36897: Summary: Replace collections.namedtuple() by typing.NamedTuple Key: SPARK-36897 URL: https://issues.apache.org/jira/browse/SPARK-36897 Project: Spark Issue

[jira] [Commented] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422487#comment-17422487 ] Takuya Ueshin commented on SPARK-36845: --- For the {{_typing.pyi}}, it uses {{Protocol}} that is

[jira] [Comment Edited] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422486#comment-17422486 ] Takuya Ueshin edited comment on SPARK-36845 at 9/30/21, 1:36 AM: - It

[jira] [Commented] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422486#comment-17422486 ] Takuya Ueshin commented on SPARK-36845: --- It would be great if we could use the "annotation" future

[jira] [Updated] (SPARK-36830) Read/write dataframes with ANSI intervals from/to JSON files

[ https://issues.apache.org/jira/browse/SPARK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36830: --- Description: Implement writing and reading ANSI intervals (year-month and day-time

[jira] [Commented] (SPARK-36830) Read/write dataframes with ANSI intervals from/to JSON files

[ https://issues.apache.org/jira/browse/SPARK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422483#comment-17422483 ] Kousuke Saruta commented on SPARK-36830: Thank you, will do. > Read/write dataframes with ANSI

[jira] [Resolved] (SPARK-36888) Sha2 with bit_length 512 not being tested

[ https://issues.apache.org/jira/browse/SPARK-36888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36888. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34145

[jira] [Assigned] (SPARK-36888) Sha2 with bit_length 512 not being tested

[ https://issues.apache.org/jira/browse/SPARK-36888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36888: Assignee: Richard Chen > Sha2 with bit_length 512 not being tested >

[jira] [Commented] (SPARK-36891) Add new test suite to cover Parquet decoding

[ https://issues.apache.org/jira/browse/SPARK-36891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422480#comment-17422480 ] Apache Spark commented on SPARK-36891: -- User 'sunchao' has created a pull request for this issue:

[jira] [Commented] (SPARK-36891) Add new test suite to cover Parquet decoding

[ https://issues.apache.org/jira/browse/SPARK-36891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422476#comment-17422476 ] Apache Spark commented on SPARK-36891: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36891) Add new test suite to cover Parquet decoding

[ https://issues.apache.org/jira/browse/SPARK-36891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36891: Assignee: Apache Spark > Add new test suite to cover Parquet decoding >

[jira] [Assigned] (SPARK-36891) Add new test suite to cover Parquet decoding

[ https://issues.apache.org/jira/browse/SPARK-36891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36891: Assignee: (was: Apache Spark) > Add new test suite to cover Parquet decoding >

[jira] [Commented] (SPARK-36895) Add Create Index syntax support

[ https://issues.apache.org/jira/browse/SPARK-36895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422468#comment-17422468 ] Apache Spark commented on SPARK-36895: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-36895) Add Create Index syntax support

[ https://issues.apache.org/jira/browse/SPARK-36895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422466#comment-17422466 ] Apache Spark commented on SPARK-36895: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36895) Add Create Index syntax support

[ https://issues.apache.org/jira/browse/SPARK-36895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36895: Assignee: (was: Apache Spark) > Add Create Index syntax support >

[jira] [Assigned] (SPARK-36895) Add Create Index syntax support

[ https://issues.apache.org/jira/browse/SPARK-36895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36895: Assignee: Apache Spark > Add Create Index syntax support >

[jira] [Commented] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422464#comment-17422464 ] Hyukjin Kwon commented on SPARK-36845: -- Yeah, _typing.pyi one I am not sure. Agree we should think

[jira] [Updated] (SPARK-36894) RDD.toDF should be synchronized with dispatched variants of SparkSession.createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-36894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-36894: --- Description: There are some variants that are supported: * Providing a schema as a

[jira] [Updated] (SPARK-36894) RDD.toDF should be synchronized with dispatched variants of SparkSession.createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-36894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-36894: --- Summary: RDD.toDF should be synchronized with dispatched variants of

[jira] [Updated] (SPARK-36896) Return boolean for `dropTempView` and `dropGlobalTempView`

[ https://issues.apache.org/jira/browse/SPARK-36896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36896: - Environment: Currently`dropTempView` and `dropGlobalTempView` don't have return value, which

[jira] [Updated] (SPARK-36896) Return boolean for `dropTempView` and `dropGlobalTempView`

[ https://issues.apache.org/jira/browse/SPARK-36896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36896: - Summary: Return boolean for `dropTempView` and `dropGlobalTempView` (was: Fix returns of

[jira] [Updated] (SPARK-36896) Fix returns of functions in python/pyspark/sql/catalog.py

[ https://issues.apache.org/jira/browse/SPARK-36896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36896: - Summary: Fix returns of functions in python/pyspark/sql/catalog.py (was: Fix returns of

[jira] [Commented] (SPARK-36896) Fix returns of functions python/pyspark/sql/catalog.py

[ https://issues.apache.org/jira/browse/SPARK-36896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422440#comment-17422440 ] Apache Spark commented on SPARK-36896: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-36896) Fix returns of functions python/pyspark/sql/catalog.py

[ https://issues.apache.org/jira/browse/SPARK-36896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36896: Assignee: Apache Spark > Fix returns of functions python/pyspark/sql/catalog.py >

[jira] [Commented] (SPARK-36896) Fix returns of functions python/pyspark/sql/catalog.py

[ https://issues.apache.org/jira/browse/SPARK-36896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422439#comment-17422439 ] Apache Spark commented on SPARK-36896: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-36896) Fix returns of functions python/pyspark/sql/catalog.py

[ https://issues.apache.org/jira/browse/SPARK-36896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36896: Assignee: (was: Apache Spark) > Fix returns of functions

[jira] [Created] (SPARK-36896) Fix returns of functions python/pyspark/sql/catalog.py

Xinrong Meng created SPARK-36896: Summary: Fix returns of functions python/pyspark/sql/catalog.py Key: SPARK-36896 URL: https://issues.apache.org/jira/browse/SPARK-36896 Project: Spark Issue

[jira] [Created] (SPARK-36895) Add Create Index syntax support

Huaxin Gao created SPARK-36895: -- Summary: Add Create Index syntax support Key: SPARK-36895 URL: https://issues.apache.org/jira/browse/SPARK-36895 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36894) RDD.toDF should support string schema

[ https://issues.apache.org/jira/browse/SPARK-36894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422430#comment-17422430 ] Apache Spark commented on SPARK-36894: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36894) RDD.toDF should support string schema

[ https://issues.apache.org/jira/browse/SPARK-36894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36894: Assignee: (was: Apache Spark) > RDD.toDF should support string schema >

[jira] [Commented] (SPARK-36894) RDD.toDF should support string schema

[ https://issues.apache.org/jira/browse/SPARK-36894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422429#comment-17422429 ] Apache Spark commented on SPARK-36894: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36894) RDD.toDF should support string schema

[ https://issues.apache.org/jira/browse/SPARK-36894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36894: Assignee: Apache Spark > RDD.toDF should support string schema >

[jira] [Commented] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422425#comment-17422425 ] Ye Zhou commented on SPARK-36892: - I am working on this issue. We have a job which can reproduce this

[jira] [Created] (SPARK-36894) RDD.toDF should support string schema

Maciej Szymkiewicz created SPARK-36894: -- Summary: RDD.toDF should support string schema Key: SPARK-36894 URL: https://issues.apache.org/jira/browse/SPARK-36894 Project: Spark Issue

[jira] [Assigned] (SPARK-36888) Sha2 with bit_length 512 not being tested

[ https://issues.apache.org/jira/browse/SPARK-36888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36888: Assignee: (was: Apache Spark) > Sha2 with bit_length 512 not being tested >

[jira] [Commented] (SPARK-36888) Sha2 with bit_length 512 not being tested

[ https://issues.apache.org/jira/browse/SPARK-36888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422424#comment-17422424 ] Apache Spark commented on SPARK-36888: -- User 'richardc-db' has created a pull request for this

[jira] [Assigned] (SPARK-36888) Sha2 with bit_length 512 not being tested

[ https://issues.apache.org/jira/browse/SPARK-36888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36888: Assignee: Apache Spark > Sha2 with bit_length 512 not being tested >

[jira] [Commented] (SPARK-36888) Sha2 with bit_length 512 not being tested

[ https://issues.apache.org/jira/browse/SPARK-36888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422422#comment-17422422 ] Apache Spark commented on SPARK-36888: -- User 'richardc-db' has created a pull request for this

[jira] [Commented] (SPARK-36893) upgrade mesos into 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-36893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422395#comment-17422395 ] Apache Spark commented on SPARK-36893: -- User 'warrenzhu25' has created a pull request for this

[jira] [Commented] (SPARK-36893) upgrade mesos into 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-36893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422393#comment-17422393 ] Apache Spark commented on SPARK-36893: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-36893) upgrade mesos into 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-36893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36893: Assignee: Apache Spark > upgrade mesos into 1.4.3 > > >

[jira] [Assigned] (SPARK-36893) upgrade mesos into 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-36893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36893: Assignee: (was: Apache Spark) > upgrade mesos into 1.4.3 >

[jira] [Created] (SPARK-36893) upgrade mesos into 1.4.3

Zhongwei Zhu created SPARK-36893: Summary: upgrade mesos into 1.4.3 Key: SPARK-36893 URL: https://issues.apache.org/jira/browse/SPARK-36893 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422379#comment-17422379 ] Maciej Szymkiewicz commented on SPARK-36845: Additionally, we should probably rethink

[jira] [Commented] (SPARK-36869) Spark job fails due to java.io.InvalidClassException: scala.collection.mutable.WrappedArray$ofRef; local class incompatible

[ https://issues.apache.org/jira/browse/SPARK-36869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422375#comment-17422375 ] Hamid EL MAAZOUZ commented on SPARK-36869: -- Thank you :) > Spark job fails due to

[jira] [Created] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

Mridul Muralidharan created SPARK-36892: --- Summary: Disable batch fetch for a shuffle when push based shuffle is enabled Key: SPARK-36892 URL: https://issues.apache.org/jira/browse/SPARK-36892

[jira] [Comment Edited] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422371#comment-17422371 ] Maciej Szymkiewicz edited comment on SPARK-36845 at 9/29/21, 8:14 PM:

[jira] [Comment Edited] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422371#comment-17422371 ] Maciej Szymkiewicz edited comment on SPARK-36845 at 9/29/21, 8:13 PM:

[jira] [Commented] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422371#comment-17422371 ] Maciej Szymkiewicz commented on SPARK-36845: I'd recommend adding SPARK-36145 as blocker for

[jira] [Commented] (SPARK-36830) Read/write dataframes with ANSI intervals from/to JSON files

[ https://issues.apache.org/jira/browse/SPARK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422341#comment-17422341 ] Max Gekk commented on SPARK-36830: -- [~sarutak] FYI, I don't plan to work on this. Please, feel free to

[jira] [Resolved] (SPARK-36883) Upgrade R version to 4.1.1 in CI images

[ https://issues.apache.org/jira/browse/SPARK-36883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36883. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34138

[jira] [Assigned] (SPARK-36883) Upgrade R version to 4.1.1 in CI images

[ https://issues.apache.org/jira/browse/SPARK-36883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36883: - Assignee: Dongjoon Hyun > Upgrade R version to 4.1.1 in CI images >

[jira] [Resolved] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36831. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34142

[jira] [Assigned] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36831: Assignee: Kousuke Saruta > Read/write dataframes with ANSI intervals from/to CSV files >

[jira] [Created] (SPARK-36891) Add new test suite to cover Parquet decoding

Chao Sun created SPARK-36891: Summary: Add new test suite to cover Parquet decoding Key: SPARK-36891 URL: https://issues.apache.org/jira/browse/SPARK-36891 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-36869) Spark job fails due to java.io.InvalidClassException: scala.collection.mutable.WrappedArray$ofRef; local class incompatible

[ https://issues.apache.org/jira/browse/SPARK-36869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422294#comment-17422294 ] Dongjoon Hyun commented on SPARK-36869: --- Thank you for your confirmation, [~hamidelmaazouz]. As

[jira] [Commented] (SPARK-36890) Websocket timeouts to K8s-API

[ https://issues.apache.org/jira/browse/SPARK-36890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422252#comment-17422252 ] Apache Spark commented on SPARK-36890: -- User 'Reamer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36890) Websocket timeouts to K8s-API

[ https://issues.apache.org/jira/browse/SPARK-36890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36890: Assignee: (was: Apache Spark) > Websocket timeouts to K8s-API >

[jira] [Commented] (SPARK-36890) Websocket timeouts to K8s-API

[ https://issues.apache.org/jira/browse/SPARK-36890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422253#comment-17422253 ] Apache Spark commented on SPARK-36890: -- User 'Reamer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36890) Websocket timeouts to K8s-API

[ https://issues.apache.org/jira/browse/SPARK-36890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36890: Assignee: Apache Spark > Websocket timeouts to K8s-API > - >

[jira] [Created] (SPARK-36890) Websocket timeouts to K8s-API

Philipp Dallig created SPARK-36890: -- Summary: Websocket timeouts to K8s-API Key: SPARK-36890 URL: https://issues.apache.org/jira/browse/SPARK-36890 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-36869) Spark job fails due to java.io.InvalidClassException: scala.collection.mutable.WrappedArray$ofRef; local class incompatible

[ https://issues.apache.org/jira/browse/SPARK-36869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422240#comment-17422240 ] Hamid EL MAAZOUZ commented on SPARK-36869: -- Testing Scala 2.12.15 against old Spark jars (3.1.2

[jira] [Resolved] (SPARK-36624) When application killed, sc should not exit with code 0

[ https://issues.apache.org/jira/browse/SPARK-36624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-36624. --- Fix Version/s: 3.3.0 Assignee: angerszhu Resolution: Fixed > When

[jira] [Commented] (SPARK-36869) Spark job fails due to java.io.InvalidClassException: scala.collection.mutable.WrappedArray$ofRef; local class incompatible

[ https://issues.apache.org/jira/browse/SPARK-36869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422215#comment-17422215 ] Dongjoon Hyun commented on SPARK-36869: --- You can test Scala 2.12.15 with Apache Spark 3.2.0 RC6

[jira] [Assigned] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36831: Assignee: (was: Apache Spark) > Read/write dataframes with ANSI intervals from/to

[jira] [Assigned] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36831: Assignee: Apache Spark > Read/write dataframes with ANSI intervals from/to CSV files >

[jira] [Commented] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422117#comment-17422117 ] Apache Spark commented on SPARK-36831: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36550) Propagation cause when UDF reflection fails

[ https://issues.apache.org/jira/browse/SPARK-36550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36550: Assignee: dzcxzl > Propagation cause when UDF reflection fails >

[jira] [Resolved] (SPARK-36550) Propagation cause when UDF reflection fails

[ https://issues.apache.org/jira/browse/SPARK-36550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36550. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33796

[jira] [Commented] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422108#comment-17422108 ] Kousuke Saruta commented on SPARK-36831: Thank you. I'll open a PR. > Read/write dataframes

[jira] [Commented] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422093#comment-17422093 ] Max Gekk commented on SPARK-36831: -- [~sarutak] No, feel free to take this. > Read/write dataframes

[jira] [Updated] (SPARK-36424) Support eliminate limits in AQE Optimizer

[ https://issues.apache.org/jira/browse/SPARK-36424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-36424: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Improvement) > Support eliminate limits in

[jira] [Resolved] (SPARK-36889) Respect `spark.sql.parquet.filterPushdown` by explain() for DSv2

[ https://issues.apache.org/jira/browse/SPARK-36889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36889. -- Fix Version/s: 3.3.0 Resolution: Fixed Fixed in

[jira] [Assigned] (SPARK-34980) Support coalesce partition through union

[ https://issues.apache.org/jira/browse/SPARK-34980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34980: --- Assignee: XiDuo You > Support coalesce partition through union >

[jira] [Resolved] (SPARK-34980) Support coalesce partition through union

[ https://issues.apache.org/jira/browse/SPARK-34980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34980. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 32084

[jira] [Commented] (SPARK-36869) Spark job fails due to java.io.InvalidClassException: scala.collection.mutable.WrappedArray$ofRef; local class incompatible

[ https://issues.apache.org/jira/browse/SPARK-36869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422010#comment-17422010 ] Hamid EL MAAZOUZ commented on SPARK-36869: -- Thank you [~dongjoon] > Spark job fails due to

  1   2   >