[jira] [Assigned] (SPARK-42021) createDataFrame with array.array

[ https://issues.apache.org/jira/browse/SPARK-42021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42021: Assignee: (was: Apache Spark) > createDataFrame with array.array > --

[jira] [Assigned] (SPARK-42021) createDataFrame with array.array

[ https://issues.apache.org/jira/browse/SPARK-42021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42021: Assignee: Apache Spark > createDataFrame with array.array > -

[jira] [Commented] (SPARK-42021) createDataFrame with array.array

[ https://issues.apache.org/jira/browse/SPARK-42021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677210#comment-17677210 ] Apache Spark commented on SPARK-42021: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-42087) Use `--no-same-owner` when HiveExternalCatalogVersionsSuite untars.

[ https://issues.apache.org/jira/browse/SPARK-42087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677207#comment-17677207 ] Apache Spark commented on SPARK-42087: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-42087) Use `--no-same-owner` when HiveExternalCatalogVersionsSuite untars.

[ https://issues.apache.org/jira/browse/SPARK-42087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42087: Assignee: Apache Spark > Use `--no-same-owner` when HiveExternalCatalogVersionsSuite unta

[jira] [Commented] (SPARK-42087) Use `--no-same-owner` when HiveExternalCatalogVersionsSuite untars.

[ https://issues.apache.org/jira/browse/SPARK-42087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677205#comment-17677205 ] Apache Spark commented on SPARK-42087: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-42087) Use `--no-same-owner` when HiveExternalCatalogVersionsSuite untars.

[ https://issues.apache.org/jira/browse/SPARK-42087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42087: Assignee: (was: Apache Spark) > Use `--no-same-owner` when HiveExternalCatalogVersion

[jira] [Created] (SPARK-42087) Use `--no-same-owner` when HiveExternalCatalogVersionsSuite untars.

Dongjoon Hyun created SPARK-42087: - Summary: Use `--no-same-owner` when HiveExternalCatalogVersionsSuite untars. Key: SPARK-42087 URL: https://issues.apache.org/jira/browse/SPARK-42087 Project: Spark

[jira] [Commented] (SPARK-36728) Can't create datetime object from anything other then year column Pyspark - koalas

[ https://issues.apache.org/jira/browse/SPARK-36728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677198#comment-17677198 ] Pralabh Kumar commented on SPARK-36728: --- [~gurwls223] I think this can be closed ,

[jira] [Commented] (SPARK-40353) Re-enable the `read_excel` tests

[ https://issues.apache.org/jira/browse/SPARK-40353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677193#comment-17677193 ] Haejoon Lee commented on SPARK-40353: - Yeah, it should not a release blocker. Just a

[jira] [Updated] (SPARK-40353) Re-enable the `read_excel` tests

[ https://issues.apache.org/jira/browse/SPARK-40353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40353: Priority: Minor (was: Major) > Re-enable the `read_excel` tests > ---

[jira] [Assigned] (SPARK-41988) Fix map_filter and map_zip_with output order

[ https://issues.apache.org/jira/browse/SPARK-41988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41988: Assignee: (was: Apache Spark) > Fix map_filter and map_zip_with output order > --

[jira] [Commented] (SPARK-41988) Fix map_filter and map_zip_with output order

[ https://issues.apache.org/jira/browse/SPARK-41988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677190#comment-17677190 ] Apache Spark commented on SPARK-41988: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41988) Fix map_filter and map_zip_with output order

[ https://issues.apache.org/jira/browse/SPARK-41988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41988: Assignee: Apache Spark > Fix map_filter and map_zip_with output order > -

[jira] [Commented] (SPARK-41988) Fix map_filter and map_zip_with output order

[ https://issues.apache.org/jira/browse/SPARK-41988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677192#comment-17677192 ] Apache Spark commented on SPARK-41988: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-42032) Map data show in different order

[ https://issues.apache.org/jira/browse/SPARK-42032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42032: Assignee: (was: Apache Spark) > Map data show in different order > --

[jira] [Commented] (SPARK-42032) Map data show in different order

[ https://issues.apache.org/jira/browse/SPARK-42032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677189#comment-17677189 ] Apache Spark commented on SPARK-42032: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-42032) Map data show in different order

[ https://issues.apache.org/jira/browse/SPARK-42032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42032: Assignee: Apache Spark > Map data show in different order > -

[jira] [Commented] (SPARK-36728) Can't create datetime object from anything other then year column Pyspark - koalas

[ https://issues.apache.org/jira/browse/SPARK-36728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677187#comment-17677187 ] Pralabh Kumar commented on SPARK-36728: --- I think this issue is not reproducible on

[jira] [Commented] (SPARK-42086) Sort test cases in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-42086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677185#comment-17677185 ] Apache Spark commented on SPARK-42086: -- User 'dongjoon-hyun' has created a pull req

[jira] [Resolved] (SPARK-42083) Make (Executor|StatefulSet)PodsAllocator extendable

[ https://issues.apache.org/jira/browse/SPARK-42083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42083. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39593 [https://

[jira] [Assigned] (SPARK-42083) Make (Executor|StatefulSet)PodsAllocator extendable

[ https://issues.apache.org/jira/browse/SPARK-42083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42083: - Assignee: Dongjoon Hyun > Make (Executor|StatefulSet)PodsAllocator extendable > ---

[jira] [Assigned] (SPARK-42086) Sort test cases in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-42086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42086: Assignee: (was: Apache Spark) > Sort test cases in SQLQueryTestSuite > --

[jira] [Assigned] (SPARK-42086) Sort test cases in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-42086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42086: Assignee: Apache Spark > Sort test cases in SQLQueryTestSuite > -

[jira] [Commented] (SPARK-42086) Sort test cases in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-42086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677184#comment-17677184 ] Apache Spark commented on SPARK-42086: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-42086) Sort test cases in SQLQueryTestSuite

Dongjoon Hyun created SPARK-42086: - Summary: Sort test cases in SQLQueryTestSuite Key: SPARK-42086 URL: https://issues.apache.org/jira/browse/SPARK-42086 Project: Spark Issue Type: Improvemen

[jira] [Commented] (SPARK-41708) Pull v1write information to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677176#comment-17677176 ] Apache Spark commented on SPARK-41708: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-41708) Pull v1write information to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677175#comment-17677175 ] Apache Spark commented on SPARK-41708: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-40353) Re-enable the `read_excel` tests

[ https://issues.apache.org/jira/browse/SPARK-40353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677171#comment-17677171 ] Dongjoon Hyun commented on SPARK-40353: --- According to the `Priority`, this is not

[jira] [Commented] (SPARK-41990) Filtering by composite field name like `field name` doesn't work with pushDownPredicate = true

[ https://issues.apache.org/jira/browse/SPARK-41990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677165#comment-17677165 ] Apache Spark commented on SPARK-41990: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-42084) Avoid leaking the qualified-access-only restriction

[ https://issues.apache.org/jira/browse/SPARK-42084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42084: Assignee: (was: Apache Spark) > Avoid leaking the qualified-access-only restriction >

[jira] [Commented] (SPARK-42084) Avoid leaking the qualified-access-only restriction

[ https://issues.apache.org/jira/browse/SPARK-42084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677164#comment-17677164 ] Apache Spark commented on SPARK-42084: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-42084) Avoid leaking the qualified-access-only restriction

[ https://issues.apache.org/jira/browse/SPARK-42084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677163#comment-17677163 ] Apache Spark commented on SPARK-42084: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-42084) Avoid leaking the qualified-access-only restriction

[ https://issues.apache.org/jira/browse/SPARK-42084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42084: Assignee: Apache Spark > Avoid leaking the qualified-access-only restriction > --

[jira] [Commented] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677162#comment-17677162 ] Xiaomin Zhang commented on SPARK-38230: --- Hello [~coalchan] Thanks for working on t

[jira] [Updated] (SPARK-42083) Make (Executor|StatefulSet)PodsAllocator extendable

[ https://issues.apache.org/jira/browse/SPARK-42083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42083: -- Summary: Make (Executor|StatefulSet)PodsAllocator extendable (was: Make ExecutorPodsAllocator

[jira] [Commented] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677159#comment-17677159 ] Apache Spark commented on SPARK-38230: -- User 'czxm' has created a pull request for

[jira] [Assigned] (SPARK-42085) Make `from_arrow_schema` support nested types

[ https://issues.apache.org/jira/browse/SPARK-42085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42085: Assignee: (was: Apache Spark) > Make `from_arrow_schema` support nested types > -

[jira] [Assigned] (SPARK-42085) Make `from_arrow_schema` support nested types

[ https://issues.apache.org/jira/browse/SPARK-42085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42085: Assignee: Apache Spark > Make `from_arrow_schema` support nested types >

[jira] [Commented] (SPARK-42085) Make `from_arrow_schema` support nested types

[ https://issues.apache.org/jira/browse/SPARK-42085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677158#comment-17677158 ] Apache Spark commented on SPARK-42085: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-42085) Make `from_arrow_schema` support nested types

Ruifeng Zheng created SPARK-42085: - Summary: Make `from_arrow_schema` support nested types Key: SPARK-42085 URL: https://issues.apache.org/jira/browse/SPARK-42085 Project: Spark Issue Type: S

[jira] [Created] (SPARK-42084) Avoid leaking the qualified-access-only restriction

Wenchen Fan created SPARK-42084: --- Summary: Avoid leaking the qualified-access-only restriction Key: SPARK-42084 URL: https://issues.apache.org/jira/browse/SPARK-42084 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42083) Make ExecutorPodsAllocator extendable

[ https://issues.apache.org/jira/browse/SPARK-42083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677156#comment-17677156 ] Apache Spark commented on SPARK-42083: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-42083) Make ExecutorPodsAllocator extendable

[ https://issues.apache.org/jira/browse/SPARK-42083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677155#comment-17677155 ] Apache Spark commented on SPARK-42083: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-42083) Make ExecutorPodsAllocator extendable

[ https://issues.apache.org/jira/browse/SPARK-42083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42083: Assignee: Apache Spark > Make ExecutorPodsAllocator extendable >

[jira] [Assigned] (SPARK-42083) Make ExecutorPodsAllocator extendable

[ https://issues.apache.org/jira/browse/SPARK-42083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42083: Assignee: (was: Apache Spark) > Make ExecutorPodsAllocator extendable > -

[jira] [Commented] (SPARK-42081) improve the plan change validation

[ https://issues.apache.org/jira/browse/SPARK-42081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677154#comment-17677154 ] Apache Spark commented on SPARK-42081: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-42081) improve the plan change validation

[ https://issues.apache.org/jira/browse/SPARK-42081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42081: Assignee: Apache Spark > improve the plan change validation > ---

[jira] [Assigned] (SPARK-42081) improve the plan change validation

[ https://issues.apache.org/jira/browse/SPARK-42081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42081: Assignee: (was: Apache Spark) > improve the plan change validation >

[jira] [Commented] (SPARK-42081) improve the plan change validation

[ https://issues.apache.org/jira/browse/SPARK-42081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677152#comment-17677152 ] Apache Spark commented on SPARK-42081: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-42083) Make ExecutorPodsAllocator extendable

Dongjoon Hyun created SPARK-42083: - Summary: Make ExecutorPodsAllocator extendable Key: SPARK-42083 URL: https://issues.apache.org/jira/browse/SPARK-42083 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-42082) Migrate ValueError into PySparkValueError and manage the functions.py

[ https://issues.apache.org/jira/browse/SPARK-42082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677151#comment-17677151 ] Haejoon Lee commented on SPARK-42082: - I'm working on this > Migrate ValueError int

[jira] [Commented] (SPARK-41712) Migrate the Spark Connect errors into error classes.

[ https://issues.apache.org/jira/browse/SPARK-41712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677150#comment-17677150 ] Haejoon Lee commented on SPARK-41712: - I'm working on this > Migrate the Spark Conn

[jira] [Created] (SPARK-42082) Migrate ValueError into PySparkValueError and manage the functions.py

Haejoon Lee created SPARK-42082: --- Summary: Migrate ValueError into PySparkValueError and manage the functions.py Key: SPARK-42082 URL: https://issues.apache.org/jira/browse/SPARK-42082 Project: Spark

[jira] [Assigned] (SPARK-42077) Literal should throw TypeError for unsupported DataType

[ https://issues.apache.org/jira/browse/SPARK-42077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42077: - Assignee: Ruifeng Zheng > Literal should throw TypeError for unsupported DataType > ---

[jira] [Resolved] (SPARK-42077) Literal should throw TypeError for unsupported DataType

[ https://issues.apache.org/jira/browse/SPARK-42077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42077. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39588 [https://

[jira] [Commented] (SPARK-42080) Add guideline for PySpark errors.

[ https://issues.apache.org/jira/browse/SPARK-42080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677148#comment-17677148 ] Haejoon Lee commented on SPARK-42080: - I'm working on this, we should introduce inte

[jira] [Created] (SPARK-42081) improve the plan change validation

Wenchen Fan created SPARK-42081: --- Summary: improve the plan change validation Key: SPARK-42081 URL: https://issues.apache.org/jira/browse/SPARK-42081 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42076) Factor data conversion `arrow -> rows` out to `conversion.py`

[ https://issues.apache.org/jira/browse/SPARK-42076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42076: - Assignee: Ruifeng Zheng > Factor data conversion `arrow -> rows` out to `conversion.py`

[jira] [Resolved] (SPARK-42076) Factor data conversion `arrow -> rows` out to `conversion.py`

[ https://issues.apache.org/jira/browse/SPARK-42076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42076. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39587 [https://

[jira] [Created] (SPARK-42080) Add guideline for PySpark errors.

Haejoon Lee created SPARK-42080: --- Summary: Add guideline for PySpark errors. Key: SPARK-42080 URL: https://issues.apache.org/jira/browse/SPARK-42080 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-42078) Migrate errors thrown by JVM into PySpark Exception.

[ https://issues.apache.org/jira/browse/SPARK-42078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677144#comment-17677144 ] Apache Spark commented on SPARK-42078: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-42078) Migrate errors thrown by JVM into PySpark Exception.

[ https://issues.apache.org/jira/browse/SPARK-42078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677143#comment-17677143 ] Apache Spark commented on SPARK-42078: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-42078) Migrate errors thrown by JVM into PySpark Exception.

[ https://issues.apache.org/jira/browse/SPARK-42078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42078: Assignee: Apache Spark > Migrate errors thrown by JVM into PySpark Exception. > -

[jira] [Assigned] (SPARK-42078) Migrate errors thrown by JVM into PySpark Exception.

[ https://issues.apache.org/jira/browse/SPARK-42078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42078: Assignee: (was: Apache Spark) > Migrate errors thrown by JVM into PySpark Exception.

[jira] [Commented] (SPARK-42032) Map data show in different order

[ https://issues.apache.org/jira/browse/SPARK-42032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677142#comment-17677142 ] Ruifeng Zheng commented on SPARK-42032: --- Have an offline discussion with [~beliefe

[jira] [Commented] (SPARK-41988) Fix map_filter and map_zip_with output order

[ https://issues.apache.org/jira/browse/SPARK-41988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677141#comment-17677141 ] jiaan.geng commented on SPARK-41988: After my investigation, the fact is the result

[jira] [Commented] (SPARK-42079) Rename proto messages for `toDF` and `withColumnsRenamed`

[ https://issues.apache.org/jira/browse/SPARK-42079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677140#comment-17677140 ] Apache Spark commented on SPARK-42079: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-42079) Rename proto messages for `toDF` and `withColumnsRenamed`

[ https://issues.apache.org/jira/browse/SPARK-42079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42079: Assignee: Apache Spark > Rename proto messages for `toDF` and `withColumnsRenamed` >

[jira] [Assigned] (SPARK-42079) Rename proto messages for `toDF` and `withColumnsRenamed`

[ https://issues.apache.org/jira/browse/SPARK-42079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42079: Assignee: (was: Apache Spark) > Rename proto messages for `toDF` and `withColumnsRena

[jira] [Created] (SPARK-42079) Rename proto messages for `toDF` and `WithColumnsRenamed`

Ruifeng Zheng created SPARK-42079: - Summary: Rename proto messages for `toDF` and `WithColumnsRenamed` Key: SPARK-42079 URL: https://issues.apache.org/jira/browse/SPARK-42079 Project: Spark I

[jira] [Updated] (SPARK-42079) Rename proto messages for `toDF` and `withColumnsRenamed`

[ https://issues.apache.org/jira/browse/SPARK-42079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-42079: -- Summary: Rename proto messages for `toDF` and `withColumnsRenamed` (was: Rename proto message

[jira] [Updated] (SPARK-42078) Migrate errors thrown by JVM into PySpark Exception.

[ https://issues.apache.org/jira/browse/SPARK-42078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42078: Summary: Migrate errors thrown by JVM into PySpark Exception. (was: Migrate errors thrown by JVM

[jira] [Commented] (SPARK-42078) Migrate errors thrown by JVM into PySpark Exception.

[ https://issues.apache.org/jira/browse/SPARK-42078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677139#comment-17677139 ] Haejoon Lee commented on SPARK-42078: - I'm working on it > Migrate errors thrown by

[jira] [Updated] (SPARK-42078) Migrate errors thrown by JVM into single file.

[ https://issues.apache.org/jira/browse/SPARK-42078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42078: Summary: Migrate errors thrown by JVM into single file. (was: Migrate errors thrown by JVM into P

[jira] [Created] (SPARK-42078) Migrate errors thrown by JVM into PySparkException.

Haejoon Lee created SPARK-42078: --- Summary: Migrate errors thrown by JVM into PySparkException. Key: SPARK-42078 URL: https://issues.apache.org/jira/browse/SPARK-42078 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42077) Literal should throw TypeError for unsupported DataType

[ https://issues.apache.org/jira/browse/SPARK-42077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677131#comment-17677131 ] Apache Spark commented on SPARK-42077: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-42077) Literal should throw TypeError for unsupported DataType

[ https://issues.apache.org/jira/browse/SPARK-42077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42077: Assignee: Apache Spark > Literal should throw TypeError for unsupported DataType > --

[jira] [Commented] (SPARK-42077) Literal should throw TypeError for unsupported DataType

[ https://issues.apache.org/jira/browse/SPARK-42077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677129#comment-17677129 ] Apache Spark commented on SPARK-42077: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-42077) Literal should throw TypeError for unsupported DataType

[ https://issues.apache.org/jira/browse/SPARK-42077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42077: Assignee: (was: Apache Spark) > Literal should throw TypeError for unsupported DataTy

[jira] [Created] (SPARK-42077) Literal should throw TypeError for unsupported DataType

Ruifeng Zheng created SPARK-42077: - Summary: Literal should throw TypeError for unsupported DataType Key: SPARK-42077 URL: https://issues.apache.org/jira/browse/SPARK-42077 Project: Spark Iss

[jira] [Commented] (SPARK-42076) Factor data conversion `arrow -> rows` out to `conversion.py`

[ https://issues.apache.org/jira/browse/SPARK-42076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677127#comment-17677127 ] Apache Spark commented on SPARK-42076: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-42076) Factor data conversion `arrow -> rows` out to `conversion.py`

[ https://issues.apache.org/jira/browse/SPARK-42076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677126#comment-17677126 ] Apache Spark commented on SPARK-42076: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-42076) Factor data conversion `arrow -> rows` out to `conversion.py`

[ https://issues.apache.org/jira/browse/SPARK-42076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42076: Assignee: (was: Apache Spark) > Factor data conversion `arrow -> rows` out to `conver

[jira] [Assigned] (SPARK-42076) Factor data conversion `arrow -> rows` out to `conversion.py`

[ https://issues.apache.org/jira/browse/SPARK-42076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42076: Assignee: Apache Spark > Factor data conversion `arrow -> rows` out to `conversion.py` >

[jira] [Created] (SPARK-42076) Factor data conversion `arrow -> rows` out to `conversion.py`

Ruifeng Zheng created SPARK-42076: - Summary: Factor data conversion `arrow -> rows` out to `conversion.py` Key: SPARK-42076 URL: https://issues.apache.org/jira/browse/SPARK-42076 Project: Spark

[jira] [Commented] (SPARK-42075) Deprecate DStream API

[ https://issues.apache.org/jira/browse/SPARK-42075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677114#comment-17677114 ] Chaoqin Li commented on SPARK-42075: [~kabhwan] , sure, I can take this. Thanks! >

[jira] [Commented] (SPARK-42032) Map data show in different order

[ https://issues.apache.org/jira/browse/SPARK-42032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677106#comment-17677106 ] jiaan.geng commented on SPARK-42032: This issue duplicated with https://issues.apach

[jira] [Assigned] (SPARK-41586) Introduce new PySpark package: pyspark.errors

[ https://issues.apache.org/jira/browse/SPARK-41586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41586: Assignee: Haejoon Lee > Introduce new PySpark package: pyspark.errors > -

[jira] [Resolved] (SPARK-41586) Introduce new PySpark package: pyspark.errors

[ https://issues.apache.org/jira/browse/SPARK-41586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41586. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39387 [https://gi

[jira] [Assigned] (SPARK-41903) Support data type ndarray

[ https://issues.apache.org/jira/browse/SPARK-41903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41903: Assignee: Ruifeng Zheng (was: Sandeep Singh) > Support data type ndarray > -

[jira] [Resolved] (SPARK-41903) Support data type ndarray

[ https://issues.apache.org/jira/browse/SPARK-41903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41903. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39570 [https://gi

[jira] [Assigned] (SPARK-41903) Support data type ndarray

[ https://issues.apache.org/jira/browse/SPARK-41903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41903: Assignee: Sandeep Singh > Support data type ndarray > - > >

[jira] [Resolved] (SPARK-42073) Enable pyspark.sql.tests.test_types 2 test cases

[ https://issues.apache.org/jira/browse/SPARK-42073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42073. -- Resolution: Fixed Issue resolved by pull request 39583 [https://github.com/apache/spark/pull/3

[jira] [Resolved] (SPARK-42074) Enable KryoSerializer in TPCDSQueryBenchmark to enforce SQL class registration

[ https://issues.apache.org/jira/browse/SPARK-42074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42074. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39584 [https://

[jira] [Assigned] (SPARK-42074) Enable KryoSerializer in TPCDSQueryBenchmark to enforce SQL class registration

[ https://issues.apache.org/jira/browse/SPARK-42074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42074: - Assignee: Dongjoon Hyun > Enable KryoSerializer in TPCDSQueryBenchmark to enforce SQL c

[jira] [Commented] (SPARK-42002) Implement DataFrameWriterV2 (ReadwriterV2Tests)

[ https://issues.apache.org/jira/browse/SPARK-42002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677094#comment-17677094 ] Sandeep Singh commented on SPARK-42002: --- I'm working on this > Implement DataFram

[jira] [Commented] (SPARK-42075) Deprecate DStream API

[ https://issues.apache.org/jira/browse/SPARK-42075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677093#comment-17677093 ] Jungtaek Lim commented on SPARK-42075: -- [~Chaoqin] Could you please take this over?

[jira] [Created] (SPARK-42075) Deprecate DStream API

Jungtaek Lim created SPARK-42075: Summary: Deprecate DStream API Key: SPARK-42075 URL: https://issues.apache.org/jira/browse/SPARK-42075 Project: Spark Issue Type: Task Components:

[jira] [Commented] (SPARK-42074) Enable KryoSerializer in TPCDSQueryBenchmark to enforce SQL class registration

[ https://issues.apache.org/jira/browse/SPARK-42074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677089#comment-17677089 ] Apache Spark commented on SPARK-42074: -- User 'dongjoon-hyun' has created a pull req

  1   2   >