[jira] [Commented] (SPARK-40966) FIX `read_parquet` with `pandas_metadata`

[ https://issues.apache.org/jira/browse/SPARK-40966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626406#comment-17626406 ] Apache Spark commented on SPARK-40966: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-40966) FIX `read_parquet` with `pandas_metadata`

[ https://issues.apache.org/jira/browse/SPARK-40966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626405#comment-17626405 ] Apache Spark commented on SPARK-40966: -- User 'itholic' has created a pull request for this issue:

[jira] [Updated] (SPARK-40955) Allow DSV2 Predicate pushdown in FileScanBuilder.pushedDataFilter

[ https://issues.apache.org/jira/browse/SPARK-40955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40955: - Summary: Allow DSV2 Predicate pushdown in FileScanBuilder.pushedDataFilter (was: allow DSV2

[jira] [Commented] (SPARK-40798) Alter partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626367#comment-17626367 ] Apache Spark commented on SPARK-40798: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-40953) Add missing `limit(n)` in DataFrame.head

[ https://issues.apache.org/jira/browse/SPARK-40953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626368#comment-17626368 ] Apache Spark commented on SPARK-40953: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Updated] (SPARK-40569) Add smoke test in standalone cluster for spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Sun updated SPARK-40569: - Summary: Add smoke test in standalone cluster for spark-docker (was: Expose port for spark standalone

[jira] [Updated] (SPARK-40970) Support List[ColumnRef] for Join's on argument.

[ https://issues.apache.org/jira/browse/SPARK-40970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-40970: - Description: Right now Join's on does not support a list of ColumnRef: [df.age == df2.age, df.name ==

[jira] [Created] (SPARK-40970) Support List[ColumnRef] for Join's on argument.

Rui Wang created SPARK-40970: Summary: Support List[ColumnRef] for Join's on argument. Key: SPARK-40970 URL: https://issues.apache.org/jira/browse/SPARK-40970 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-40969) Unable to download spark 3.3.0 tarball after 3.3.1 release in spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40969: --- Assignee: Qian Sun > Unable to download spark 3.3.0 tarball after 3.3.1 release in

[jira] [Commented] (SPARK-40969) Unable to download spark 3.3.0 tarball after 3.3.1 release in spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626359#comment-17626359 ] Qian Sun commented on SPARK-40969: -- [~yikunkero] fine with me, I'm working on this :) > Unable to

[jira] [Comment Edited] (SPARK-40969) Unable to download spark 3.3.0 tarball after 3.3.1 release in spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626358#comment-17626358 ] Yikun Jiang edited comment on SPARK-40969 at 10/31/22 3:25 AM: --- Let's use

[jira] [Commented] (SPARK-40969) Unable to download spark 3.3.0 tarball after 3.3.1 release in spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626358#comment-17626358 ] Yikun Jiang commented on SPARK-40969: - Let's use the https://archive.apache.org/dist/spark/ >

[jira] [Updated] (SPARK-40371) Migrate type check failures of NthValue and NTile onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40371: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in window expressions: 1.

[jira] [Updated] (SPARK-40371) Migrate type check failures of NthValue and NTile onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40371: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in window expressions: 1.

[jira] [Commented] (SPARK-40969) Unable to download spark 3.3.0 tarball after 3.3.1 release in spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626355#comment-17626355 ] Qian Sun commented on SPARK-40969: -- cc [~yikunkero][~hyukjin.kwon] > Unable to download spark 3.3.0

[jira] [Created] (SPARK-40969) Unable to download spark 3.3.0 tarball after 3.3.1 release in spark-docker

Qian Sun created SPARK-40969: Summary: Unable to download spark 3.3.0 tarball after 3.3.1 release in spark-docker Key: SPARK-40969 URL: https://issues.apache.org/jira/browse/SPARK-40969 Project: Spark

[jira] [Commented] (SPARK-40481) Ignore stage fetch failure caused by decommissioned executor

[ https://issues.apache.org/jira/browse/SPARK-40481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626352#comment-17626352 ] Apache Spark commented on SPARK-40481: -- User 'warrenzhu25' has created a pull request for this

[jira] [Commented] (SPARK-40481) Ignore stage fetch failure caused by decommissioned executor

[ https://issues.apache.org/jira/browse/SPARK-40481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626353#comment-17626353 ] Apache Spark commented on SPARK-40481: -- User 'warrenzhu25' has created a pull request for this

[jira] [Commented] (SPARK-40954) Kubernetes integration tests stuck forever on Mac M1 with Minikube + Docker

[ https://issues.apache.org/jira/browse/SPARK-40954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626345#comment-17626345 ] Qian Sun commented on SPARK-40954: -- Hi [~_anton] I use hyperkit as minikube driver. Could you try this

[jira] [Resolved] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40963. -- Assignee: Bruce Robbins Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40963: - Fix Version/s: 3.4.0 3.2.3 3.3.2 > ExtractGenerator sets

[jira] [Assigned] (SPARK-40968) Fix some wrong/misleading comments in DAGSchedulerSuite

[ https://issues.apache.org/jira/browse/SPARK-40968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40968: Assignee: Apache Spark > Fix some wrong/misleading comments in DAGSchedulerSuite >

[jira] [Assigned] (SPARK-40968) Fix some wrong/misleading comments in DAGSchedulerSuite

[ https://issues.apache.org/jira/browse/SPARK-40968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40968: Assignee: (was: Apache Spark) > Fix some wrong/misleading comments in

[jira] [Commented] (SPARK-40968) Fix some wrong/misleading comments in DAGSchedulerSuite

[ https://issues.apache.org/jira/browse/SPARK-40968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626331#comment-17626331 ] Apache Spark commented on SPARK-40968: -- User 'JiexingLi' has created a pull request for this issue:

[jira] [Created] (SPARK-40968) Fix some wrong/misleading comments in DAGSchedulerSuite

Jiexing Li created SPARK-40968: -- Summary: Fix some wrong/misleading comments in DAGSchedulerSuite Key: SPARK-40968 URL: https://issues.apache.org/jira/browse/SPARK-40968 Project: Spark Issue

[jira] [Resolved] (SPARK-40925) Fix late record filtering to support chaining of steteful operators

[ https://issues.apache.org/jira/browse/SPARK-40925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-40925. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38405

[jira] [Assigned] (SPARK-40925) Fix late record filtering to support chaining of steteful operators

[ https://issues.apache.org/jira/browse/SPARK-40925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-40925: Assignee: Alex Balikov > Fix late record filtering to support chaining of steteful

[jira] [Updated] (SPARK-40925) Fix late record filtering to support chaining of steteful operators

[ https://issues.apache.org/jira/browse/SPARK-40925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-40925: - Fix Version/s: (was: 3.4.0) > Fix late record filtering to support chaining of steteful

[jira] [Commented] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626316#comment-17626316 ] Apache Spark commented on SPARK-40963: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40963: Assignee: Apache Spark > ExtractGenerator sets incorrect nullability in new Project >

[jira] [Assigned] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40963: Assignee: (was: Apache Spark) > ExtractGenerator sets incorrect nullability in new

[jira] [Commented] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626315#comment-17626315 ] Apache Spark commented on SPARK-40963: -- User 'bersprockets' has created a pull request for this

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Summary: ExtractGenerator sets incorrect nullability in new Project (was: containsNull in

[jira] [Commented] (SPARK-40374) Migrate type check failures of type creators onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626232#comment-17626232 ] BingKun Pan commented on SPARK-40374: - I work on it. > Migrate type check failures of type creators

[jira] [Assigned] (SPARK-40890) Check error classes in DataSourceV2SQLSuite

[ https://issues.apache.org/jira/browse/SPARK-40890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40890: Assignee: (was: Apache Spark) > Check error classes in DataSourceV2SQLSuite >

[jira] [Commented] (SPARK-40890) Check error classes in DataSourceV2SQLSuite

[ https://issues.apache.org/jira/browse/SPARK-40890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626231#comment-17626231 ] Apache Spark commented on SPARK-40890: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40890) Check error classes in DataSourceV2SQLSuite

[ https://issues.apache.org/jira/browse/SPARK-40890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40890: Assignee: Apache Spark > Check error classes in DataSourceV2SQLSuite >

[jira] [Assigned] (SPARK-40748) Migrate type check failures of conditions onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40748: Assignee: Apache Spark > Migrate type check failures of conditions onto error classes >

[jira] [Assigned] (SPARK-40748) Migrate type check failures of conditions onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40748: Assignee: (was: Apache Spark) > Migrate type check failures of conditions onto error

[jira] [Commented] (SPARK-40748) Migrate type check failures of conditions onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626222#comment-17626222 ] Apache Spark commented on SPARK-40748: -- User 'panbingkun' has created a pull request for this

[jira] [Resolved] (SPARK-40953) Add missing `limit(n)` in DataFrame.head

[ https://issues.apache.org/jira/browse/SPARK-40953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40953. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38424

[jira] [Assigned] (SPARK-40953) Add missing `limit(n)` in DataFrame.head

[ https://issues.apache.org/jira/browse/SPARK-40953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40953: Assignee: Ruifeng Zheng > Add missing `limit(n)` in DataFrame.head >

[jira] [Commented] (SPARK-40967) Migrate failAnalysis() onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626202#comment-17626202 ] Apache Spark commented on SPARK-40967: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40967) Migrate failAnalysis() onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40967: Assignee: Max Gekk (was: Apache Spark) > Migrate failAnalysis() onto error classes >

[jira] [Assigned] (SPARK-40967) Migrate failAnalysis() onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40967: Assignee: Apache Spark (was: Max Gekk) > Migrate failAnalysis() onto error classes >

[jira] [Commented] (SPARK-40967) Migrate failAnalysis() onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626201#comment-17626201 ] Apache Spark commented on SPARK-40967: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-40967) Migrate failAnalysis() onto error classes

Max Gekk created SPARK-40967: Summary: Migrate failAnalysis() onto error classes Key: SPARK-40967 URL: https://issues.apache.org/jira/browse/SPARK-40967 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-40965) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1208

[ https://issues.apache.org/jira/browse/SPARK-40965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40965. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38435