[jira] [Updated] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost

[ https://issues.apache.org/jira/browse/SPARK-41360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-41360: - Summary: Avoid BlockManager re-registration if the executor has been lost (was: Avoid BlockMananger

[jira] [Commented] (SPARK-41236) The renamed field name cannot be recognized after group filtering

[ https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642332#comment-17642332 ] Ritika Maheshwari commented on SPARK-41236: --- Running the following query against Spark 3.3.0

[jira] [Created] (SPARK-41360) Avoid BlockMananger re-registration if the executor has been lost

wuyi created SPARK-41360: Summary: Avoid BlockMananger re-registration if the executor has been lost Key: SPARK-41360 URL: https://issues.apache.org/jira/browse/SPARK-41360 Project: Spark Issue

[jira] [Commented] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642313#comment-17642313 ] Apache Spark commented on SPARK-41358: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41358: Assignee: (was: Apache Spark) > Use `PhysicalDataType` instead of DataType in

[jira] [Assigned] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41358: Assignee: Apache Spark > Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

[jira] [Commented] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642312#comment-17642312 ] Apache Spark commented on SPARK-41358: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

Yang Jie created SPARK-41359: Summary: Use `PhysicalDataType` instead of DataType in UnsafeRow Key: SPARK-41359 URL: https://issues.apache.org/jira/browse/SPARK-41359 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41358: - Parent: SPARK-41356 Issue Type: Sub-task (was: Improvement) > Use `PhysicalDataType` instead

[jira] [Created] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

Yang Jie created SPARK-41358: Summary: Use `PhysicalDataType` instead of DataType in ColumnVectorUtils Key: SPARK-41358 URL: https://issues.apache.org/jira/browse/SPARK-41358 Project: Spark

[jira] [Updated] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType`

[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41356: - Description: SPARK-41226 Introduce physical data types, and the use  PhysicalDataType replace DataType

[jira] [Assigned] (SPARK-41357) Implement math functions

[ https://issues.apache.org/jira/browse/SPARK-41357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41357: Assignee: (was: Apache Spark) > Implement math functions >

[jira] [Assigned] (SPARK-41357) Implement math functions

[ https://issues.apache.org/jira/browse/SPARK-41357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41357: Assignee: Apache Spark > Implement math functions > > >

[jira] [Commented] (SPARK-41357) Implement math functions

[ https://issues.apache.org/jira/browse/SPARK-41357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642310#comment-17642310 ] Apache Spark commented on SPARK-41357: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType`

[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642309#comment-17642309 ] Apache Spark commented on SPARK-41356: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType`

[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41356: - Issue Type: Umbrella (was: Improvement) > Find and refactor all cases suitable for using

[jira] [Created] (SPARK-41357) Implement math functions

Ruifeng Zheng created SPARK-41357: - Summary: Implement math functions Key: SPARK-41357 URL: https://issues.apache.org/jira/browse/SPARK-41357 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-35011) False active executor in UI that caused by BlockManager reregistration

[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-35011: - Summary: False active executor in UI that caused by BlockManager reregistration (was: Avoid Block Manager

[jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error

[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642303#comment-17642303 ] Apache Spark commented on SPARK-41344: -- User 'wForget' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41344) Reading V2 datasource masks underlying error

[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41344: Assignee: Apache Spark > Reading V2 datasource masks underlying error >

[jira] [Assigned] (SPARK-41344) Reading V2 datasource masks underlying error

[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41344: Assignee: (was: Apache Spark) > Reading V2 datasource masks underlying error >

[jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error

[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642304#comment-17642304 ] Apache Spark commented on SPARK-41344: -- User 'wForget' has created a pull request for this issue:

[jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error

[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642298#comment-17642298 ] Zhen Wang commented on SPARK-41344: --- I want to work on this and will send a PR later. > Reading V2

[jira] [Assigned] (SPARK-41353) UNRESOLVED_ROUTINE error class

[ https://issues.apache.org/jira/browse/SPARK-41353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41353: Assignee: Apache Spark > UNRESOLVED_ROUTINE error class > --

[jira] [Assigned] (SPARK-41353) UNRESOLVED_ROUTINE error class

[ https://issues.apache.org/jira/browse/SPARK-41353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41353: Assignee: (was: Apache Spark) > UNRESOLVED_ROUTINE error class >

[jira] [Commented] (SPARK-41353) UNRESOLVED_ROUTINE error class

[ https://issues.apache.org/jira/browse/SPARK-41353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642286#comment-17642286 ] Apache Spark commented on SPARK-41353: -- User 'srielau' has created a pull request for this issue:

[jira] [Commented] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType`

[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642270#comment-17642270 ] Apache Spark commented on SPARK-41356: -- User 'LuciferYang' has created a pull request for this

[jira] (SPARK-41236) The renamed field name cannot be recognized after group filtering

[ https://issues.apache.org/jira/browse/SPARK-41236 ] Ritika Maheshwari deleted comment on SPARK-41236: --- was (Author: ritikam): Hello Zhong , Try to rename the field as a different name than the original column name. select

[jira] [Updated] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType`

[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41356: - Priority: Major (was: Minor) > Find and refactor all cases suitable for using `PhysicalDataType`

[jira] [Updated] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType`

[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41356: - Summary: Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType` (was:

[jira] [Commented] (SPARK-41356) Refactor `ColumnVectorUtils#populate` method to use physical types

[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642254#comment-17642254 ] Apache Spark commented on SPARK-41356: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41356) Refactor `ColumnVectorUtils#populate` method to use physical types

[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41356: Assignee: (was: Apache Spark) > Refactor `ColumnVectorUtils#populate` method to use

[jira] [Commented] (SPARK-41356) Refactor `ColumnVectorUtils#populate` method to use physical types

[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642253#comment-17642253 ] Apache Spark commented on SPARK-41356: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41356) Refactor `ColumnVectorUtils#populate` method to use physical types

[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41356: Assignee: Apache Spark > Refactor `ColumnVectorUtils#populate` method to use physical

[jira] [Created] (SPARK-41356) Refactor `ColumnVectorUtils#populate` method to use physical types

Yang Jie created SPARK-41356: Summary: Refactor `ColumnVectorUtils#populate` method to use physical types Key: SPARK-41356 URL: https://issues.apache.org/jira/browse/SPARK-41356 Project: Spark

[jira] [Commented] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642238#comment-17642238 ] Deng Ziming commented on SPARK-41349: - Thank you [~amaliujia] , glad to have a try. > Implement

[jira] [Resolved] (SPARK-41336) BroadcastExchange does not support the execute() code path. when AQE enabled

[ https://issues.apache.org/jira/browse/SPARK-41336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JacobZheng resolved SPARK-41336. Fix Version/s: 3.2.2 Resolution: Fixed > BroadcastExchange does not support the execute()

[jira] [Assigned] (SPARK-41355) Workaround hive table name validation issue

[ https://issues.apache.org/jira/browse/SPARK-41355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41355: Assignee: (was: Apache Spark) > Workaround hive table name validation issue >

[jira] [Assigned] (SPARK-41355) Workaround hive table name validation issue

[ https://issues.apache.org/jira/browse/SPARK-41355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41355: Assignee: Apache Spark > Workaround hive table name validation issue >

[jira] [Commented] (SPARK-41355) Workaround hive table name validation issue

[ https://issues.apache.org/jira/browse/SPARK-41355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1764#comment-1764 ] Apache Spark commented on SPARK-41355: -- User 'wankunde' has created a pull request for this issue:

[jira] [Created] (SPARK-41355) Workaround hive table name validation issue

Wan Kun created SPARK-41355: --- Summary: Workaround hive table name validation issue Key: SPARK-41355 URL: https://issues.apache.org/jira/browse/SPARK-41355 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-41319) when-otherwise support

[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642221#comment-17642221 ] Ruifeng Zheng commented on SPARK-41319: --- I thought we need dedicated proto message for

[jira] [Updated] (SPARK-41319) when-otherwise support

[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41319: -- Description: to support the `when(condition, col).otherwise(col)` function in Spark Connect.

[jira] [Updated] (SPARK-41354) Implement `DataFrame.repartitionByRange`

[ https://issues.apache.org/jira/browse/SPARK-41354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41354: - Summary: Implement `DataFrame.repartitionByRange` (was: Support

[jira] [Created] (SPARK-41354) Support `DataFrame.repartitionByRange`

Xinrong Meng created SPARK-41354: Summary: Support `DataFrame.repartitionByRange` Key: SPARK-41354 URL: https://issues.apache.org/jira/browse/SPARK-41354 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41234) High-order function: array_insert

[ https://issues.apache.org/jira/browse/SPARK-41234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41234: Assignee: (was: Apache Spark) > High-order function: array_insert >

[jira] [Assigned] (SPARK-41234) High-order function: array_insert

[ https://issues.apache.org/jira/browse/SPARK-41234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41234: Assignee: Apache Spark > High-order function: array_insert >

[jira] [Commented] (SPARK-41234) High-order function: array_insert

[ https://issues.apache.org/jira/browse/SPARK-41234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642207#comment-17642207 ] Apache Spark commented on SPARK-41234: -- User 'Daniel-Davies' has created a pull request for this

[jira] [Commented] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642185#comment-17642185 ] Rui Wang commented on SPARK-41349: -- cc [~dengziming] if you are interested in > Implement

[jira] [Created] (SPARK-41353) UNRESOLVED_ROUTINE error class

Serge Rielau created SPARK-41353: Summary: UNRESOLVED_ROUTINE error class Key: SPARK-41353 URL: https://issues.apache.org/jira/browse/SPARK-41353 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-40970) Support List[Column] for Join's on argument.

[ https://issues.apache.org/jira/browse/SPARK-40970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40970: Assignee: Apache Spark (was: Rui Wang) > Support List[Column] for Join's on argument. >

[jira] [Assigned] (SPARK-40970) Support List[Column] for Join's on argument.

[ https://issues.apache.org/jira/browse/SPARK-40970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40970: Assignee: Rui Wang (was: Apache Spark) > Support List[Column] for Join's on argument. >

[jira] [Commented] (SPARK-40970) Support List[Column] for Join's on argument.

[ https://issues.apache.org/jira/browse/SPARK-40970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642166#comment-17642166 ] Apache Spark commented on SPARK-40970: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40970) Support List[Column] for Join's on argument.

[ https://issues.apache.org/jira/browse/SPARK-40970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40970: Assignee: Apache Spark (was: Rui Wang) > Support List[Column] for Join's on argument. >

[jira] [Updated] (SPARK-40970) Support List[Column] for Join's on argument.

[ https://issues.apache.org/jira/browse/SPARK-40970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-40970: - Summary: Support List[Column] for Join's on argument. (was: Support List[ColumnRef] for Join's on

[jira] [Assigned] (SPARK-41232) High-order function: array_append

[ https://issues.apache.org/jira/browse/SPARK-41232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41232: Assignee: (was: Apache Spark) > High-order function: array_append >

[jira] [Assigned] (SPARK-41232) High-order function: array_append

[ https://issues.apache.org/jira/browse/SPARK-41232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41232: Assignee: Apache Spark > High-order function: array_append >

[jira] [Commented] (SPARK-41232) High-order function: array_append

[ https://issues.apache.org/jira/browse/SPARK-41232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642150#comment-17642150 ] Apache Spark commented on SPARK-41232: -- User 'infoankitp' has created a pull request for this

[jira] [Updated] (SPARK-36950) Normalize semi-structured data into tabular tables.

[ https://issues.apache.org/jira/browse/SPARK-36950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-36950: Description: Many users get seminested data form JSON or XML. There are some problems

[jira] [Commented] (SPARK-41271) Parameterized SQL

[ https://issues.apache.org/jira/browse/SPARK-41271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642130#comment-17642130 ] Apache Spark commented on SPARK-41271: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-41271) Parameterized SQL

[ https://issues.apache.org/jira/browse/SPARK-41271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642129#comment-17642129 ] Apache Spark commented on SPARK-41271: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-40586) Decouple plan transformation and validation on server side

[ https://issues.apache.org/jira/browse/SPARK-40586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642120#comment-17642120 ] Rui Wang commented on SPARK-40586: -- Contributions are welcome! > Decouple plan transformation and

[jira] [Assigned] (SPARK-40586) Decouple plan transformation and validation on server side

[ https://issues.apache.org/jira/browse/SPARK-40586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang reassigned SPARK-40586: Assignee: (was: Rui Wang) > Decouple plan transformation and validation on server side >

[jira] [Deleted] (SPARK-41352) Support DataFrame.hint

[ https://issues.apache.org/jira/browse/SPARK-41352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang deleted SPARK-41352: - > Support DataFrame.hint > -- > > Key: SPARK-41352 >

[jira] [Updated] (SPARK-41352) Support DataFrame.hint

[ https://issues.apache.org/jira/browse/SPARK-41352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-41352: - Description: We have hint in proto now:

[jira] [Commented] (SPARK-41352) Support DataFrame.hint

[ https://issues.apache.org/jira/browse/SPARK-41352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642118#comment-17642118 ] Rui Wang commented on SPARK-41352: -- This JIRA is open to pick up. > Support DataFrame.hint >

[jira] [Created] (SPARK-41352) Support DataFrame.hint

Rui Wang created SPARK-41352: Summary: Support DataFrame.hint Key: SPARK-41352 URL: https://issues.apache.org/jira/browse/SPARK-41352 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41313: - Priority: Minor (was: Major) > Combine fixes for SPARK-3900 and SPARK-21138 >

[jira] [Updated] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41313: - Target Version/s: (was: 3.2.4, 3.3.2, 3.4.0) > Combine fixes for SPARK-3900 and SPARK-21138 >

[jira] [Updated] (SPARK-41008) Isotonic regression result differs from sklearn implementation

[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41008: - Priority: Minor (was: Major) > Isotonic regression result differs from sklearn implementation

[jira] [Commented] (SPARK-41013) spark-3.1.2以cluster模式提交作业报 Could not initialize class com.github.luben.zstd.ZstdOutputStream

[ https://issues.apache.org/jira/browse/SPARK-41013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642001#comment-17642001 ] Sean R. Owen commented on SPARK-41013: -- Can you clarify the issue? this doesn't look like it

[jira] [Resolved] (SPARK-41087) Make `build/mvn` use the same JAVA_OPTS as `dev/make-distribution.sh`

[ https://issues.apache.org/jira/browse/SPARK-41087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41087. -- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed Resolved by

[jira] [Commented] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641994#comment-17641994 ] Sean R. Owen commented on SPARK-41219: -- Is this the same as

[jira] [Updated] (SPARK-41253) Make K8s volcano IT work in Github Action

[ https://issues.apache.org/jira/browse/SPARK-41253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-41253: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > Make K8s volcano IT

[jira] [Commented] (SPARK-41324) Follow-up on JDK-8180450

[ https://issues.apache.org/jira/browse/SPARK-41324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641992#comment-17641992 ] Sean R. Owen commented on SPARK-41324: -- Or isn't this a dupe of

[jira] [Commented] (SPARK-41319) when-otherwise support

[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641993#comment-17641993 ] Sean R. Owen commented on SPARK-41319: -- Can we get a little more detail in these sub-tasks? >

[jira] [Commented] (SPARK-41324) Follow-up on JDK-8180450

[ https://issues.apache.org/jira/browse/SPARK-41324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641990#comment-17641990 ] Sean R. Owen commented on SPARK-41324: -- Can we get a little more detail in here / update the title?

[jira] [Commented] (SPARK-41342) Add support for distributed deep learning framework

[ https://issues.apache.org/jira/browse/SPARK-41342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641989#comment-17641989 ] Sean R. Owen commented on SPARK-41342: -- Why not Horovod? it works with Spark and Pytorch. > Add

[jira] [Commented] (SPARK-41351) Column does not support !=

[ https://issues.apache.org/jira/browse/SPARK-41351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641940#comment-17641940 ] Apache Spark commented on SPARK-41351: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-41351) Column does not support !=

[ https://issues.apache.org/jira/browse/SPARK-41351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641939#comment-17641939 ] Apache Spark commented on SPARK-41351: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-41351) Column does not support !=

[ https://issues.apache.org/jira/browse/SPARK-41351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41351: Assignee: (was: Apache Spark) > Column does not support != >

[jira] [Assigned] (SPARK-41351) Column does not support !=

[ https://issues.apache.org/jira/browse/SPARK-41351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41351: Assignee: Apache Spark > Column does not support != > -- > >

[jira] [Created] (SPARK-41351) Column does not support !=

Martin Grund created SPARK-41351: Summary: Column does not support != Key: SPARK-41351 URL: https://issues.apache.org/jira/browse/SPARK-41351 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

[ https://issues.apache.org/jira/browse/SPARK-41350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41350: Assignee: Apache Spark > allow simple name access of using join hidden columns after

[jira] [Commented] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

[ https://issues.apache.org/jira/browse/SPARK-41350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641930#comment-17641930 ] Apache Spark commented on SPARK-41350: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

[ https://issues.apache.org/jira/browse/SPARK-41350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41350: Assignee: (was: Apache Spark) > allow simple name access of using join hidden

[jira] [Commented] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

[ https://issues.apache.org/jira/browse/SPARK-41350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641929#comment-17641929 ] Apache Spark commented on SPARK-41350: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

Wenchen Fan created SPARK-41350: --- Summary: allow simple name access of using join hidden columns after subquery alias Key: SPARK-41350 URL: https://issues.apache.org/jira/browse/SPARK-41350 Project:

[jira] [Assigned] (SPARK-41348) Refactor `UnsafeArrayWriterSuite` to check error class

[ https://issues.apache.org/jira/browse/SPARK-41348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41348: Assignee: Yang Jie > Refactor `UnsafeArrayWriterSuite` to check error class >

[jira] [Resolved] (SPARK-41348) Refactor `UnsafeArrayWriterSuite` to check error class

[ https://issues.apache.org/jira/browse/SPARK-41348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41348. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38860

[jira] [Commented] (SPARK-41336) BroadcastExchange does not support the execute() code path. when AQE enabled

[ https://issues.apache.org/jira/browse/SPARK-41336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641843#comment-17641843 ] JacobZheng commented on SPARK-41336: [SPARK-39551][SQL][3.2] Add AQE invalid plan check solved this

[jira] [Resolved] (SPARK-41345) Add Hint to Connect Proto

[ https://issues.apache.org/jira/browse/SPARK-41345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41345. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38857

[jira] [Commented] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641833#comment-17641833 ] Ruifeng Zheng commented on SPARK-41349: --- contributions are welcomed! > Implement `DataFrame.hint`

[jira] [Updated] (SPARK-41349) Implement `DataFrame.hint`

[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41349: -- Description: implement DataFrame.hint with the proto message added in

[jira] [Created] (SPARK-41349) Implement `DataFrame.hint`

Ruifeng Zheng created SPARK-41349: - Summary: Implement `DataFrame.hint` Key: SPARK-41349 URL: https://issues.apache.org/jira/browse/SPARK-41349 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-41346) Implement asc and desc methods

[ https://issues.apache.org/jira/browse/SPARK-41346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41346. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38858

[jira] [Resolved] (SPARK-41347) Add Cast to Expression proto

[ https://issues.apache.org/jira/browse/SPARK-41347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41347. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38859

[jira] [Assigned] (SPARK-41314) Assign a name to the error class _LEGACY_ERROR_TEMP_1094

[ https://issues.apache.org/jira/browse/SPARK-41314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41314: Assignee: Yang Jie > Assign a name to the error class _LEGACY_ERROR_TEMP_1094 >

[jira] [Resolved] (SPARK-41314) Assign a name to the error class _LEGACY_ERROR_TEMP_1094

[ https://issues.apache.org/jira/browse/SPARK-41314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41314. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38856

[jira] [Comment Edited] (SPARK-39257) use spark.read.jdbc() to read data from SQL databse into dataframe, it fails silently, when the session is killed from SQL server side

[ https://issues.apache.org/jira/browse/SPARK-39257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641736#comment-17641736 ] Sandeep Katta edited comment on SPARK-39257 at 12/1/22 8:02 AM:

  1   2   >