[jira] [Assigned] (SPARK-41102) Merge SparkConnectPlanner and SparkConnectCommandPlanner

[ https://issues.apache.org/jira/browse/SPARK-41102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41102: --- Assignee: Rui Wang > Merge SparkConnectPlanner and SparkConnectCommandPlanner >

[jira] [Resolved] (SPARK-41102) Merge SparkConnectPlanner and SparkConnectCommandPlanner

[ https://issues.apache.org/jira/browse/SPARK-41102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41102. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38604

[jira] [Commented] (SPARK-41113) Upgrade sbt to 1.8.0

[ https://issues.apache.org/jira/browse/SPARK-41113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632133#comment-17632133 ] Apache Spark commented on SPARK-41113: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-41113) Upgrade sbt to 1.8.0

[ https://issues.apache.org/jira/browse/SPARK-41113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632132#comment-17632132 ] Apache Spark commented on SPARK-41113: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41113) Upgrade sbt to 1.8.0

[ https://issues.apache.org/jira/browse/SPARK-41113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41113: Assignee: (was: Apache Spark) > Upgrade sbt to 1.8.0 > > >

[jira] [Assigned] (SPARK-41113) Upgrade sbt to 1.8.0

[ https://issues.apache.org/jira/browse/SPARK-41113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41113: Assignee: Apache Spark > Upgrade sbt to 1.8.0 > > >

[jira] [Created] (SPARK-41113) Upgrade sbt to 1.8.0

Yang Jie created SPARK-41113: Summary: Upgrade sbt to 1.8.0 Key: SPARK-41113 URL: https://issues.apache.org/jira/browse/SPARK-41113 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-41112) RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter

[ https://issues.apache.org/jira/browse/SPARK-41112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41112: Assignee: Apache Spark > RuntimeFilter should apply ColumnPruning eagerly with

[jira] [Commented] (SPARK-41112) RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter

[ https://issues.apache.org/jira/browse/SPARK-41112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632128#comment-17632128 ] Apache Spark commented on SPARK-41112: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-41112) RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter

[ https://issues.apache.org/jira/browse/SPARK-41112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41112: Assignee: (was: Apache Spark) > RuntimeFilter should apply ColumnPruning eagerly

[jira] [Created] (SPARK-41112) RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter

XiDuo You created SPARK-41112: - Summary: RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter Key: SPARK-41112 URL: https://issues.apache.org/jira/browse/SPARK-41112 Project: Spark

[jira] [Commented] (SPARK-41005) Arrow based collect

[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632119#comment-17632119 ] Apache Spark commented on SPARK-41005: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41005) Arrow based collect

[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632117#comment-17632117 ] Apache Spark commented on SPARK-41005: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41005) Arrow based collect

[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632118#comment-17632118 ] Apache Spark commented on SPARK-41005: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41108) Control the max size of arrow batch

[ https://issues.apache.org/jira/browse/SPARK-41108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632115#comment-17632115 ] Apache Spark commented on SPARK-41108: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-41111) Implement `DataFrame.show`

Ruifeng Zheng created SPARK-4: - Summary: Implement `DataFrame.show` Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41111) Implement `DataFrame.show`

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-4: - Assignee: Ruifeng Zheng > Implement `DataFrame.show` > -- > >

[jira] [Commented] (SPARK-41108) Control the max size of arrow batch

[ https://issues.apache.org/jira/browse/SPARK-41108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632116#comment-17632116 ] Apache Spark commented on SPARK-41108: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-40798) Alter partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632106#comment-17632106 ] Ranga Reddy commented on SPARK-40798: - The below issue is addressed in the current Jira. Can I add a

[jira] [Resolved] (SPARK-41095) Convert unresolved operators to internal errors

[ https://issues.apache.org/jira/browse/SPARK-41095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41095. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38582

[jira] [Commented] (SPARK-40988) Spark3 partition column value is not validated with user provided schema.

[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632102#comment-17632102 ] Ranga Reddy commented on SPARK-40988: - The following Jira will resolve the issue by throwing the

[jira] [Resolved] (SPARK-41059) Rename _LEGACY_ERROR_TEMP_2420 to NESTED_AGGREGATE_FUNCTION

[ https://issues.apache.org/jira/browse/SPARK-41059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41059. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38572

[jira] [Commented] (SPARK-40096) Finalize shuffle merge slow due to connection creation fails

[ https://issues.apache.org/jira/browse/SPARK-40096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632091#comment-17632091 ] Apache Spark commented on SPARK-40096: -- User 'mridulm' has created a pull request for this issue:

[jira] [Commented] (SPARK-40096) Finalize shuffle merge slow due to connection creation fails

[ https://issues.apache.org/jira/browse/SPARK-40096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632090#comment-17632090 ] Apache Spark commented on SPARK-40096: -- User 'mridulm' has created a pull request for this issue:

[jira] [Commented] (SPARK-41110) Implement `DataFrame.sparkSession` in Python client

[ https://issues.apache.org/jira/browse/SPARK-41110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632084#comment-17632084 ] Apache Spark commented on SPARK-41110: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41110) Implement `DataFrame.sparkSession` in Python client

[ https://issues.apache.org/jira/browse/SPARK-41110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41110: Assignee: Apache Spark > Implement `DataFrame.sparkSession` in Python client >

[jira] [Commented] (SPARK-41110) Implement `DataFrame.sparkSession` in Python client

[ https://issues.apache.org/jira/browse/SPARK-41110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632083#comment-17632083 ] Apache Spark commented on SPARK-41110: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41110) Implement `DataFrame.sparkSession` in Python client

[ https://issues.apache.org/jira/browse/SPARK-41110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41110: Assignee: (was: Apache Spark) > Implement `DataFrame.sparkSession` in Python client

[jira] [Created] (SPARK-41110) Implement `DataFrame.sparkSession` in Python client

Rui Wang created SPARK-41110: Summary: Implement `DataFrame.sparkSession` in Python client Key: SPARK-41110 URL: https://issues.apache.org/jira/browse/SPARK-41110 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41108) Control the max size of arrow batch

[ https://issues.apache.org/jira/browse/SPARK-41108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41108: Assignee: Ruifeng Zheng > Control the max size of arrow batch >

[jira] [Resolved] (SPARK-41108) Control the max size of arrow batch

[ https://issues.apache.org/jira/browse/SPARK-41108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41108. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38612

[jira] [Assigned] (SPARK-41109) Rename the error class _LEGACY_ERROR_TEMP_1216 to INVALID_LIKE_PATTERN

[ https://issues.apache.org/jira/browse/SPARK-41109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41109: Assignee: Apache Spark > Rename the error class _LEGACY_ERROR_TEMP_1216 to

[jira] [Assigned] (SPARK-41109) Rename the error class _LEGACY_ERROR_TEMP_1216 to INVALID_LIKE_PATTERN

[ https://issues.apache.org/jira/browse/SPARK-41109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41109: Assignee: (was: Apache Spark) > Rename the error class _LEGACY_ERROR_TEMP_1216 to

[jira] [Commented] (SPARK-41109) Rename the error class _LEGACY_ERROR_TEMP_1216 to INVALID_LIKE_PATTERN

[ https://issues.apache.org/jira/browse/SPARK-41109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632078#comment-17632078 ] Apache Spark commented on SPARK-41109: -- User 'panbingkun' has created a pull request for this

[jira] [Created] (SPARK-41109) Rename the error class _LEGACY_ERROR_TEMP_1216 to INVALID_LIKE_PATTERN

BingKun Pan created SPARK-41109: --- Summary: Rename the error class _LEGACY_ERROR_TEMP_1216 to INVALID_LIKE_PATTERN Key: SPARK-41109 URL: https://issues.apache.org/jira/browse/SPARK-41109 Project: Spark

[jira] [Commented] (SPARK-40988) Spark3 partition column value is not validated with user provided schema.

[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632073#comment-17632073 ] Ranga Reddy commented on SPARK-40988: - In Spark 3.4, if we run the following code we can see the

[jira] [Commented] (SPARK-41005) Arrow based collect

[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632069#comment-17632069 ] Apache Spark commented on SPARK-41005: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41005) Arrow based collect

[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632070#comment-17632070 ] Apache Spark commented on SPARK-41005: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41005) Arrow based collect

[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632067#comment-17632067 ] Apache Spark commented on SPARK-41005: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41005) Arrow based collect

[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632066#comment-17632066 ] Apache Spark commented on SPARK-41005: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41108) Control the max size of arrow batch

[ https://issues.apache.org/jira/browse/SPARK-41108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632058#comment-17632058 ] Apache Spark commented on SPARK-41108: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41108) Control the max size of arrow batch

[ https://issues.apache.org/jira/browse/SPARK-41108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41108: Assignee: Apache Spark > Control the max size of arrow batch >

[jira] [Commented] (SPARK-41108) Control the max size of arrow batch

[ https://issues.apache.org/jira/browse/SPARK-41108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632057#comment-17632057 ] Apache Spark commented on SPARK-41108: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41108) Control the max size of arrow batch

[ https://issues.apache.org/jira/browse/SPARK-41108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41108: Assignee: (was: Apache Spark) > Control the max size of arrow batch >

[jira] [Created] (SPARK-41108) Control the max size of arrow batch

Ruifeng Zheng created SPARK-41108: - Summary: Control the max size of arrow batch Key: SPARK-41108 URL: https://issues.apache.org/jira/browse/SPARK-41108 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41063) `hive-thriftserver` module compilation deadlock

[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41063: Assignee: (was: Apache Spark) > `hive-thriftserver` module compilation deadlock >

[jira] [Assigned] (SPARK-41107) Install memory-profiler in the CI

[ https://issues.apache.org/jira/browse/SPARK-41107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41107: Assignee: (was: Apache Spark) > Install memory-profiler in the CI >

[jira] [Commented] (SPARK-41107) Install memory-profiler in the CI

[ https://issues.apache.org/jira/browse/SPARK-41107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632054#comment-17632054 ] Apache Spark commented on SPARK-41107: -- User 'xinrong-meng' has created a pull request for this

[jira] [Updated] (SPARK-41107) Install memory-profiler in the CI

[ https://issues.apache.org/jira/browse/SPARK-41107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41107: - Description: PySpark memory profiler depends on

[jira] [Assigned] (SPARK-41063) `hive-thriftserver` module compilation deadlock

[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41063: Assignee: Apache Spark > `hive-thriftserver` module compilation deadlock >

[jira] [Updated] (SPARK-41107) Install memory-profiler in the CI

[ https://issues.apache.org/jira/browse/SPARK-41107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41107: - Description: PySpark memory profiler depends on

[jira] [Assigned] (SPARK-41107) Install memory-profiler in the CI

[ https://issues.apache.org/jira/browse/SPARK-41107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41107: Assignee: Apache Spark > Install memory-profiler in the CI >

[jira] [Updated] (SPARK-41107) Install memory-profiler in the CI

[ https://issues.apache.org/jira/browse/SPARK-41107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41107: - Description: PySpark memory profiler depends on

[jira] [Updated] (SPARK-41107) Install memory-profiler in the CI

[ https://issues.apache.org/jira/browse/SPARK-41107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41107: - Summary: Install memory-profiler in the CI (was: Install memory-profiler in CI) > Install

[jira] [Updated] (SPARK-41107) Install memory-profiler in CI

[ https://issues.apache.org/jira/browse/SPARK-41107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41107: - Summary: Install memory-profiler in CI (was: Install the Memory Profiler in CI) > Install

[jira] [Reopened] (SPARK-41063) `hive-thriftserver` module compilation deadlock

[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-41063: -- Assignee: (was: Hyukjin Kwon) > `hive-thriftserver` module compilation deadlock >

[jira] [Updated] (SPARK-41063) `hive-thriftserver` module compilation deadlock

[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41063: - Fix Version/s: (was: 3.4.0) > `hive-thriftserver` module compilation deadlock >

[jira] [Commented] (SPARK-41063) `hive-thriftserver` module compilation deadlock

[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632053#comment-17632053 ] Hyukjin Kwon commented on SPARK-41063: -- Reverted at

[jira] [Resolved] (SPARK-41036) `columns` API should use `schema` API to avoid data fetching

[ https://issues.apache.org/jira/browse/SPARK-41036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41036. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38546

[jira] [Assigned] (SPARK-41036) `columns` API should use `schema` API to avoid data fetching

[ https://issues.apache.org/jira/browse/SPARK-41036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41036: - Assignee: Rui Wang > `columns` API should use `schema` API to avoid data fetching >

[jira] [Updated] (SPARK-41107) Install the Memory Profiler in CI

[ https://issues.apache.org/jira/browse/SPARK-41107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41107: - Component/s: Tests > Install the Memory Profiler in CI > - > >

[jira] [Created] (SPARK-41107) Install the Memory Profiler in CI

Xinrong Meng created SPARK-41107: Summary: Install the Memory Profiler in CI Key: SPARK-41107 URL: https://issues.apache.org/jira/browse/SPARK-41107 Project: Spark Issue Type: Sub-task

[jira] [Closed] (SPARK-41099) Do not wrap exceptions thrown in SparkHadoopWriter.write with SparkException

[ https://issues.apache.org/jira/browse/SPARK-41099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang closed SPARK-41099. > Do not wrap exceptions thrown in SparkHadoopWriter.write with SparkException >

[jira] [Comment Edited] (SPARK-41099) Do not wrap exceptions thrown in SparkHadoopWriter.write with SparkException

[ https://issues.apache.org/jira/browse/SPARK-41099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632048#comment-17632048 ] Bo Zhang edited comment on SPARK-41099 at 11/11/22 3:08 AM: To keep the

[jira] [Resolved] (SPARK-41105) Adopt `optional` keyword from proto3 which offers `hasXXX` to differentiate if a field is set or unset

[ https://issues.apache.org/jira/browse/SPARK-41105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41105. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38606

[jira] [Resolved] (SPARK-41099) Do not wrap exceptions thrown in SparkHadoopWriter.write with SparkException

[ https://issues.apache.org/jira/browse/SPARK-41099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang resolved SPARK-41099. -- Resolution: Won't Fix To keep the exceptions exposed to users who use the RDD APIs, we will not

[jira] [Assigned] (SPARK-41105) Adopt `optional` keyword from proto3 which offers `hasXXX` to differentiate if a field is set or unset

[ https://issues.apache.org/jira/browse/SPARK-41105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41105: Assignee: Rui Wang > Adopt `optional` keyword from proto3 which offers `hasXXX` to

[jira] [Resolved] (SPARK-40281) Memory Profiler on Executors

[ https://issues.apache.org/jira/browse/SPARK-40281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40281. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38584

[jira] [Assigned] (SPARK-40281) Memory Profiler on Executors

[ https://issues.apache.org/jira/browse/SPARK-40281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40281: Assignee: Xinrong Meng > Memory Profiler on Executors > > >

[jira] [Commented] (SPARK-41106) Reduce collection conversion when create AttributeMap

[ https://issues.apache.org/jira/browse/SPARK-41106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632041#comment-17632041 ] Apache Spark commented on SPARK-41106: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41106) Reduce collection conversion when create AttributeMap

[ https://issues.apache.org/jira/browse/SPARK-41106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41106: Assignee: (was: Apache Spark) > Reduce collection conversion when create

[jira] [Assigned] (SPARK-41106) Reduce collection conversion when create AttributeMap

[ https://issues.apache.org/jira/browse/SPARK-41106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41106: Assignee: Apache Spark > Reduce collection conversion when create AttributeMap >

[jira] [Created] (SPARK-41106) Reduce collection conversion when create AttributeMap

Yang Jie created SPARK-41106: Summary: Reduce collection conversion when create AttributeMap Key: SPARK-41106 URL: https://issues.apache.org/jira/browse/SPARK-41106 Project: Spark Issue Type:

[jira] [Commented] (SPARK-40593) protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

[ https://issues.apache.org/jira/browse/SPARK-40593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632030#comment-17632030 ] Apache Spark commented on SPARK-40593: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-40593) protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

[ https://issues.apache.org/jira/browse/SPARK-40593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632028#comment-17632028 ] Apache Spark commented on SPARK-40593: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40593) protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

[ https://issues.apache.org/jira/browse/SPARK-40593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40593: Assignee: Apache Spark > protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14 >

[jira] [Assigned] (SPARK-40593) protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

[ https://issues.apache.org/jira/browse/SPARK-40593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40593: Assignee: (was: Apache Spark) > protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

[jira] [Assigned] (SPARK-41077) Rename `ColumnRef` to `Column` in Python client implementation

[ https://issues.apache.org/jira/browse/SPARK-41077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41077: Assignee: Rui Wang > Rename `ColumnRef` to `Column` in Python client implementation >

[jira] [Resolved] (SPARK-41077) Rename `ColumnRef` to `Column` in Python client implementation

[ https://issues.apache.org/jira/browse/SPARK-41077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41077. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38586

[jira] [Resolved] (SPARK-41063) `hive-thriftserver` module compilation deadlock

[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41063. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38599

[jira] [Assigned] (SPARK-41063) `hive-thriftserver` module compilation deadlock

[ https://issues.apache.org/jira/browse/SPARK-41063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41063: Assignee: Hyukjin Kwon > `hive-thriftserver` module compilation deadlock >

[jira] [Assigned] (SPARK-41005) Arrow based collect

[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41005: - Assignee: Ruifeng Zheng > Arrow based collect > --- > >

[jira] [Resolved] (SPARK-41005) Arrow based collect

[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41005. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38468

[jira] [Commented] (SPARK-41080) Support Bit manipulation function SETBIT

[ https://issues.apache.org/jira/browse/SPARK-41080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631991#comment-17631991 ] Apache Spark commented on SPARK-41080: -- User 'vinodkc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41080) Support Bit manipulation function SETBIT

[ https://issues.apache.org/jira/browse/SPARK-41080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41080: Assignee: (was: Apache Spark) > Support Bit manipulation function SETBIT >

[jira] [Commented] (SPARK-41080) Support Bit manipulation function SETBIT

[ https://issues.apache.org/jira/browse/SPARK-41080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631990#comment-17631990 ] Apache Spark commented on SPARK-41080: -- User 'vinodkc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41080) Support Bit manipulation function SETBIT

[ https://issues.apache.org/jira/browse/SPARK-41080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41080: Assignee: Apache Spark > Support Bit manipulation function SETBIT >

[jira] [Commented] (SPARK-40938) Support Alias for every Relation

[ https://issues.apache.org/jira/browse/SPARK-40938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631982#comment-17631982 ] Apache Spark commented on SPARK-40938: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40938) Support Alias for every Relation

[ https://issues.apache.org/jira/browse/SPARK-40938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631983#comment-17631983 ] Apache Spark commented on SPARK-40938: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Resolved] (SPARK-40901) Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path

[ https://issues.apache.org/jira/browse/SPARK-40901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40901. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-40901) Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path

[ https://issues.apache.org/jira/browse/SPARK-40901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40901: --- Assignee: Swaminathan Balachandran > Unable to store Spark Driver logs

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Attachment: Screenshot 2022-11-09 015432.png > Spark Submitter generates a ConfigMap with

[jira] [Commented] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631972#comment-17631972 ] Serhii Nesterov commented on SPARK-41060: - After applying the fixes from the pull request config

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Description: *Description of the issue:* There's a problem with submitting spark jobs to

[jira] [Updated] (SPARK-41060) Spark Submitter generates a ConfigMap with the same name

[ https://issues.apache.org/jira/browse/SPARK-41060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serhii Nesterov updated SPARK-41060: Description: There's a problem with submitting spark jobs to K8s cluster: the library

[jira] [Commented] (SPARK-41105) Adopt `optional` keyword from proto3 which offers `hasXXX` to differentiate if a field is set or unset

[ https://issues.apache.org/jira/browse/SPARK-41105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631967#comment-17631967 ] Apache Spark commented on SPARK-41105: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41105) Adopt `optional` keyword from proto3 which offers `hasXXX` to differentiate if a field is set or unset

[ https://issues.apache.org/jira/browse/SPARK-41105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41105: Assignee: Apache Spark > Adopt `optional` keyword from proto3 which offers `hasXXX` to

[jira] [Assigned] (SPARK-41105) Adopt `optional` keyword from proto3 which offers `hasXXX` to differentiate if a field is set or unset

[ https://issues.apache.org/jira/browse/SPARK-41105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41105: Assignee: (was: Apache Spark) > Adopt `optional` keyword from proto3 which offers

[jira] [Created] (SPARK-41105) Adopt `optional` keyword from proto3 which offers `hasXXX` to differentiate if a field is set or unset

Rui Wang created SPARK-41105: Summary: Adopt `optional` keyword from proto3 which offers `hasXXX` to differentiate if a field is set or unset Key: SPARK-41105 URL: https://issues.apache.org/jira/browse/SPARK-41105

[jira] [Commented] (SPARK-41104) Can insert NULL into hive table table with NOT NULL column

[ https://issues.apache.org/jira/browse/SPARK-41104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631946#comment-17631946 ] Rui Wang commented on SPARK-41104: -- Looks like HIVE only enforce `NOT NULL` since Hive 3.0.0

  1   2   >