[jira] [Updated] (SPARK-43225) Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution

[ https://issues.apache.org/jira/browse/SPARK-43225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43225: Summary: Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution (was: Change

[jira] [Resolved] (SPARK-43102) Upgrade commons-compress to 1.23.0

[ https://issues.apache.org/jira/browse/SPARK-43102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43102. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40751

[jira] [Assigned] (SPARK-43102) Upgrade commons-compress to 1.23.0

[ https://issues.apache.org/jira/browse/SPARK-43102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43102: - Assignee: Yang Jie > Upgrade commons-compress to 1.23.0 >

[jira] [Created] (SPARK-43227) Fix deserialisation issue when UDFs contain a lambda expression

Venkata Sai Akhil Gudesa created SPARK-43227: Summary: Fix deserialisation issue when UDFs contain a lambda expression Key: SPARK-43227 URL: https://issues.apache.org/jira/browse/SPARK-43227

[jira] [Resolved] (SPARK-43213) Add `DataFrame.offset` to PySpark

[ https://issues.apache.org/jira/browse/SPARK-43213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43213. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40873

[jira] [Assigned] (SPARK-43213) Add `DataFrame.offset` to PySpark

[ https://issues.apache.org/jira/browse/SPARK-43213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43213: - Assignee: Ruifeng Zheng > Add `DataFrame.offset` to PySpark >

[jira] [Commented] (SPARK-43224) Executor should not be removed when decommissioned in standalone

[ https://issues.apache.org/jira/browse/SPARK-43224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714820#comment-17714820 ] Hyukjin Kwon commented on SPARK-43224: -- [~warrenzhu25]would be great if we have some description on

[jira] [Updated] (SPARK-43226) Define extractors for file-constant metadata columns

[ https://issues.apache.org/jira/browse/SPARK-43226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-43226: - Target Version/s: (was: 3.5.0) > Define extractors for file-constant metadata columns >

[jira] [Commented] (SPARK-43225) Change the scope of jackson-mapper-asl from compile to test

[ https://issues.apache.org/jira/browse/SPARK-43225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714817#comment-17714817 ] Snoot.io commented on SPARK-43225: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-43222) Remove check of `isHadoop3`

[ https://issues.apache.org/jira/browse/SPARK-43222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714819#comment-17714819 ] Snoot.io commented on SPARK-43222: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Commented] (SPARK-43193) Remove workaround for HADOOP-12074

[ https://issues.apache.org/jira/browse/SPARK-43193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714818#comment-17714818 ] Snoot.io commented on SPARK-43193: -- User 'pan3793' has created a pull request for this issue:

[jira] [Commented] (SPARK-31733) Make YarnClient.`specify a more specific type for the application` pass in Hadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-31733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714816#comment-17714816 ] Snoot.io commented on SPARK-31733: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Resolved] (SPARK-43193) Remove workaround for HADOOP-12074

[ https://issues.apache.org/jira/browse/SPARK-43193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43193. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40852

[jira] [Assigned] (SPARK-43193) Remove workaround for HADOOP-12074

[ https://issues.apache.org/jira/browse/SPARK-43193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43193: Assignee: Cheng Pan > Remove workaround for HADOOP-12074 >

[jira] [Created] (SPARK-43226) Define extractors for file-constant metadata columns

Ryan Johnson created SPARK-43226: Summary: Define extractors for file-constant metadata columns Key: SPARK-43226 URL: https://issues.apache.org/jira/browse/SPARK-43226 Project: Spark Issue

[jira] [Commented] (SPARK-43128) Streaming progress struct (especially in Scala)

[ https://issues.apache.org/jira/browse/SPARK-43128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714812#comment-17714812 ] Snoot.io commented on SPARK-43128: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Commented] (SPARK-43128) Streaming progress struct (especially in Scala)

[ https://issues.apache.org/jira/browse/SPARK-43128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714810#comment-17714810 ] Snoot.io commented on SPARK-43128: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Commented] (SPARK-42945) Support PYSPARK_JVM_STACKTRACE_ENABLED in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-42945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714808#comment-17714808 ] Snoot.io commented on SPARK-42945: -- User 'allisonwang-db' has created a pull request for this issue:

[jira] [Commented] (SPARK-43136) Scala mapGroup, coGroup

[ https://issues.apache.org/jira/browse/SPARK-43136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714807#comment-17714807 ] Snoot.io commented on SPARK-43136: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Created] (SPARK-43225) Change the scope of jackson-mapper-asl from compile to test

Yuming Wang created SPARK-43225: --- Summary: Change the scope of jackson-mapper-asl from compile to test Key: SPARK-43225 URL: https://issues.apache.org/jira/browse/SPARK-43225 Project: Spark

[jira] [Assigned] (SPARK-43119) Support Get SQL Keywords Dynamically

[ https://issues.apache.org/jira/browse/SPARK-43119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-43119: Assignee: Kent Yao > Support Get SQL Keywords Dynamically >

[jira] [Resolved] (SPARK-43119) Support Get SQL Keywords Dynamically

[ https://issues.apache.org/jira/browse/SPARK-43119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-43119. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40768

[jira] [Closed] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression

[ https://issues.apache.org/jira/browse/SPARK-43220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Fan closed SPARK-43220. --- > INSERT INTO REPLACE statement can't support WHERE with bool_expression >

[jira] [Commented] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression

[ https://issues.apache.org/jira/browse/SPARK-43220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714794#comment-17714794 ] Jia Fan commented on SPARK-43220: - After I tested with another way, it works. My fault. > INSERT INTO

[jira] [Resolved] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression

[ https://issues.apache.org/jira/browse/SPARK-43220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Fan resolved SPARK-43220. - Resolution: Invalid > INSERT INTO REPLACE statement can't support WHERE with bool_expression >

[jira] [Commented] (SPARK-39203) Fix remote table location based on database location

[ https://issues.apache.org/jira/browse/SPARK-39203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714793#comment-17714793 ] Hyukjin Kwon commented on SPARK-39203: -- But to be clear, this change exists in Spark 3.4.0. It was

[jira] [Updated] (SPARK-39203) Fix remote table location based on database location

[ https://issues.apache.org/jira/browse/SPARK-39203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39203: - Fix Version/s: (was: 3.4.0) > Fix remote table location based on database location >

[jira] [Reopened] (SPARK-39203) Fix remote table location based on database location

[ https://issues.apache.org/jira/browse/SPARK-39203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-39203: -- Assignee: (was: Yuming Wang) Reverted in https://github.com/apache/spark/pull/40871 >

[jira] [Resolved] (SPARK-43124) Dataset.show should not trigger job execution on CommandResults

[ https://issues.apache.org/jira/browse/SPARK-43124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43124. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40779

[jira] [Assigned] (SPARK-43124) Dataset.show should not trigger job execution on CommandResults

[ https://issues.apache.org/jira/browse/SPARK-43124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43124: Assignee: Peter Toth > Dataset.show should not trigger job execution on CommandResults >

[jira] [Resolved] (SPARK-42960) Add remaining Streaming Query commands like await_termination()

[ https://issues.apache.org/jira/browse/SPARK-42960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42960. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40785

[jira] [Assigned] (SPARK-42960) Add remaining Streaming Query commands like await_termination()

[ https://issues.apache.org/jira/browse/SPARK-42960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42960: Assignee: Raghu Angadi > Add remaining Streaming Query commands like await_termination()

[jira] [Created] (SPARK-43224) Executor should not be removed when decommissioned in standalone

Zhongwei Zhu created SPARK-43224: Summary: Executor should not be removed when decommissioned in standalone Key: SPARK-43224 URL: https://issues.apache.org/jira/browse/SPARK-43224 Project: Spark

[jira] [Resolved] (SPARK-43211) Remove Hadoop2 support in IsolatedClientLoader

[ https://issues.apache.org/jira/browse/SPARK-43211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-43211. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40870

[jira] [Assigned] (SPARK-43211) Remove Hadoop2 support in IsolatedClientLoader

[ https://issues.apache.org/jira/browse/SPARK-43211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-43211: Assignee: Cheng Pan > Remove Hadoop2 support in IsolatedClientLoader >

[jira] [Resolved] (SPARK-43202) Replace reflection w/ direct calling for YARN Resource API

[ https://issues.apache.org/jira/browse/SPARK-43202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-43202. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40860

[jira] [Assigned] (SPARK-43202) Replace reflection w/ direct calling for YARN Resource API

[ https://issues.apache.org/jira/browse/SPARK-43202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-43202: Assignee: Cheng Pan > Replace reflection w/ direct calling for YARN Resource API >

[jira] [Updated] (SPARK-43201) Inconsistency between from_avro and from_json function

[ https://issues.apache.org/jira/browse/SPARK-43201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Adetiloye updated SPARK-43201: - Description: Spark from_avro function does not allow schema parameter to use dataframe

[jira] [Updated] (SPARK-43201) Inconsistency between from_avro and from_json function

[ https://issues.apache.org/jira/browse/SPARK-43201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Adetiloye updated SPARK-43201: - Description: Spark from_avro function does not allow schema parameter to use dataframe

[jira] [Commented] (SPARK-43202) Replace reflection w/ direct calling for YARN Resource API

[ https://issues.apache.org/jira/browse/SPARK-43202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714707#comment-17714707 ] Mike K commented on SPARK-43202: User 'pan3793' has created a pull request for this issue:

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Description: Spark on Yarn Cluster When multiple executors exist on a node, and the same block

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Description: Spark on Yarn Cluster When multiple executors exist on a node, and the same block

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Attachment: image-2023-04-21-00-57-29-140.png > Executor obtained error information >

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Attachment: image-2023-04-21-00-54-11-968.png > Executor obtained error information >

[jira] [Assigned] (SPARK-43208) IsolatedClassLoader should close barrier class InputStream after reading

[ https://issues.apache.org/jira/browse/SPARK-43208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-43208: Assignee: Cheng Pan > IsolatedClassLoader should close barrier class InputStream after reading >

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Attachment: image-2023-04-21-00-53-20-720.png > Executor obtained error information >

[jira] [Resolved] (SPARK-43208) IsolatedClassLoader should close barrier class InputStream after reading

[ https://issues.apache.org/jira/browse/SPARK-43208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-43208. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40867

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Attachment: image-2023-04-21-00-50-10-918.png > Executor obtained error information >

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Description: Spark on Yarn Cluster When multiple executors exist on a node, and the same block

[jira] [Updated] (SPARK-43222) Remove check of `isHadoop3`

[ https://issues.apache.org/jira/browse/SPARK-43222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43222: - Component/s: (was: YARN) > Remove check of `isHadoop3` > --- > >

[jira] [Created] (SPARK-43223) KeyValueGroupedDataset#agg

Zhen Li created SPARK-43223: --- Summary: KeyValueGroupedDataset#agg Key: SPARK-43223 URL: https://issues.apache.org/jira/browse/SPARK-43223 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Attachment: image-2023-04-21-00-30-41-851.png > Executor obtained error information >

[jira] [Resolved] (SPARK-35959) Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions

[ https://issues.apache.org/jira/browse/SPARK-35959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Chao resolved SPARK-35959. -- Resolution: Won't Fix > Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions >

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Attachment: image-2023-04-21-00-24-22-059.png > Executor obtained error information >

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Attachment: image-2023-04-21-00-19-58-021.png > Executor obtained error information >

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Description: Spark on Yarn Cluster When multiple executors exist on a node, and the same block

[jira] [Updated] (SPARK-43222) Remove check of `isHadoop3`

[ https://issues.apache.org/jira/browse/SPARK-43222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43222: - Summary: Remove check of `isHadoop3` (was: Remove check of `VersionUtils.isHadoop3`) > Remove check

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Description: Spark on Yarn Cluster When multiple executors exist on a node, and the same block

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Description: Spark on Yarn Cluster When multiple executors exist on a node, and the same block

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiang Yang updated SPARK-43221: --- Description: Spark on Yarn Cluster When multiple executors exist on a node, and the same block

[jira] [Created] (SPARK-43222) Remove check of `VersionUtils.isHadoop3`

Yang Jie created SPARK-43222: Summary: Remove check of `VersionUtils.isHadoop3` Key: SPARK-43222 URL: https://issues.apache.org/jira/browse/SPARK-43222 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43221) Executor obtained error information

Qiang Yang created SPARK-43221: -- Summary: Executor obtained error information Key: SPARK-43221 URL: https://issues.apache.org/jira/browse/SPARK-43221 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-43197) Clean up the code written for compatibility with Hadoop 2

[ https://issues.apache.org/jira/browse/SPARK-43197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714647#comment-17714647 ] GridGain Integration commented on SPARK-43197: -- User 'pan3793' has created a pull request

[jira] [Commented] (SPARK-43215) Remove `ResourceRequestHelper#isYarnResourceTypesAvailable`

[ https://issues.apache.org/jira/browse/SPARK-43215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714646#comment-17714646 ] GridGain Integration commented on SPARK-43215: -- User 'LuciferYang' has created a pull

[jira] [Resolved] (SPARK-43215) Remove `ResourceRequestHelper#isYarnResourceTypesAvailable`

[ https://issues.apache.org/jira/browse/SPARK-43215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-43215. -- Resolution: Duplicate > Remove `ResourceRequestHelper#isYarnResourceTypesAvailable` >

[jira] [Commented] (SPARK-43113) Codegen error when full outer join's bound condition has multiple references to the same stream-side column

[ https://issues.apache.org/jira/browse/SPARK-43113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714645#comment-17714645 ] Hudson commented on SPARK-43113: User 'bersprockets' has created a pull request for this issue:

[jira] [Commented] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression

[ https://issues.apache.org/jira/browse/SPARK-43220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714644#comment-17714644 ] Jia Fan commented on SPARK-43220: - Maybe the way of test have problem or `InMemoryTable` not support

[jira] [Resolved] (SPARK-43216) Refactor `ResourceRequestHelper ` to no longer use reflection

[ https://issues.apache.org/jira/browse/SPARK-43216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-43216. -- Resolution: Duplicate > Refactor `ResourceRequestHelper ` to no longer use reflection >

[jira] [Updated] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression

[ https://issues.apache.org/jira/browse/SPARK-43220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Fan updated SPARK-43220: Description: {code:java} sql("CREATE TABLE persons (name string,address String,ssn int) USING parquet")

[jira] [Updated] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression

[ https://issues.apache.org/jira/browse/SPARK-43220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Fan updated SPARK-43220: Description: sql("CREATE TABLE persons (name string,address String,ssn int) USING parquet") sql("CREATE

[jira] [Updated] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression

[ https://issues.apache.org/jira/browse/SPARK-43220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Fan updated SPARK-43220: Attachment: image-2023-04-20-23-40-25-212.png > INSERT INTO REPLACE statement can't support WHERE with

[jira] [Created] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression

Jia Fan created SPARK-43220: --- Summary: INSERT INTO REPLACE statement can't support WHERE with bool_expression Key: SPARK-43220 URL: https://issues.apache.org/jira/browse/SPARK-43220 Project: Spark

[jira] [Created] (SPARK-43219) Website can't find INSERT INTO REPLACE Statement

Jia Fan created SPARK-43219: --- Summary: Website can't find INSERT INTO REPLACE Statement Key: SPARK-43219 URL: https://issues.apache.org/jira/browse/SPARK-43219 Project: Spark Issue Type:

[jira] [Created] (SPARK-43218) Support "ESCAPE BY" in SparkScriptTransformationExec

jiang13021 created SPARK-43218: -- Summary: Support "ESCAPE BY" in SparkScriptTransformationExec Key: SPARK-43218 URL: https://issues.apache.org/jira/browse/SPARK-43218 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43152) User-defined output metadata path (_spark_metadata)

[ https://issues.apache.org/jira/browse/SPARK-43152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-43152: Summary: User-defined output metadata path (_spark_metadata) (was: Parametrisable output

[jira] [Updated] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField

[ https://issues.apache.org/jira/browse/SPARK-43217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-43217: --- Description:

[jira] [Updated] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField

[ https://issues.apache.org/jira/browse/SPARK-43217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-43217: --- Description:

[jira] [Updated] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField

[ https://issues.apache.org/jira/browse/SPARK-43217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-43217: --- Description:

[jira] [Created] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField

Johan Lasperas created SPARK-43217: -- Summary: Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField Key: SPARK-43217 URL: https://issues.apache.org/jira/browse/SPARK-43217

[jira] [Commented] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714556#comment-17714556 ] Hu Ziqian commented on SPARK-36058: --- hi [~holden], i have a question about the

[jira] [Created] (SPARK-43216) Refactor `ResourceRequestHelper ` to no longer use reflection

Yang Jie created SPARK-43216: Summary: Refactor `ResourceRequestHelper ` to no longer use reflection Key: SPARK-43216 URL: https://issues.apache.org/jira/browse/SPARK-43216 Project: Spark Issue

[jira] [Created] (SPARK-43215) Remove `ResourceRequestHelper#isYarnResourceTypesAvailable`

Yang Jie created SPARK-43215: Summary: Remove `ResourceRequestHelper#isYarnResourceTypesAvailable` Key: SPARK-43215 URL: https://issues.apache.org/jira/browse/SPARK-43215 Project: Spark Issue

[jira] [Created] (SPARK-43214) Post driver-side metrics for LocalTableScanExec/CommandResultExec

Fu Chen created SPARK-43214: --- Summary: Post driver-side metrics for LocalTableScanExec/CommandResultExec Key: SPARK-43214 URL: https://issues.apache.org/jira/browse/SPARK-43214 Project: Spark

[jira] [Resolved] (SPARK-43184) Resume using enumeration to compare `NodeState.DECOMMISSIONING`

[ https://issues.apache.org/jira/browse/SPARK-43184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43184. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40846

[jira] [Assigned] (SPARK-43184) Resume using enumeration to compare `NodeState.DECOMMISSIONING`

[ https://issues.apache.org/jira/browse/SPARK-43184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43184: - Assignee: Yang Jie > Resume using enumeration to compare `NodeState.DECOMMISSIONING`

[jira] [Commented] (SPARK-43213) Add `DataFrame.offset` to PySpark

[ https://issues.apache.org/jira/browse/SPARK-43213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714501#comment-17714501 ] ASF GitHub Bot commented on SPARK-43213: User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-39203) Fix remote table location based on database location

[ https://issues.apache.org/jira/browse/SPARK-39203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714499#comment-17714499 ] ASF GitHub Bot commented on SPARK-39203: User 'cloud-fan' has created a pull request for this

[jira] [Updated] (SPARK-43213) Add `DataFrame.offset` to PySpark

[ https://issues.apache.org/jira/browse/SPARK-43213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43213: -- Issue Type: New Feature (was: Improvement) > Add `DataFrame.offset` to PySpark >

[jira] [Commented] (SPARK-43169) Update mima's previousSparkVersion to 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-43169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714498#comment-17714498 ] ASF GitHub Bot commented on SPARK-43169: User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-43213) Add `DataFrame.offset` to PySpark

Ruifeng Zheng created SPARK-43213: - Summary: Add `DataFrame.offset` to PySpark Key: SPARK-43213 URL: https://issues.apache.org/jira/browse/SPARK-43213 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-43183) Move update event on idleness in streaming query listener to separate callback method

[ https://issues.apache.org/jira/browse/SPARK-43183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-43183. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40845

[jira] [Assigned] (SPARK-43183) Move update event on idleness in streaming query listener to separate callback method

[ https://issues.apache.org/jira/browse/SPARK-43183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-43183: Assignee: Jungtaek Lim > Move update event on idleness in streaming query listener to

[jira] [Assigned] (SPARK-43207) Add helper functions for extract value from literal expression

[ https://issues.apache.org/jira/browse/SPARK-43207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43207: - Assignee: Ruifeng Zheng > Add helper functions for extract value from literal

[jira] [Resolved] (SPARK-43207) Add helper functions for extract value from literal expression

[ https://issues.apache.org/jira/browse/SPARK-43207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43207. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40863

[jira] [Created] (SPARK-43212) Migrate Structured Streaming errors into error class

Haejoon Lee created SPARK-43212: --- Summary: Migrate Structured Streaming errors into error class Key: SPARK-43212 URL: https://issues.apache.org/jira/browse/SPARK-43212 Project: Spark Issue

[jira] [Resolved] (SPARK-43190) ListQuery.childOutput should be consistent with child output

[ https://issues.apache.org/jira/browse/SPARK-43190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43190. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40851

[jira] [Assigned] (SPARK-43190) ListQuery.childOutput should be consistent with child output

[ https://issues.apache.org/jira/browse/SPARK-43190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43190: --- Assignee: Wenchen Fan > ListQuery.childOutput should be consistent with child output >

[jira] [Created] (SPARK-43211) Remove Hadoop2 support in IsolatedClientLoader

Cheng Pan created SPARK-43211: - Summary: Remove Hadoop2 support in IsolatedClientLoader Key: SPARK-43211 URL: https://issues.apache.org/jira/browse/SPARK-43211 Project: Spark Issue Type:

[jira] [Created] (SPARK-43210) Introduce PySparkAssersionError

Haejoon Lee created SPARK-43210: --- Summary: Introduce PySparkAssersionError Key: SPARK-43210 URL: https://issues.apache.org/jira/browse/SPARK-43210 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43209) Migrate Expression errors into error class

Haejoon Lee created SPARK-43209: --- Summary: Migrate Expression errors into error class Key: SPARK-43209 URL: https://issues.apache.org/jira/browse/SPARK-43209 Project: Spark Issue Type:

  1   2   >