[jira] [Resolved] (SPARK-43302) Make Python UDAF an AggregateFunction

[ https://issues.apache.org/jira/browse/SPARK-43302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43302. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40739

[jira] [Resolved] (SPARK-43309) Extend INTERNAL_ERROR with category

[ https://issues.apache.org/jira/browse/SPARK-43309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43309. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40978

[jira] [Assigned] (SPARK-43309) Extend INTERNAL_ERROR with category

[ https://issues.apache.org/jira/browse/SPARK-43309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43309: --- Assignee: Bo Zhang > Extend INTERNAL_ERROR with category >

[jira] [Assigned] (SPARK-38461) Use error classes in org.apache.spark.broadcast

[ https://issues.apache.org/jira/browse/SPARK-38461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38461: --- Assignee: Bo Zhang > Use error classes in org.apache.spark.broadcast >

[jira] [Resolved] (SPARK-43219) Website can't find INSERT INTO REPLACE Statement

[ https://issues.apache.org/jira/browse/SPARK-43219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43219. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40890

[jira] [Assigned] (SPARK-43219) Website can't find INSERT INTO REPLACE Statement

[ https://issues.apache.org/jira/browse/SPARK-43219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43219: --- Assignee: Jia Fan > Website can't find INSERT INTO REPLACE Statement >

[jira] [Created] (SPARK-43302) Make Python UDAF an AggregateFunction

Wenchen Fan created SPARK-43302: --- Summary: Make Python UDAF an AggregateFunction Key: SPARK-43302 URL: https://issues.apache.org/jira/browse/SPARK-43302 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-43293) __qualified_access_only should be ignored in normal columns

[ https://issues.apache.org/jira/browse/SPARK-43293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43293: --- Assignee: Wenchen Fan > __qualified_access_only should be ignored in normal columns >

[jira] [Resolved] (SPARK-43293) __qualified_access_only should be ignored in normal columns

[ https://issues.apache.org/jira/browse/SPARK-43293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43293. - Fix Version/s: 3.3.3 3.5.0 3.4.1 Resolution: Fixed

[jira] [Created] (SPARK-43293) __qualified_access_only should be ignored in normal columns

Wenchen Fan created SPARK-43293: --- Summary: __qualified_access_only should be ignored in normal columns Key: SPARK-43293 URL: https://issues.apache.org/jira/browse/SPARK-43293 Project: Spark

[jira] [Resolved] (SPARK-43240) df.describe() method may- return wrong result if the last RDD is RDD[UnsafeRow]

[ https://issues.apache.org/jira/browse/SPARK-43240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43240. - Fix Version/s: 3.3.3 Resolution: Fixed Issue resolved by pull request 40914

[jira] [Assigned] (SPARK-43240) df.describe() method may- return wrong result if the last RDD is RDD[UnsafeRow]

[ https://issues.apache.org/jira/browse/SPARK-43240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43240: --- Assignee: Ke Jia > df.describe() method may- return wrong result if the last RDD is >

[jira] [Assigned] (SPARK-43199) Make InlineCTE idempotent

[ https://issues.apache.org/jira/browse/SPARK-43199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43199: --- Assignee: Peter Toth > Make InlineCTE idempotent > - > >

[jira] [Resolved] (SPARK-43199) Make InlineCTE idempotent

[ https://issues.apache.org/jira/browse/SPARK-43199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43199. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40856

[jira] [Assigned] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null`

[ https://issues.apache.org/jira/browse/SPARK-43156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43156: --- Assignee: Jack Chen > Correctness COUNT bug in correlated scalar subselect with `COUNT(*)

[jira] [Resolved] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null`

[ https://issues.apache.org/jira/browse/SPARK-43156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43156. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40946

[jira] [Resolved] (SPARK-43142) DSL expressions fail on attribute with special characters

[ https://issues.apache.org/jira/browse/SPARK-43142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43142. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40902

[jira] [Resolved] (SPARK-43204) Align MERGE assignments with table attributes

[ https://issues.apache.org/jira/browse/SPARK-43204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43204. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40919

[jira] [Assigned] (SPARK-43204) Align MERGE assignments with table attributes

[ https://issues.apache.org/jira/browse/SPARK-43204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43204: --- Assignee: Anton Okolnychyi > Align MERGE assignments with table attributes >

[jira] [Resolved] (SPARK-43226) Define extractors for file-constant metadata columns

[ https://issues.apache.org/jira/browse/SPARK-43226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43226. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40885

[jira] [Assigned] (SPARK-43226) Define extractors for file-constant metadata columns

[ https://issues.apache.org/jira/browse/SPARK-43226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43226: --- Assignee: Ryan Johnson > Define extractors for file-constant metadata columns >

[jira] [Resolved] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField

[ https://issues.apache.org/jira/browse/SPARK-43217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43217. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40879

[jira] [Assigned] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField

[ https://issues.apache.org/jira/browse/SPARK-43217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43217: --- Assignee: Johan Lasperas > Correctly recurse into maps of maps and arrays of arrays in >

[jira] [Assigned] (SPARK-43214) Post driver-side metrics for LocalTableScanExec/CommandResultExec

[ https://issues.apache.org/jira/browse/SPARK-43214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43214: --- Assignee: Fu Chen > Post driver-side metrics for LocalTableScanExec/CommandResultExec >

[jira] [Resolved] (SPARK-43214) Post driver-side metrics for LocalTableScanExec/CommandResultExec

[ https://issues.apache.org/jira/browse/SPARK-43214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43214. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40875

[jira] [Assigned] (SPARK-43142) DSL expressions fail on attribute with special characters

[ https://issues.apache.org/jira/browse/SPARK-43142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43142: --- Assignee: Willi Raschkowski > DSL expressions fail on attribute with special characters >

[jira] [Resolved] (SPARK-43142) DSL expressions fail on attribute with special characters

[ https://issues.apache.org/jira/browse/SPARK-43142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43142. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40794

[jira] [Resolved] (SPARK-43190) ListQuery.childOutput should be consistent with child output

[ https://issues.apache.org/jira/browse/SPARK-43190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43190. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40851

[jira] [Assigned] (SPARK-43190) ListQuery.childOutput should be consistent with child output

[ https://issues.apache.org/jira/browse/SPARK-43190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43190: --- Assignee: Wenchen Fan > ListQuery.childOutput should be consistent with child output >

[jira] [Assigned] (SPARK-43137) Improve ArrayInsert if the position is foldable and equals to zero.

[ https://issues.apache.org/jira/browse/SPARK-43137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43137: --- Assignee: jiaan.geng > Improve ArrayInsert if the position is foldable and equals to zero.

[jira] [Resolved] (SPARK-43137) Improve ArrayInsert if the position is foldable and equals to zero.

[ https://issues.apache.org/jira/browse/SPARK-43137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43137. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40833

[jira] [Assigned] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

[ https://issues.apache.org/jira/browse/SPARK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37829: --- Assignee: Jason Xu > An outer-join using joinWith on DataFrames returns Rows with null

[jira] [Resolved] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values

[ https://issues.apache.org/jira/browse/SPARK-37829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37829. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-43190) ListQuery.childOutput should be consistent with child output

Wenchen Fan created SPARK-43190: --- Summary: ListQuery.childOutput should be consistent with child output Key: SPARK-43190 URL: https://issues.apache.org/jira/browse/SPARK-43190 Project: Spark

[jira] [Resolved] (SPARK-42552) Get ParseException when run sql: "SELECT 1 UNION SELECT 1;"

[ https://issues.apache.org/jira/browse/SPARK-42552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42552. - Fix Version/s: 3.5.0 (was: 3.2.3) Resolution: Fixed Issue

[jira] [Assigned] (SPARK-42552) Get ParseException when run sql: "SELECT 1 UNION SELECT 1;"

[ https://issues.apache.org/jira/browse/SPARK-42552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42552: --- Assignee: Cheng Pan > Get ParseException when run sql: "SELECT 1 UNION SELECT 1;" >

[jira] [Resolved] (SPARK-43165) Move canWrite to DataTypeUtils

[ https://issues.apache.org/jira/browse/SPARK-43165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43165. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40825

[jira] [Assigned] (SPARK-43098) Should not handle the COUNT bug when the GROUP BY clause of a correlated scalar subquery is non-empty

[ https://issues.apache.org/jira/browse/SPARK-43098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43098: --- Assignee: Jack Chen > Should not handle the COUNT bug when the GROUP BY clause of a

[jira] [Resolved] (SPARK-43098) Should not handle the COUNT bug when the GROUP BY clause of a correlated scalar subquery is non-empty

[ https://issues.apache.org/jira/browse/SPARK-43098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43098. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-42151) Align UPDATE assignments with table attributes

[ https://issues.apache.org/jira/browse/SPARK-42151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42151. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40308

[jira] [Assigned] (SPARK-42151) Align UPDATE assignments with table attributes

[ https://issues.apache.org/jira/browse/SPARK-42151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42151: --- Assignee: Anton Okolnychyi > Align UPDATE assignments with table attributes >

[jira] [Resolved] (SPARK-43130) Move InternalType to PhysicalDataType

[ https://issues.apache.org/jira/browse/SPARK-43130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43130. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40784

[jira] [Assigned] (SPARK-43099) `Class.getCanonicalName` return null for anonymous class on JDK15+, impacting function registry

[ https://issues.apache.org/jira/browse/SPARK-43099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43099: --- Assignee: Alex Jing > `Class.getCanonicalName` return null for anonymous class on JDK15+,

[jira] [Resolved] (SPARK-43099) `Class.getCanonicalName` return null for anonymous class on JDK15+, impacting function registry

[ https://issues.apache.org/jira/browse/SPARK-43099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43099. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40747

[jira] [Resolved] (SPARK-43123) special internal field metadata should not be leaked to catalogs

[ https://issues.apache.org/jira/browse/SPARK-43123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43123. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40776

[jira] [Assigned] (SPARK-43123) special internal field metadata should not be leaked to catalogs

[ https://issues.apache.org/jira/browse/SPARK-43123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43123: --- Assignee: Wenchen Fan > special internal field metadata should not be leaked to catalogs >

[jira] [Resolved] (SPARK-43021) Shuffle happens when Coalesce Buckets should occur

[ https://issues.apache.org/jira/browse/SPARK-43021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43021. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40688

[jira] [Assigned] (SPARK-43021) Shuffle happens when Coalesce Buckets should occur

[ https://issues.apache.org/jira/browse/SPARK-43021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43021: --- Assignee: ming95 > Shuffle happens when Coalesce Buckets should occur >

[jira] [Resolved] (SPARK-41674) Runtime filter should supports multi level shuffle join side as filter creation side

[ https://issues.apache.org/jira/browse/SPARK-41674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41674. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39170

[jira] [Assigned] (SPARK-41674) Runtime filter should supports multi level shuffle join side as filter creation side

[ https://issues.apache.org/jira/browse/SPARK-41674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41674: --- Assignee: jiaan.geng > Runtime filter should supports multi level shuffle join side as

[jira] [Created] (SPARK-43126) mark two Hive UDF expressions as stateful

Wenchen Fan created SPARK-43126: --- Summary: mark two Hive UDF expressions as stateful Key: SPARK-43126 URL: https://issues.apache.org/jira/browse/SPARK-43126 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-43123) special internal field metadata should not be leaked to catalogs

Wenchen Fan created SPARK-43123: --- Summary: special internal field metadata should not be leaked to catalogs Key: SPARK-43123 URL: https://issues.apache.org/jira/browse/SPARK-43123 Project: Spark

[jira] [Resolved] (SPARK-43088) Respect RequiresDistributionAndOrdering in CTAS/RTAS

[ https://issues.apache.org/jira/browse/SPARK-43088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43088. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40734

[jira] [Assigned] (SPARK-43088) Respect RequiresDistributionAndOrdering in CTAS/RTAS

[ https://issues.apache.org/jira/browse/SPARK-43088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43088: --- Assignee: Anton Okolnychyi > Respect RequiresDistributionAndOrdering in CTAS/RTAS >

[jira] [Assigned] (SPARK-43063) `df.show` handle null should print NULL instead of null

[ https://issues.apache.org/jira/browse/SPARK-43063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43063: --- Assignee: yikaifei > `df.show` handle null should print NULL instead of null >

[jira] [Resolved] (SPARK-43063) `df.show` handle null should print NULL instead of null

[ https://issues.apache.org/jira/browse/SPARK-43063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43063. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40699

[jira] [Resolved] (SPARK-43110) Move asIntegral to PhysicalDataType

[ https://issues.apache.org/jira/browse/SPARK-43110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43110. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40758

[jira] [Resolved] (SPARK-43103) Move Integral to PhysicalDataType

[ https://issues.apache.org/jira/browse/SPARK-43103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43103. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40752

[jira] [Resolved] (SPARK-43039) Support custom fields in the file source _metadata column

[ https://issues.apache.org/jira/browse/SPARK-43039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43039. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40677

[jira] [Assigned] (SPARK-43039) Support custom fields in the file source _metadata column

[ https://issues.apache.org/jira/browse/SPARK-43039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43039: --- Assignee: Ryan Johnson > Support custom fields in the file source _metadata column >

[jira] [Updated] (SPARK-39625) add Dataset.to(StructType)

[ https://issues.apache.org/jira/browse/SPARK-39625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-39625: Summary: add Dataset.to(StructType) (was: add Dataset.as(StructType)) > add

[jira] [Resolved] (SPARK-43058) Move Numeric to PhysicalDataType

[ https://issues.apache.org/jira/browse/SPARK-43058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43058. - Fix Version/s: 3.5.0 Resolution: Fixed > Move Numeric to PhysicalDataType >

[jira] [Updated] (SPARK-43061) Introduce PartitionEvaluator for SQL operator execution

[ https://issues.apache.org/jira/browse/SPARK-43061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-43061: Summary: Introduce PartitionEvaluator for SQL operator execution (was: Introduce TaskEvaluator

[jira] [Resolved] (SPARK-43061) Introduce TaskEvaluator for SQL operator execution

[ https://issues.apache.org/jira/browse/SPARK-43061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43061. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40697

[jira] [Assigned] (SPARK-43061) Introduce TaskEvaluator for SQL operator execution

[ https://issues.apache.org/jira/browse/SPARK-43061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43061: --- Assignee: Wenchen Fan > Introduce TaskEvaluator for SQL operator execution >

[jira] [Created] (SPARK-43061) Introduce TaskEvaluator for SQL operator execution

Wenchen Fan created SPARK-43061: --- Summary: Introduce TaskEvaluator for SQL operator execution Key: SPARK-43061 URL: https://issues.apache.org/jira/browse/SPARK-43061 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-43030) deduplicate relations with metadata columns

[ https://issues.apache.org/jira/browse/SPARK-43030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43030. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40662

[jira] [Assigned] (SPARK-43030) deduplicate relations with metadata columns

[ https://issues.apache.org/jira/browse/SPARK-43030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43030: --- Assignee: Wenchen Fan > deduplicate relations with metadata columns >

[jira] [Assigned] (SPARK-42855) Migrate nullability write checks to runtime for V2 tables

[ https://issues.apache.org/jira/browse/SPARK-42855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42855: --- Assignee: Anton Okolnychyi > Migrate nullability write checks to runtime for V2 tables >

[jira] [Resolved] (SPARK-42855) Migrate nullability write checks to runtime for V2 tables

[ https://issues.apache.org/jira/browse/SPARK-42855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42855. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40655

[jira] [Created] (SPARK-43030) deduplicate relations with metadata columns

Wenchen Fan created SPARK-43030: --- Summary: deduplicate relations with metadata columns Key: SPARK-43030 URL: https://issues.apache.org/jira/browse/SPARK-43030 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-42655) Incorrect ambiguous column reference error

[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42655: --- Assignee: Shrikant Prasad > Incorrect ambiguous column reference error >

[jira] [Resolved] (SPARK-42655) Incorrect ambiguous column reference error

[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42655. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40258

[jira] [Assigned] (SPARK-43026) Apply AQE with non-exchange table cache

[ https://issues.apache.org/jira/browse/SPARK-43026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43026: --- Assignee: XiDuo You > Apply AQE with non-exchange table cache >

[jira] [Resolved] (SPARK-43026) Apply AQE with non-exchange table cache

[ https://issues.apache.org/jira/browse/SPARK-43026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43026. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40659

[jira] [Assigned] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42918: --- Assignee: Johan Lasperas > Generalize handling of metadata attributes in

[jira] [Resolved] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42918. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40545

[jira] [Assigned] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41391: --- Assignee: Ritika Maheshwari > The output column name of `groupBy.agg(count_distinct)` is

[jira] [Resolved] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41391. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40116

[jira] [Reopened] (SPARK-41765) Pull out v1 write metrics to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-41765: - Assignee: (was: XiDuo You) > Pull out v1 write metrics to WriteFiles >

[jira] [Resolved] (SPARK-41765) Pull out v1 write metrics to WriteFiles

[ https://issues.apache.org/jira/browse/SPARK-41765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41765. - Fix Version/s: (was: 3.4.0) Resolution: Won't Do > Pull out v1 write metrics to

[jira] [Assigned] (SPARK-42683) Automatically rename metadata columns that conflict with data schema columns

[ https://issues.apache.org/jira/browse/SPARK-42683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42683: --- Assignee: Ryan Johnson > Automatically rename metadata columns that conflict with data

[jira] [Resolved] (SPARK-42683) Automatically rename metadata columns that conflict with data schema columns

[ https://issues.apache.org/jira/browse/SPARK-42683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42683. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40300

[jira] [Assigned] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41359: --- Assignee: Yang Jie > Use `PhysicalDataType` instead of DataType in UnsafeRow >

[jira] [Resolved] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41359. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40400

[jira] [Resolved] (SPARK-42949) Simplify code for NAAJ

[ https://issues.apache.org/jira/browse/SPARK-42949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42949. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40578

[jira] [Assigned] (SPARK-42949) Simplify code for NAAJ

[ https://issues.apache.org/jira/browse/SPARK-42949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42949: --- Assignee: Cheng Pan > Simplify code for NAAJ > -- > >

[jira] [Assigned] (SPARK-42928) Make resolvePersistentFunction synchronized

[ https://issues.apache.org/jira/browse/SPARK-42928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42928: --- Assignee: Allison Wang > Make resolvePersistentFunction synchronized >

[jira] [Resolved] (SPARK-42928) Make resolvePersistentFunction synchronized

[ https://issues.apache.org/jira/browse/SPARK-42928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42928. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40557

[jira] [Resolved] (SPARK-42936) Unresolved having at the end of analysis when using with LCA with the having clause that can be resolved directly by its child Aggregate

[ https://issues.apache.org/jira/browse/SPARK-42936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42936. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40558

[jira] [Assigned] (SPARK-42936) Unresolved having at the end of analysis when using with LCA with the having clause that can be resolved directly by its child Aggregate

[ https://issues.apache.org/jira/browse/SPARK-42936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42936: --- Assignee: Xinyi Yu > Unresolved having at the end of analysis when using with LCA with the

[jira] [Resolved] (SPARK-41630) Support lateral column alias in Project code path

[ https://issues.apache.org/jira/browse/SPARK-41630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41630. - Fix Version/s: 3.4.0 Assignee: Xinyi Yu Resolution: Fixed > Support lateral

[jira] [Assigned] (SPARK-42815) Subexpression elimination support shortcut expression

[ https://issues.apache.org/jira/browse/SPARK-42815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42815: --- Assignee: XiDuo You > Subexpression elimination support shortcut expression >

[jira] [Resolved] (SPARK-42815) Subexpression elimination support shortcut expression

[ https://issues.apache.org/jira/browse/SPARK-42815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42815. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40446

[jira] [Assigned] (SPARK-42052) Codegen Support for HiveSimpleUDF

[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42052: --- Assignee: BingKun Pan > Codegen Support for HiveSimpleUDF >

[jira] [Resolved] (SPARK-42052) Codegen Support for HiveSimpleUDF

[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42052. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40397

[jira] [Resolved] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42851. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40473

[jira] [Assigned] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42851: --- Assignee: Kris Mok > EquivalentExpressions methods need to be consistently guarded by >

[jira] [Resolved] (SPARK-42876) DataType's physicalDataType should be private[sql]

[ https://issues.apache.org/jira/browse/SPARK-42876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42876. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40499

[jira] [Assigned] (SPARK-42791) Create golden file test framework for analysis

[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42791: --- Assignee: Daniel > Create golden file test framework for analysis >

<    2   3   4   5   6   7   8   9   10   11   >