[jira] [Commented] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386980#comment-17386980 ] Takeshi Yamamuro commented on SPARK-36218: -- Ah, okay. I got it now. Thanks. > Flaky Test:

[jira] [Commented] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386979#comment-17386979 ] Takeshi Yamamuro commented on SPARK-36218: -- Ah, okay. Is it okay to close this as resolved? >

[jira] [Issue Comment Deleted] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-36218: - Comment: was deleted (was: Ah, okay. Is it okay to close this as resolved?) > Flaky

[jira] [Commented] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386972#comment-17386972 ] Takeshi Yamamuro commented on SPARK-36218: -- Sorry for my late work.., has anyone tried to make 

[jira] [Resolved] (SPARK-34565) Collapse Window nodes with Project between them

[ https://issues.apache.org/jira/browse/SPARK-34565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34565. -- Fix Version/s: 3.2.0 Assignee: Tanel Kiis Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-35203) Improve Repartition statistics estimation

[ https://issues.apache.org/jira/browse/SPARK-35203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35203. -- Fix Version/s: 3.2.0 Assignee: Yuming Wang Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-35669) fix special char in CSV header with filter pushdown

[ https://issues.apache.org/jira/browse/SPARK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35669. -- Fix Version/s: 3.2.0 Assignee: Wenchen Fan Resolution: Fixed Resolved

[jira] [Updated] (SPARK-35669) fix special char in CSV header with filter pushdown

[ https://issues.apache.org/jira/browse/SPARK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35669: - Description: This is a followup of [#31964|https://github.com/apache/spark/pull/31964]

[jira] [Resolved] (SPARK-35760) Fix the max rows check for broadcast exchange

[ https://issues.apache.org/jira/browse/SPARK-35760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35760. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Commented] (SPARK-35688) GeneratePredicate eliminate will fail in some case

[ https://issues.apache.org/jira/browse/SPARK-35688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361494#comment-17361494 ] Takeshi Yamamuro commented on SPARK-35688: -- I run the query above in v3.1.1, but the issue

[jira] [Commented] (SPARK-35722) wait until something does get queued

[ https://issues.apache.org/jira/browse/SPARK-35722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361469#comment-17361469 ] Takeshi Yamamuro commented on SPARK-35722: -- Could you describe more in the description? The

[jira] [Resolved] (SPARK-35709) Remove links to Nomad integration in the Documentation

[ https://issues.apache.org/jira/browse/SPARK-35709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35709. -- Fix Version/s: 3.2.0 Assignee: Paweł Ptaszyński Resolution: Fixed

[jira] [Commented] (SPARK-35673) Spark fails on unrecognized hint in subquery

[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359663#comment-17359663 ] Takeshi Yamamuro commented on SPARK-35673: -- We cannot move `RemoveAllHints` just after the

[jira] [Updated] (SPARK-35653) [SQL] CatalystToExternalMap interpreted path fails for Map with case classes as keys or values

[ https://issues.apache.org/jira/browse/SPARK-35653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35653: - Affects Version/s: 3.2.0 3.0.2 > [SQL] CatalystToExternalMap

[jira] [Resolved] (SPARK-35632) SELECT rand(cast(3 / 7 AS int)) value gives different resultset in Spark 3.1 as compared to Spark 2.4.5

[ https://issues.apache.org/jira/browse/SPARK-35632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35632. -- Resolution: Not A Problem > SELECT rand(cast(3 / 7 AS int)) value gives different

[jira] [Commented] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359062#comment-17359062 ] Takeshi Yamamuro commented on SPARK-35667: -- Could you check this in newer Spark versions, e.g.,

[jira] [Commented] (SPARK-35673) Spark fails on unrecognized hint in subquery

[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359059#comment-17359059 ] Takeshi Yamamuro commented on SPARK-35673: -- Since 2.4.x does not have this issue, it is a kind

[jira] [Updated] (SPARK-35673) Spark fails on unrecognized hint in subquery

[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35673: - Affects Version/s: 3.2.0 > Spark fails on unrecognized hint in subquery >

[jira] [Commented] (SPARK-35579) Fix a bug in janino or work around it in Spark.

[ https://issues.apache.org/jira/browse/SPARK-35579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355497#comment-17355497 ] Takeshi Yamamuro commented on SPARK-35579: -- I'm working on this. See: 

[jira] [Resolved] (SPARK-35577) Allow to log container output for docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35577. -- Fix Version/s: 3.2.0 Resolution: Fixed Resolved by 

[jira] [Updated] (SPARK-23101) Migrate unit test sinks

[ https://issues.apache.org/jira/browse/SPARK-23101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23101: - Labels: (was: bulk-closed) > Migrate unit test sinks > --- > >

[jira] [Updated] (SPARK-23100) Migrate unit test sources

[ https://issues.apache.org/jira/browse/SPARK-23100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23100: - Labels: (was: bulk-closed) > Migrate unit test sources > - >

[jira] [Updated] (SPARK-23100) Migrate unit test sources

[ https://issues.apache.org/jira/browse/SPARK-23100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23100: - Labels: bulk-closed (was: ) > Migrate unit test sources > - >

[jira] [Updated] (SPARK-23101) Migrate unit test sinks

[ https://issues.apache.org/jira/browse/SPARK-23101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23101: - Labels: bulk-closed (was: ) > Migrate unit test sinks > --- > >

[jira] [Updated] (SPARK-35452) Introduce ArrayOps, MapOps and StructOps

[ https://issues.apache.org/jira/browse/SPARK-35452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35452: - Summary: Introduce ArrayOps, MapOps and StructOps (was: ntroduce ArrayOps, MapOps and

[jira] [Commented] (SPARK-35500) GenerateSafeProjection.generate will generate SpecificSafeProjection class, but if column is array type or map type, the code cannot be reused which impact the query p

[ https://issues.apache.org/jira/browse/SPARK-35500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350458#comment-17350458 ] Takeshi Yamamuro commented on SPARK-35500: -- Which version did you use? v3.1.0 does not exist,

[jira] [Commented] (SPARK-34927) Support TPCDSQueryBenchmark in Benchmarks

[ https://issues.apache.org/jira/browse/SPARK-34927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350188#comment-17350188 ] Takeshi Yamamuro commented on SPARK-34927: -- +1 > Support TPCDSQueryBenchmark in Benchmarks >

[jira] [Commented] (SPARK-35483) Add a new GA test job for the integration tests

[ https://issues.apache.org/jira/browse/SPARK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349612#comment-17349612 ] Takeshi Yamamuro commented on SPARK-35483: -- Which PR? If you've already opened a PR, I'll close

[jira] [Updated] (SPARK-35483) Add a new GA test job for the docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35483: - Summary: Add a new GA test job for the docker integration tests (was: Add a new GA

[jira] [Created] (SPARK-35483) Add a new GA test job for the integration tests

Takeshi Yamamuro created SPARK-35483: Summary: Add a new GA test job for the integration tests Key: SPARK-35483 URL: https://issues.apache.org/jira/browse/SPARK-35483 Project: Spark

[jira] [Created] (SPARK-35479) Format PartitionFilters IN strings in scan nodes

Takeshi Yamamuro created SPARK-35479: Summary: Format PartitionFilters IN strings in scan nodes Key: SPARK-35479 URL: https://issues.apache.org/jira/browse/SPARK-35479 Project: Spark

[jira] [Commented] (SPARK-33867) java.time.Instant and java.time.LocalDate not handled in org.apache.spark.sql.jdbc.JdbcDialect#compileValue

[ https://issues.apache.org/jira/browse/SPARK-33867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348323#comment-17348323 ] Takeshi Yamamuro commented on SPARK-33867: -- Please see the "Fix Version/s" in this jira and

[jira] [Resolved] (SPARK-35457) Update ANTLR runtime version to 4.8

[ https://issues.apache.org/jira/browse/SPARK-35457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35457. -- Fix Version/s: 3.2.0 Assignee: Bo Zhang Resolution: Fixed Resolved by 

[jira] [Commented] (SPARK-35446) Override getJDBCType in MySQLDialect to map FloatType to FLOAT

[ https://issues.apache.org/jira/browse/SPARK-35446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347993#comment-17347993 ] Takeshi Yamamuro commented on SPARK-35446: -- Oh, I was a bit surprised that mysql treats real as

[jira] [Resolved] (SPARK-35438) Minor documentation fix for window physical operator

[ https://issues.apache.org/jira/browse/SPARK-35438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35438. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Resolved] (SPARK-35362) Update null count in the column stats for UNION stats estimation

[ https://issues.apache.org/jira/browse/SPARK-35362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35362. -- Fix Version/s: 3.2.0 Assignee: shahid Resolution: Fixed Resolved by 

[jira] [Resolved] (SPARK-35368) [SQL]Update histogram statistics for RANGE operator stats estimation

[ https://issues.apache.org/jira/browse/SPARK-35368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35368. -- Fix Version/s: 3.2.0 Assignee: shahid Resolution: Fixed Resolved by 

[jira] [Resolved] (SPARK-35398) Simplify the way to get classes from ClassBodyEvaluator in CodeGenerator.updateAndGetCompilationStats method

[ https://issues.apache.org/jira/browse/SPARK-35398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35398. -- Fix Version/s: 3.2.0 Assignee: Yang Jie Resolution: Fixed Resolved by 

[jira] [Resolved] (SPARK-35351) Add code-gen for left anti sort merge join

[ https://issues.apache.org/jira/browse/SPARK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35351. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Updated] (SPARK-35431) Sort elements generated by collect_set in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-35431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35431: - Parent: SPARK-25075 Issue Type: Sub-task (was: Test) > Sort elements generated

[jira] [Created] (SPARK-35431) Sort elements generated by collect_set in SQLQueryTestSuite

Takeshi Yamamuro created SPARK-35431: Summary: Sort elements generated by collect_set in SQLQueryTestSuite Key: SPARK-35431 URL: https://issues.apache.org/jira/browse/SPARK-35431 Project: Spark

[jira] [Commented] (SPARK-35422) Many test cases failed in Scala 2.13 CI

[ https://issues.apache.org/jira/browse/SPARK-35422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346513#comment-17346513 ] Takeshi Yamamuro commented on SPARK-35422: -- Thank you for pinging me, Dongjoon~ I'm checking

[jira] [Resolved] (SPARK-35413) Use the SHA of the latest commit when checking out databricks/tpcds-kit

[ https://issues.apache.org/jira/browse/SPARK-35413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35413. -- Fix Version/s: 3.2.0 3.1.2 3.0.3

[jira] [Created] (SPARK-35413) Use the SHA of the latest commit when checking out databricks/tpcds-kit

Takeshi Yamamuro created SPARK-35413: Summary: Use the SHA of the latest commit when checking out databricks/tpcds-kit Key: SPARK-35413 URL: https://issues.apache.org/jira/browse/SPARK-35413

[jira] [Created] (SPARK-35412) Fix a bug in groupBy of year-month/day-time intervals

Takeshi Yamamuro created SPARK-35412: Summary: Fix a bug in groupBy of year-month/day-time intervals Key: SPARK-35412 URL: https://issues.apache.org/jira/browse/SPARK-35412 Project: Spark

[jira] [Resolved] (SPARK-35385) skip duplicate queries in the TPCDS-related tests

[ https://issues.apache.org/jira/browse/SPARK-35385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35385. -- Fix Version/s: 3.2.0 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Updated] (SPARK-35385) skip duplicate queries in the TPCDS-related tests

[ https://issues.apache.org/jira/browse/SPARK-35385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35385: - Summary: skip duplicate queries in the TPCDS-related tests (was: kip duplicate queries

[jira] [Created] (SPARK-35385) kip duplicate queries in the TPCDS-related tests

Takeshi Yamamuro created SPARK-35385: Summary: kip duplicate queries in the TPCDS-related tests Key: SPARK-35385 URL: https://issues.apache.org/jira/browse/SPARK-35385 Project: Spark

[jira] [Updated] (SPARK-35346) More clause needed for combining groupby and cube

[ https://issues.apache.org/jira/browse/SPARK-35346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35346: - Component/s: SQL > More clause needed for combining groupby and cube >

[jira] [Commented] (SPARK-35346) More clause needed for combining groupby and cube

[ https://issues.apache.org/jira/browse/SPARK-35346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343208#comment-17343208 ] Takeshi Yamamuro commented on SPARK-35346: -- Do you mean this feature?

[jira] [Resolved] (SPARK-35363) Refactor sort merge join code-gen be agnostic to join type

[ https://issues.apache.org/jira/browse/SPARK-35363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35363. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35079. -- Fix Version/s: 3.2.0 3.1.2 Resolution: Fixed > Transform

[jira] [Commented] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342230#comment-17342230 ] Takeshi Yamamuro commented on SPARK-35079: -- I've checked it and the issue has already resolved

[jira] [Commented] (SPARK-35079) Transform with udf gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342182#comment-17342182 ] Takeshi Yamamuro commented on SPARK-35079: -- Could you check if branch-3.1 has the issue? >

[jira] [Assigned] (SPARK-35261) Support static invoke for stateless UDF

[ https://issues.apache.org/jira/browse/SPARK-35261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reassigned SPARK-35261: Assignee: Chao Sun > Support static invoke for stateless UDF >

[jira] [Assigned] (SPARK-35261) Support static invoke for stateless UDF

[ https://issues.apache.org/jira/browse/SPARK-35261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reassigned SPARK-35261: Assignee: (was: Apache Spark) > Support static invoke for stateless UDF >

[jira] [Resolved] (SPARK-35354) Minor cleanup to replace BaseJoinExec with ShuffledJoin in CoalesceBucketsInJoin

[ https://issues.apache.org/jira/browse/SPARK-35354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35354. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Resolved] (SPARK-35231) logical.Range override maxRowsPerPartition

[ https://issues.apache.org/jira/browse/SPARK-35231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35231. -- Fix Version/s: 3.2.0 Assignee: zhengruifeng Resolution: Fixed

[jira] [Resolved] (SPARK-35327) Filters out the TPC-DS queries that can cause flaky test results

[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35327. -- Fix Version/s: 3.2.0 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17341313#comment-17341313 ] Takeshi Yamamuro commented on SPARK-35332: -- okay, sgtm. cc: [~cloud_fan] could you make a PR

[jira] [Comment Edited] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17341233#comment-17341233 ] Takeshi Yamamuro edited comment on SPARK-35332 at 5/8/21, 8:05 AM: ---

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17341233#comment-17341233 ] Takeshi Yamamuro commented on SPARK-35332: -- Yea, right. As [~ulysses] said, that's because the

[jira] [Resolved] (SPARK-35297) Modify the comment about the executor

[ https://issues.apache.org/jira/browse/SPARK-35297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35297. -- Fix Version/s: 3.2.0 Assignee: roryqi Resolution: Fixed Resolved by 

[jira] [Updated] (SPARK-35327) Filters out the TPC-DS queries that can cause flaky test results

[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35327: - Summary: Filters out the TPC-DS queries that can cause flaky test results (was: Merge

[jira] [Updated] (SPARK-35327) Filters out the TPC-DS queries that can cause flaky test results

[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35327: - Description: This ticket aims at filtering out TPCDS v1.4 q6 and q75 in

[jira] [Updated] (SPARK-35253) Upgrade Janino from 3.0.16 to 3.1.4

[ https://issues.apache.org/jira/browse/SPARK-35253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35253: - Summary: Upgrade Janino from 3.0.16 to 3.1.4 (was: Upgrade Janino from 3.0.x to 3.1.x)

[jira] [Created] (SPARK-35329) Split generated switch code into pieces in ExpandExec

Takeshi Yamamuro created SPARK-35329: Summary: Split generated switch code into pieces in ExpandExec Key: SPARK-35329 URL: https://issues.apache.org/jira/browse/SPARK-35329 Project: Spark

[jira] [Created] (SPARK-35327) Merge similar v1.4/v2.7 TPCDS queries

Takeshi Yamamuro created SPARK-35327: Summary: Merge similar v1.4/v2.7 TPCDS queries Key: SPARK-35327 URL: https://issues.apache.org/jira/browse/SPARK-35327 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31325) Control a plan explain mode in the events of SQL listeners via SQLConf

[ https://issues.apache.org/jira/browse/SPARK-31325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31325: - Fix Version/s: 3.1.0 > Control a plan explain mode in the events of SQL listeners via

[jira] [Resolved] (SPARK-35293) Use the newer dsdgen for TPCDSQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35293. -- Fix Version/s: 3.2.0 Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-34794) Nested higher-order functions broken in DSL

[ https://issues.apache.org/jira/browse/SPARK-34794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34794. -- Fix Version/s: 3.2.0 3.1.2 3.0.3

[jira] [Created] (SPARK-35293) Use the newer dsdgen for TPCDSQueryTestSuite

Takeshi Yamamuro created SPARK-35293: Summary: Use the newer dsdgen for TPCDSQueryTestSuite Key: SPARK-35293 URL: https://issues.apache.org/jira/browse/SPARK-35293 Project: Spark Issue

[jira] [Resolved] (SPARK-35192) Port minimal TPC-DS datagen code from databricks/spark-sql-perf

[ https://issues.apache.org/jira/browse/SPARK-35192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35192. -- Fix Version/s: 3.2.0 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Updated] (SPARK-35159) extract doc of hive format

[ https://issues.apache.org/jira/browse/SPARK-35159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35159: - Fix Version/s: 3.1.2 3.0.3 > extract doc of hive format >

[jira] [Resolved] (SPARK-35214) OptimizeSkewedJoin support ShuffledHashJoinExec

[ https://issues.apache.org/jira/browse/SPARK-35214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35214. -- Fix Version/s: 3.2.0 Assignee: ulysses you Resolution: Fixed Resolved

[jira] [Updated] (SPARK-33976) Add a dedicated SQL document page for the TRANSFORM-related functionality,

[ https://issues.apache.org/jira/browse/SPARK-33976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33976: - Fix Version/s: 3.1.2 3.0.3 > Add a dedicated SQL document page for

[jira] [Resolved] (SPARK-35201) Format empty grouping set exception in CUBE/ROLLUP

[ https://issues.apache.org/jira/browse/SPARK-35201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35201. -- Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed Resolved

[jira] [Created] (SPARK-35192) Port minimal TPC-DS datagen code from databricks/spark-sql-perf

Takeshi Yamamuro created SPARK-35192: Summary: Port minimal TPC-DS datagen code from databricks/spark-sql-perf Key: SPARK-35192 URL: https://issues.apache.org/jira/browse/SPARK-35192 Project:

[jira] [Updated] (SPARK-34639) always remove unnecessary Alias in Analyzer.resolveExpression

[ https://issues.apache.org/jira/browse/SPARK-34639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34639: - Fix Version/s: 3.1.2 > always remove unnecessary Alias in Analyzer.resolveExpression >

[jira] [Resolved] (SPARK-35109) Fix minor exception messages of HashedRelation and HashJoin

[ https://issues.apache.org/jira/browse/SPARK-35109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35109. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-35067) Test case for function COALESCE() does not cover the CodeGen support

[ https://issues.apache.org/jira/browse/SPARK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35067: - Issue Type: Test (was: Bug) > Test case for function COALESCE() does not cover the

[jira] [Resolved] (SPARK-35115) Test ANSI intervals in MutableProjectionSuite

[ https://issues.apache.org/jira/browse/SPARK-35115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35115. -- Fix Version/s: 3.2.0 Assignee: Max Gekk Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-33411) Cardinality estimation of union, range and sort logical operators

[ https://issues.apache.org/jira/browse/SPARK-33411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33411. -- Fix Version/s: 3.2.0 Assignee: Ayushi Agarwal Resolution: Fixed

[jira] [Resolved] (SPARK-28227) Spark can’t support TRANSFORM with aggregation

[ https://issues.apache.org/jira/browse/SPARK-28227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-28227. -- Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed Resolved

[jira] [Updated] (SPARK-34922) Use better CBO cost function

[ https://issues.apache.org/jira/browse/SPARK-34922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34922: - Fix Version/s: 3.0.3 3.1.2 > Use better CBO cost function >

[jira] [Resolved] (SPARK-34922) Use better CBO cost function

[ https://issues.apache.org/jira/browse/SPARK-34922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34922. -- Fix Version/s: 3.2.0 Assignee: Tanel Kiis Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-34935) CREATE TABLE LIKE should respect the reserved properties of tables

[ https://issues.apache.org/jira/browse/SPARK-34935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34935. -- Fix Version/s: 3.2.0 Assignee: Kent Yao Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-34932) ignore the groupBy expressions in GROUP BY ... GROUPING SETS

[ https://issues.apache.org/jira/browse/SPARK-34932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34932. -- Fix Version/s: 3.2.0 Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-34946) Fix correlated scalar subquery behavior in Aggregate

[ https://issues.apache.org/jira/browse/SPARK-34946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34946. -- Resolution: Invalid > Fix correlated scalar subquery behavior in Aggregate >

[jira] [Commented] (SPARK-34946) Fix correlated scalar subquery behavior in Aggregate

[ https://issues.apache.org/jira/browse/SPARK-34946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314119#comment-17314119 ] Takeshi Yamamuro commented on SPARK-34946: -- Please fill the description first. > Fix

[jira] [Resolved] (SPARK-34882) RewriteDistinctAggregates can cause a bug if the aggregator does not ignore NULLs

[ https://issues.apache.org/jira/browse/SPARK-34882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34882. -- Fix Version/s: 3.2.0 Assignee: Tanel Kiis Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-34795) Adds a new job in GitHub Actions to check the output of TPC-DS queries

[ https://issues.apache.org/jira/browse/SPARK-34795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34795. -- Fix Version/s: 3.2.0 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Updated] (SPARK-34882) RewriteDistinctAggregates can cause a bug if the aggregator does not ignore NULLs

[ https://issues.apache.org/jira/browse/SPARK-34882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34882: - Affects Version/s: 3.0.3 3.1.2 2.4.8 >

[jira] [Updated] (SPARK-34882) RewriteDistinctAggregates can cause a bug if the aggregator does not ignore NULLs

[ https://issues.apache.org/jira/browse/SPARK-34882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34882: - Labels: correctness (was: ) > RewriteDistinctAggregates can cause a bug if the

[jira] [Resolved] (SPARK-34622) Push down limit through Project

[ https://issues.apache.org/jira/browse/SPARK-34622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34622. -- Fix Version/s: 3.2.0 Assignee: Yuming Wang Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-33791) grouping__id() result does not consistent with hive's version < 2.3

[ https://issues.apache.org/jira/browse/SPARK-33791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33791. -- Resolution: Won't Fix I close this because the corresponding PR is inactive. >

[jira] [Updated] (SPARK-34819) MapType supports orderable semantics

[ https://issues.apache.org/jira/browse/SPARK-34819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34819: - Affects Version/s: 3.1.2 3.2.0 > MapType supports orderable

[jira] [Updated] (SPARK-34819) MapType supports orderable semantics

[ https://issues.apache.org/jira/browse/SPARK-34819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34819: - Priority: Major (was: Minor) > MapType supports orderable semantics >

[jira] [Resolved] (SPARK-34846) Sort output rows in SQLQueryTestSuite even if a plan has a Sort node

[ https://issues.apache.org/jira/browse/SPARK-34846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34846. -- Resolution: Won't Fix > Sort output rows in SQLQueryTestSuite even if a plan has a

[jira] [Updated] (SPARK-34843) JDBCRelation columnPartition function improperly determines stride size. Upper bound is skewed do to stride alignment.

[ https://issues.apache.org/jira/browse/SPARK-34843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34843: - Affects Version/s: 3.0.3 3.2.0 3.12 >

  1   2   3   4   5   6   7   8   9   10   >