[jira] [Created] (SPARK-31477) Dump codegen and compile time in BenchmarkQueryTest

Xiao Li created SPARK-31477: --- Summary: Dump codegen and compile time in BenchmarkQueryTest Key: SPARK-31477 URL: https://issues.apache.org/jira/browse/SPARK-31477 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-15616) CatalogRelation should fallback to HDFS size of partitions that are involved in Query if statistics are not available.

[ https://issues.apache.org/jira/browse/SPARK-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-15616: --- Assignee: Hu Fuwang > CatalogRelation should fallback to HDFS size of partitions that are involved

[jira] [Assigned] (SPARK-31399) Closure cleaner broken in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-31399: --- Assignee: Kris Mok > Closure cleaner broken in Scala 2.12 > >

[jira] [Commented] (SPARK-31399) Closure cleaner broken in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084356#comment-17084356 ] Xiao Li commented on SPARK-31399: - [~rednaxelafx] will help this ticket and do more investigation.  >

[jira] [Assigned] (SPARK-25440) Dump query execution info to a file

[ https://issues.apache.org/jira/browse/SPARK-25440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25440: --- Assignee: Maxim Gekk > Dump query execution info to a file > --- >

[jira] [Assigned] (SPARK-18299) Allow more aggregations on KeyValueGroupedDataset

[ https://issues.apache.org/jira/browse/SPARK-18299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-18299: --- Assignee: nooberfsh > Allow more aggregations on KeyValueGroupedDataset >

[jira] [Updated] (SPARK-31384) NPE in OptimizeSkewedJoin when there's a inputRDD of plan has 0 partition

[ https://issues.apache.org/jira/browse/SPARK-31384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31384: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > NPE in OptimizeSkewedJoin when there's a

[jira] [Updated] (SPARK-31206) AQE will use the same SubqueryExec even if subqueryReuseEnabled=false

[ https://issues.apache.org/jira/browse/SPARK-31206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31206: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > AQE will use the same SubqueryExec even if

[jira] [Updated] (SPARK-31096) Replace `Array` with `Seq` in AQE `CustomShuffleReaderExec`

[ https://issues.apache.org/jira/browse/SPARK-31096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31096: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > Replace `Array` with `Seq` in AQE

[jira] [Updated] (SPARK-31046) Make more efficient and clean up AQE update UI code

[ https://issues.apache.org/jira/browse/SPARK-31046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31046: Parent: SPARK-31412 Issue Type: Sub-task (was: Improvement) > Make more efficient and clean up

[jira] [Updated] (SPARK-31045) Add config for AQE logging level

[ https://issues.apache.org/jira/browse/SPARK-31045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31045: Parent: SPARK-31412 Issue Type: Sub-task (was: Improvement) > Add config for AQE logging level >

[jira] [Updated] (SPARK-30999) Don't cancel a QueryStageExec when it's already finished

[ https://issues.apache.org/jira/browse/SPARK-30999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30999: Parent: SPARK-31412 Issue Type: Sub-task (was: Improvement) > Don't cancel a QueryStageExec when

[jira] [Updated] (SPARK-30922) Remove the max split config after changing the multi sub joins to multi sub partitions

[ https://issues.apache.org/jira/browse/SPARK-30922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30922: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > Remove the max split config after changing

[jira] [Updated] (SPARK-30991) Refactor AQE readers and RDDs

[ https://issues.apache.org/jira/browse/SPARK-30991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30991: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > Refactor AQE readers and RDDs >

[jira] [Updated] (SPARK-30906) Turning off AQE in CacheManager is not thread-safe

[ https://issues.apache.org/jira/browse/SPARK-30906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30906: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > Turning off AQE in CacheManager is not

[jira] [Updated] (SPARK-30801) Subqueries should not be AQE-ed if main query is not

[ https://issues.apache.org/jira/browse/SPARK-30801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30801: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > Subqueries should not be AQE-ed if main

[jira] [Updated] (SPARK-30751) Combine the skewed readers into one in AQE skew join optimizations

[ https://issues.apache.org/jira/browse/SPARK-30751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30751: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > Combine the skewed readers into one in AQE

[jira] [Updated] (SPARK-30719) AQE should not issue a "not supported" warning for queries being by-passed

[ https://issues.apache.org/jira/browse/SPARK-30719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30719: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > AQE should not issue a "not supported"

[jira] [Updated] (SPARK-30571) coalesce shuffle reader with splitting shuffle fetch request fails

[ https://issues.apache.org/jira/browse/SPARK-30571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30571: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > coalesce shuffle reader with splitting

[jira] [Updated] (SPARK-30549) Fix the subquery metrics showing issue in UI When enable AQE

[ https://issues.apache.org/jira/browse/SPARK-30549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30549: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > Fix the subquery metrics showing issue in

[jira] [Updated] (SPARK-30407) reset the metrics info of AdaptiveSparkPlanExec plan when enable aqe

[ https://issues.apache.org/jira/browse/SPARK-30407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30407: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > reset the metrics info of

[jira] [Updated] (SPARK-30403) Fix the NoSuchElementException exception when enable AQE with InSubquery use case

[ https://issues.apache.org/jira/browse/SPARK-30403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30403: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > Fix the NoSuchElementException exception

[jira] [Updated] (SPARK-30188) Fix tests when enable Adaptive Query Execution

[ https://issues.apache.org/jira/browse/SPARK-30188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30188: Parent: SPARK-31412 Issue Type: Sub-task (was: Test) > Fix tests when enable Adaptive Query

[jira] [Updated] (SPARK-30307) remove ReusedQueryStageExec

[ https://issues.apache.org/jira/browse/SPARK-30307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30307: Parent: SPARK-31412 Issue Type: Sub-task (was: Improvement) > remove ReusedQueryStageExec >

[jira] [Updated] (SPARK-30315) Add adaptive execution context

[ https://issues.apache.org/jira/browse/SPARK-30315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30315: Parent: SPARK-31412 Issue Type: Sub-task (was: Task) > Add adaptive execution context >

[jira] [Resolved] (SPARK-30315) Add adaptive execution context

[ https://issues.apache.org/jira/browse/SPARK-30315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30315. - Fix Version/s: 3.0.0 Assignee: Wei Xue Resolution: Fixed > Add adaptive execution

[jira] [Updated] (SPARK-30291) Catch the exception when do materialize in AQE

[ https://issues.apache.org/jira/browse/SPARK-30291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30291: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > Catch the exception when do materialize in

[jira] [Updated] (SPARK-29906) Reading of csv file fails with adaptive execution turned on

[ https://issues.apache.org/jira/browse/SPARK-29906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29906: Parent: SPARK-31412 Issue Type: Sub-task (was: Bug) > Reading of csv file fails with adaptive

[jira] [Updated] (SPARK-29893) Improve the local reader performance by changing the task number from 1 to multi

[ https://issues.apache.org/jira/browse/SPARK-29893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29893: Parent: SPARK-31412 Issue Type: Sub-task (was: Improvement) > Improve the local reader

[jira] [Updated] (SPARK-29759) LocalShuffleReaderExec.outputPartitioning should use the corrected attributes

[ https://issues.apache.org/jira/browse/SPARK-29759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29759: Parent: SPARK-31412 Issue Type: Sub-task (was: Improvement) >

[jira] [Updated] (SPARK-9853) Optimize shuffle fetch of contiguous partition IDs

[ https://issues.apache.org/jira/browse/SPARK-9853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-9853: --- Parent Issue: SPARK-31412 (was: SPARK-9850) > Optimize shuffle fetch of contiguous partition IDs >

[jira] [Updated] (SPARK-29060) Add tree traversal helper for adaptive spark plans

[ https://issues.apache.org/jira/browse/SPARK-29060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29060: Parent: SPARK-31412 Issue Type: Sub-task (was: Improvement) > Add tree traversal helper for

[jira] [Updated] (SPARK-29002) Avoid changing SMJ to BHJ if the build side has a high ratio of empty partitions

[ https://issues.apache.org/jira/browse/SPARK-29002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29002: Parent: SPARK-31412 Issue Type: Sub-task (was: Improvement) > Avoid changing SMJ to BHJ if the

[jira] [Resolved] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30808. - Resolution: Cannot Reproduce > Thrift server returns wrong timestamps/dates strings before 1582 >

[jira] [Commented] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080183#comment-17080183 ] Xiao Li commented on SPARK-30808: - The problem does not exist.  > Thrift server returns wrong

[jira] [Reopened] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-30808: - > Thrift server returns wrong timestamps/dates strings before 1582 >

[jira] [Commented] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080102#comment-17080102 ] Xiao Li commented on SPARK-30808: - Is it reverted? > Thrift server returns wrong timestamps/dates

[jira] [Commented] (SPARK-31399) closure cleaner is broken in Spark 3.0

[ https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079514#comment-17079514 ] Xiao Li commented on SPARK-31399: - cc [~zsxwing] > closure cleaner is broken in Spark 3.0 >

[jira] [Created] (SPARK-31351) Migration Guide Auditing for Spark 3.0 Release

Xiao Li created SPARK-31351: --- Summary: Migration Guide Auditing for Spark 3.0 Release Key: SPARK-31351 URL: https://issues.apache.org/jira/browse/SPARK-31351 Project: Spark Issue Type:

[jira] [Created] (SPARK-31333) Document Join Hints

Xiao Li created SPARK-31333: --- Summary: Document Join Hints Key: SPARK-31333 URL: https://issues.apache.org/jira/browse/SPARK-31333 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Resolved] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-17592. - Resolution: Won't Fix > SQL: CAST string as INT inconsistent with Hive >

[jira] [Resolved] (SPARK-31253) add metrics to shuffle reader

[ https://issues.apache.org/jira/browse/SPARK-31253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31253. - Fix Version/s: 3.1.0 Resolution: Fixed > add metrics to shuffle reader >

[jira] [Resolved] (SPARK-31087) Add Back Multiple Removed APIs

[ https://issues.apache.org/jira/browse/SPARK-31087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31087. - Fix Version/s: 3.0.0 Resolution: Fixed > Add Back Multiple Removed APIs >

[jira] [Resolved] (SPARK-31088) Add back HiveContext and createExternalTable

[ https://issues.apache.org/jira/browse/SPARK-31088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31088. - Fix Version/s: 3.0.0 Resolution: Fixed > Add back HiveContext and createExternalTable >

[jira] [Resolved] (SPARK-31086) Add Back the Deprecated SQLContext methods

[ https://issues.apache.org/jira/browse/SPARK-31086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31086. - Fix Version/s: 3.0.0 Resolution: Fixed > Add Back the Deprecated SQLContext methods >

[jira] [Updated] (SPARK-31246) GracefulShutdown does not work when application is terminated from RestSubmissionClient or YarnClient

[ https://issues.apache.org/jira/browse/SPARK-31246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31246: Priority: Major (was: Blocker) > GracefulShutdown does not work when application is terminated from >

[jira] [Updated] (SPARK-31236) Spark error while consuming data from Kinesis direct end point

[ https://issues.apache.org/jira/browse/SPARK-31236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31236: Priority: Critical (was: Blocker) > Spark error while consuming data from Kinesis direct end point >

[jira] [Commented] (SPARK-31139) Fileformat datasources (ORC, Json) case sensitivity regressions

[ https://issues.apache.org/jira/browse/SPARK-31139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063127#comment-17063127 ] Xiao Li commented on SPARK-31139: - ping [~viirya] [~dongjoon] > Fileformat datasources (ORC, Json) case

[jira] [Resolved] (SPARK-31134) optimize skew join after shuffle partitions are coalesced

[ https://issues.apache.org/jira/browse/SPARK-31134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31134. - Fix Version/s: 3.0.0 Resolution: Fixed > optimize skew join after shuffle partitions are

[jira] [Assigned] (SPARK-31151) Reorganize the migration guide of SQL

[ https://issues.apache.org/jira/browse/SPARK-31151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-31151: --- Assignee: Xiao Li > Reorganize the migration guide of SQL >

[jira] [Assigned] (SPARK-28588) Build a SQL reference doc

[ https://issues.apache.org/jira/browse/SPARK-28588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28588: --- Assignee: (was: Xiao Li) > Build a SQL reference doc > - > >

[jira] [Assigned] (SPARK-28588) Build a SQL reference doc

[ https://issues.apache.org/jira/browse/SPARK-28588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28588: --- Assignee: Xiao Li > Build a SQL reference doc > - > > Key:

[jira] [Created] (SPARK-31151) Reorganize the migration guide of SQL

Xiao Li created SPARK-31151: --- Summary: Reorganize the migration guide of SQL Key: SPARK-31151 URL: https://issues.apache.org/jira/browse/SPARK-31151 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-31136) Revert SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

[ https://issues.apache.org/jira/browse/SPARK-31136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058275#comment-17058275 ] Xiao Li commented on SPARK-31136: - Yes. The impact of this change is big. As [~dongjoon] did, we already

[jira] [Resolved] (SPARK-31070) make skew join split skewed partitions more evenly

[ https://issues.apache.org/jira/browse/SPARK-31070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31070. - Fix Version/s: 3.0.0 Resolution: Fixed > make skew join split skewed partitions more evenly >

[jira] [Updated] (SPARK-31113) Support DDL "SHOW VIEWS"

[ https://issues.apache.org/jira/browse/SPARK-31113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31113: Issue Type: New Feature (was: Bug) > Support DDL "SHOW VIEWS" > > >

[jira] [Comment Edited] (SPARK-31113) Support DDL "SHOW VIEWS"

[ https://issues.apache.org/jira/browse/SPARK-31113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056628#comment-17056628 ] Xiao Li edited comment on SPARK-31113 at 3/11/20, 4:04 AM: --- cc [~EricWu] Could

[jira] [Commented] (SPARK-31113) Support DDL "SHOW VIEWS"

[ https://issues.apache.org/jira/browse/SPARK-31113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056628#comment-17056628 ] Xiao Li commented on SPARK-31113: - cc [~EricWu]  > Support DDL "SHOW VIEWS" >

[jira] [Created] (SPARK-31113) Support DDL "SHOW VIEWS"

Xiao Li created SPARK-31113: --- Summary: Support DDL "SHOW VIEWS" Key: SPARK-31113 URL: https://issues.apache.org/jira/browse/SPARK-31113 Project: Spark Issue Type: Bug Components: SQL

[jira] [Resolved] (SPARK-30896) The behavior of JsonToStructs should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30896. - Resolution: Won't Fix > The behavior of JsonToStructs should not depend on SQLConf.get >

[jira] [Resolved] (SPARK-30895) The behavior of CsvToStructs should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30895. - Resolution: Won't Fix > The behavior of CsvToStructs should not depend on SQLConf.get >

[jira] [Resolved] (SPARK-30893) Expressions should not change its data type/behavior after it's created

[ https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30893. - Fix Version/s: 3.0.0 Resolution: Fixed > Expressions should not change its data type/behavior

[jira] [Updated] (SPARK-30510) Publicly document options under spark.sql.*

[ https://issues.apache.org/jira/browse/SPARK-30510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30510: Labels: release-notes (was: ) > Publicly document options under spark.sql.* >

[jira] [Updated] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30951: Priority: Blocker (was: Major) > Potential data loss for legacy applications after switch to proleptic

[jira] [Updated] (SPARK-31010) forbid untyped scala UDF API by default

[ https://issues.apache.org/jira/browse/SPARK-31010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31010: Labels: release-notes (was: ) > forbid untyped scala UDF API by default >

[jira] [Resolved] (SPARK-31022) group by alias should fail if there are name conflicts

[ https://issues.apache.org/jira/browse/SPARK-31022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31022. - Resolution: Won't Fix > group by alias should fail if there are name conflicts >

[jira] [Assigned] (SPARK-30999) Don't cancel a QueryStageExec when it's already finished

[ https://issues.apache.org/jira/browse/SPARK-30999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30999: --- Assignee: wuyi > Don't cancel a QueryStageExec when it's already finished >

[jira] [Resolved] (SPARK-30999) Don't cancel a QueryStageExec when it's already finished

[ https://issues.apache.org/jira/browse/SPARK-30999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30999. - Fix Version/s: 3.0.0 Resolution: Fixed > Don't cancel a QueryStageExec when it's already

[jira] [Resolved] (SPARK-30991) Refactor AQE readers and RDDs

[ https://issues.apache.org/jira/browse/SPARK-30991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30991. - Fix Version/s: 3.0.0 Resolution: Fixed > Refactor AQE readers and RDDs >

[jira] [Assigned] (SPARK-30991) Refactor AQE readers and RDDs

[ https://issues.apache.org/jira/browse/SPARK-30991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30991: --- Assignee: Wei Xue > Refactor AQE readers and RDDs > - > >

[jira] [Commented] (SPARK-30982) List All the removed APIs of Spark SQL and Core

[ https://issues.apache.org/jira/browse/SPARK-30982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049385#comment-17049385 ] Xiao Li commented on SPARK-30982: - {code:java} org.apache.spark.sql.sources.And

[jira] [Resolved] (SPARK-30982) List All the removed APIs of Spark SQL and Core

[ https://issues.apache.org/jira/browse/SPARK-30982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30982. - Resolution: Fixed > List All the removed APIs of Spark SQL and Core >

[jira] [Assigned] (SPARK-30982) List All the removed APIs of Spark SQL and Core

[ https://issues.apache.org/jira/browse/SPARK-30982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30982: --- Assignee: zhengruifeng (was: Xiao Li) > List All the removed APIs of Spark SQL and Core >

[jira] [Created] (SPARK-30982) List All the removed APIs of Spark SQL and Core

Xiao Li created SPARK-30982: --- Summary: List All the removed APIs of Spark SQL and Core Key: SPARK-30982 URL: https://issues.apache.org/jira/browse/SPARK-30982 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-14643. - Resolution: Won't Fix > Remove overloaded methods which become ambiguous in Scala 2.12 >

[jira] [Comment Edited] (SPARK-27630) Stage retry causes totalRunningTasks calculation to be negative

[ https://issues.apache.org/jira/browse/SPARK-27630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046245#comment-17046245 ] Xiao Li edited comment on SPARK-27630 at 2/27/20 7:11 AM: -- This change breaks

[jira] [Commented] (SPARK-27630) Stage retry causes totalRunningTasks calculation to be negative

[ https://issues.apache.org/jira/browse/SPARK-27630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046245#comment-17046245 ] Xiao Li commented on SPARK-27630: - This change breaks the API {code:java}

[jira] [Updated] (SPARK-27630) Stage retry causes totalRunningTasks calculation to be negative

[ https://issues.apache.org/jira/browse/SPARK-27630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27630: Labels: release-notes (was: ) > Stage retry causes totalRunningTasks calculation to be negative >

[jira] [Updated] (SPARK-26311) [YARN] New feature: custom log URL for stdout/stderr

[ https://issues.apache.org/jira/browse/SPARK-26311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-26311: Labels: release-notes (was: ) > [YARN] New feature: custom log URL for stdout/stderr >

[jira] [Commented] (SPARK-26329) ExecutorMetrics should poll faster than heartbeats

[ https://issues.apache.org/jira/browse/SPARK-26329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045938#comment-17045938 ] Xiao Li commented on SPARK-26329: - This breaks the developer API   {code:java}

[jira] [Updated] (SPARK-26329) ExecutorMetrics should poll faster than heartbeats

[ https://issues.apache.org/jira/browse/SPARK-26329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-26329: Labels: release-notes (was: ) > ExecutorMetrics should poll faster than heartbeats >

[jira] [Commented] (SPARK-30962) Document ALTER TABLE statement in SQL Reference [Phase 2]

[ https://issues.apache.org/jira/browse/SPARK-30962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045771#comment-17045771 ] Xiao Li commented on SPARK-30962: - Also, please give some examples to show how we can alter the table's

[jira] [Updated] (SPARK-30962) Document ALTER TABLE statement in SQL Reference [Phase 2]

[ https://issues.apache.org/jira/browse/SPARK-30962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30962: Target Version/s: 3.0.0 > Document ALTER TABLE statement in SQL Reference [Phase 2] >

[jira] [Commented] (SPARK-30962) Document ALTER TABLE statement in SQL Reference [Phase 2]

[ https://issues.apache.org/jira/browse/SPARK-30962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045770#comment-17045770 ] Xiao Li commented on SPARK-30962: - cc [~huaxing] [~dkbiswal] > Document ALTER TABLE statement in SQL

[jira] [Updated] (SPARK-30962) Document ALTER TABLE statement in SQL Reference [Phase 2]

[ https://issues.apache.org/jira/browse/SPARK-30962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30962: Description: https://issues.apache.org/jira/browse/SPARK-28791 only covers a subset of ALTER TABLE

[jira] [Updated] (SPARK-30962) Document ALTER TABLE statement in SQL Reference [Phase 2]

[ https://issues.apache.org/jira/browse/SPARK-30962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30962: Description: https://issues.apache.org/jira/browse/SPARK-28791 only covers a subset of ALTER TABLE

[jira] [Created] (SPARK-30962) Document ALTER TABLE statement in SQL Reference [Phase 2]

Xiao Li created SPARK-30962: --- Summary: Document ALTER TABLE statement in SQL Reference [Phase 2] Key: SPARK-30962 URL: https://issues.apache.org/jira/browse/SPARK-30962 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28791) Document ALTER TABLE statement in SQL Reference [Phase 1]

[ https://issues.apache.org/jira/browse/SPARK-28791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28791: Summary: Document ALTER TABLE statement in SQL Reference [Phase 1] (was: Document ALTER TABLE statement

[jira] [Updated] (SPARK-30904) Thrift RowBasedSet serialization throws NullPointerException on NULL BigDecimal

[ https://issues.apache.org/jira/browse/SPARK-30904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30904: Fix Version/s: (was: 3.1.0) > Thrift RowBasedSet serialization throws NullPointerException on NULL >

[jira] [Updated] (SPARK-30893) Expressions should not change its data type/behavior after it's created

[ https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30893: Target Version/s: 3.0.0 > Expressions should not change its data type/behavior after it's created >

[jira] [Created] (SPARK-30950) Setting version to 3.1.0-SNAPSHOT

Xiao Li created SPARK-30950: --- Summary: Setting version to 3.1.0-SNAPSHOT Key: SPARK-30950 URL: https://issues.apache.org/jira/browse/SPARK-30950 Project: Spark Issue Type: Story

[jira] [Resolved] (SPARK-30918) improve the splitting of skewed partitions

[ https://issues.apache.org/jira/browse/SPARK-30918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30918. - Fix Version/s: 3.0.0 Resolution: Fixed > improve the splitting of skewed partitions >

[jira] [Commented] (SPARK-30923) Spark MLlib, GraphX 2.4 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-30923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042362#comment-17042362 ] Xiao Li commented on SPARK-30923: - cc [~ruifengz] Could you lead this effort and open the subtasks? >

[jira] [Updated] (SPARK-30923) Spark MLlib, GraphX 2.4 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-30923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30923: Component/s: ML Documentation > Spark MLlib, GraphX 2.4 QA umbrella >

[jira] [Created] (SPARK-30923) Spark MLlib, GraphX 2.4 QA umbrella

Xiao Li created SPARK-30923: --- Summary: Spark MLlib, GraphX 2.4 QA umbrella Key: SPARK-30923 URL: https://issues.apache.org/jira/browse/SPARK-30923 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-30779) Review and fix issues in Structured Streaming API docs

[ https://issues.apache.org/jira/browse/SPARK-30779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30779. - Fix Version/s: 3.0.0 Assignee: Shixiong Zhu Resolution: Fixed > Review and fix issues

[jira] [Updated] (SPARK-30779) Review and fix issues in Structured Streaming API docs

[ https://issues.apache.org/jira/browse/SPARK-30779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30779: Parent: SPARK-26904 Issue Type: Sub-task (was: Bug) > Review and fix issues in Structured

[jira] [Reopened] (SPARK-30245) Add cache for Like and RLike when pattern is not static

[ https://issues.apache.org/jira/browse/SPARK-30245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-30245: - > Add cache for Like and RLike when pattern is not static >

[jira] [Updated] (SPARK-30245) Add cache for Like and RLike when pattern is not static

[ https://issues.apache.org/jira/browse/SPARK-30245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30245: Fix Version/s: (was: 3.0.0) > Add cache for Like and RLike when pattern is not static >

[jira] [Reopened] (SPARK-29721) Spark SQL reads unnecessary nested fields after using explode

[ https://issues.apache.org/jira/browse/SPARK-29721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-29721: - > Spark SQL reads unnecessary nested fields after using explode >

<    1   2   3   4   5   6   7   8   9   10   >