[jira] [Created] (SPARK-36341) In stage page, 'Aggregated Metrics by Executor' the underline displayed when the mouse is moved to the link is blocked

2021-07-29 Thread angerszhu (Jira)
angerszhu created SPARK-36341: - Summary: In stage page, 'Aggregated Metrics by Executor' the underline displayed when the mouse is moved to the link is blocked Key: SPARK-36341 URL:

[jira] [Created] (SPARK-36340) V2 Insert data check filed name

2021-07-29 Thread angerszhu (Jira)
angerszhu created SPARK-36340: - Summary: V2 Insert data check filed name Key: SPARK-36340 URL: https://issues.apache.org/jira/browse/SPARK-36340 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-36271) Hive SerDe and V1 Insert data to parquet/orc/avro need to check schema too

2021-07-28 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36271: -- Summary: Hive SerDe and V1 Insert data to parquet/orc/avro need to check schema too (was: Insert

[jira] [Created] (SPARK-36312) ParquetWritter should check inner field

2021-07-26 Thread angerszhu (Jira)
angerszhu created SPARK-36312: - Summary: ParquetWritter should check inner field Key: SPARK-36312 URL: https://issues.apache.org/jira/browse/SPARK-36312 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36311) DESC TABLE in v2 show more detail information

2021-07-26 Thread angerszhu (Jira)
angerszhu created SPARK-36311: - Summary: DESC TABLE in v2 show more detail information Key: SPARK-36311 URL: https://issues.apache.org/jira/browse/SPARK-36311 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-30694) If exception occured while fetching blocks by ExternalBlockClient, fail early when External Shuffle Service is not alive

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-30694. --- Resolution: Won't Fix > If exception occured while fetching blocks by ExternalBlockClient, fail

[jira] [Resolved] (SPARK-29769) Spark SQL cannot handle "exists/not exists" condition when using "JOIN"

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-29769. --- Resolution: Implemented > Spark SQL cannot handle "exists/not exists" condition when using "JOIN" >

[jira] [Resolved] (SPARK-29018) Build spark thrift server on it's own code based on protocol v11

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-29018. --- Resolution: Won't Fix > Build spark thrift server on it's own code based on protocol v11 >

[jira] [Resolved] (SPARK-28419) A patch for SparkThriftServer support multi-tenant authentication

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-28419. --- Resolution: Won't Fix > A patch for SparkThriftServer support multi-tenant authentication >

[jira] [Resolved] (SPARK-33912) Refactor DependencyUtils ivy property parameter

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-33912. --- Resolution: Won't Fix > Refactor DependencyUtils ivy property parameter >

[jira] [Resolved] (SPARK-32818) Make hive metastore convert config can be changed session level

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-32818. --- Resolution: Not A Problem > Make hive metastore convert config can be changed session level >

[jira] [Resolved] (SPARK-32692) Support INSERT OVERWRITE DIR cross cluster

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-32692. --- Resolution: Not A Problem > Support INSERT OVERWRITE DIR cross cluster >

[jira] [Resolved] (SPARK-32939) Avoid re-compute expensive expression

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-32939. --- Resolution: Implemented > Avoid re-compute expensive expression >

[jira] [Resolved] (SPARK-33547) Doc Type Construct Literal usage

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-33547. --- Resolution: Not A Problem > Doc Type Construct Literal usage > > >

[jira] [Resolved] (SPARK-33809) Support `all_columns_except` complex column expression function

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-33809. --- Resolution: Won't Fix > Support `all_columns_except` complex column expression function >

[jira] [Resolved] (SPARK-34576) Cannot drop/add columns from/to a dataset of v2 `DESCRIBE COLUMN`

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-34576. --- Resolution: Fixed > Cannot drop/add columns from/to a dataset of v2 `DESCRIBE COLUMN` >

[jira] [Resolved] (SPARK-31298) validate CTAS table path in SPARK-19724 seems conflict and External table also need to check non-empty

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-31298. --- Resolution: Won't Fix > validate CTAS table path in SPARK-19724 seems conflict and External table

[jira] [Resolved] (SPARK-30237) Move `sql()` method from DataType to AbstractType

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-30237. --- Resolution: Won't Fix > Move `sql()` method from DataType to AbstractType >

[jira] [Resolved] (SPARK-29271) Run HiveSparkSubmitSuite with hive jars use maven 3.1.2 won't stop then timeout

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-29271. --- Resolution: Invalid > Run HiveSparkSubmitSuite with hive jars use maven 3.1.2 won't stop then >

[jira] [Commented] (SPARK-36271) Insert data to parquet/orc/avro need to check schema too

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17385986#comment-17385986 ] angerszhu commented on SPARK-36271: --- Will start this after

[jira] [Updated] (SPARK-36271) Insert data to parquet/orc/avro need to check schema too

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36271: -- Description: {code:java} withTempPath { path => spark.sql( s"""

[jira] [Updated] (SPARK-36271) Insert data to parquet/orc/avro need to check schema too

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36271: -- Description: {code:java} withTempPath { path => spark.sql( s"""

[jira] [Updated] (SPARK-36271) Insert data to parquet/orc/avro need to check schema too

2021-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36271: -- Attachment: screenshot-1.png > Insert data to parquet/orc/avro need to check schema too >

[jira] [Created] (SPARK-36271) Insert data to parquet/orc/avro need to check schema too

2021-07-23 Thread angerszhu (Jira)
angerszhu created SPARK-36271: - Summary: Insert data to parquet/orc/avro need to check schema too Key: SPARK-36271 URL: https://issues.apache.org/jira/browse/SPARK-36271 Project: Spark Issue

[jira] [Updated] (SPARK-36238) Spark UI load event timeline too slow for huge stage

2021-07-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36238: -- Description: (was: !screenshot-1.png! ) > Spark UI load event timeline too slow for huge stage

[jira] [Commented] (SPARK-36238) Spark UI load event timeline too slow for huge stage

2021-07-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384707#comment-17384707 ] angerszhu commented on SPARK-36238: --- Working on this > Spark UI load event timeline too slow for

[jira] [Updated] (SPARK-36238) Spark UI load event timeline too slow for huge stage

2021-07-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36238: -- Description: !screenshot-1.png! > Spark UI load event timeline too slow for huge stage >

[jira] [Created] (SPARK-36238) Spark UI load event timeline too slow for huge stage

2021-07-21 Thread angerszhu (Jira)
angerszhu created SPARK-36238: - Summary: Spark UI load event timeline too slow for huge stage Key: SPARK-36238 URL: https://issues.apache.org/jira/browse/SPARK-36238 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36238) Spark UI load event timeline too slow for huge stage

2021-07-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36238: -- Attachment: screenshot-1.png > Spark UI load event timeline too slow for huge stage >

[jira] [Commented] (SPARK-36201) Add check for inner field of schema

2021-07-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384696#comment-17384696 ] angerszhu commented on SPARK-36201: --- Issue resolved by https://github.com/apache/spark/pull/33409 >

[jira] [Resolved] (SPARK-36201) Add check for inner field of schema

2021-07-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-36201. --- Resolution: Resolved Issue resolved by https://github.com/apache/spark/pull/33409 > Add check for

[jira] [Created] (SPARK-36237) SparkUI should bind handler after application started

2021-07-21 Thread angerszhu (Jira)
angerszhu created SPARK-36237: - Summary: SparkUI should bind handler after application started Key: SPARK-36237 URL: https://issues.apache.org/jira/browse/SPARK-36237 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36235) Supported datatype check should check inner field

2021-07-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-36235. --- Resolution: Not A Bug > Supported datatype check should check inner field >

[jira] [Created] (SPARK-36235) Supported datatype check should check inner field

2021-07-20 Thread angerszhu (Jira)
angerszhu created SPARK-36235: - Summary: Supported datatype check should check inner field Key: SPARK-36235 URL: https://issues.apache.org/jira/browse/SPARK-36235 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36029) Interval str should handle start field == end Field

2021-07-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-36029. --- Resolution: Fixed > Interval str should handle start field == end Field >

[jira] [Commented] (SPARK-36029) Interval str should handle start field == end Field

2021-07-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383802#comment-17383802 ] angerszhu commented on SPARK-36029: --- This bug has been fixed by

[jira] [Updated] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2021-07-19 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33844: -- Parent: SPARK-36200 Issue Type: Sub-task (was: Improvement) > InsertIntoDir failed since

[jira] [Created] (SPARK-36201) Add check for inner field of schema

2021-07-18 Thread angerszhu (Jira)
angerszhu created SPARK-36201: - Summary: Add check for inner field of schema Key: SPARK-36201 URL: https://issues.apache.org/jira/browse/SPARK-36201 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36202) Unify schema check API

2021-07-18 Thread angerszhu (Jira)
angerszhu created SPARK-36202: - Summary: Unify schema check API Key: SPARK-36202 URL: https://issues.apache.org/jira/browse/SPARK-36202 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-33865) When HiveDDL, we need check avro schema too like parquet & orc

2021-07-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33865: -- Parent: SPARK-36200 Issue Type: Sub-task (was: Improvement) > When HiveDDL, we need check

[jira] [Created] (SPARK-36200) Improve schema check logic before execution

2021-07-18 Thread angerszhu (Jira)
angerszhu created SPARK-36200: - Summary: Improve schema check logic before execution Key: SPARK-36200 URL: https://issues.apache.org/jira/browse/SPARK-36200 Project: Spark Issue Type:

[jira] [Created] (SPARK-36156) Row FORMAT SERDE should handle null value as `\N`

2021-07-15 Thread angerszhu (Jira)
angerszhu created SPARK-36156: - Summary: Row FORMAT SERDE should handle null value as `\N` Key: SPARK-36156 URL: https://issues.apache.org/jira/browse/SPARK-36156 Project: Spark Issue Type:

[jira] [Created] (SPARK-36153) Add SLQ doc about transform for current behavior

2021-07-15 Thread angerszhu (Jira)
angerszhu created SPARK-36153: - Summary: Add SLQ doc about transform for current behavior Key: SPARK-36153 URL: https://issues.apache.org/jira/browse/SPARK-36153 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36093) The result incorrect if the partition path case is inconsistent

2021-07-12 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379224#comment-17379224 ] angerszhu commented on SPARK-36093: --- Working on this > The result incorrect if the partition path

[jira] [Created] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread angerszhu (Jira)
angerszhu created SPARK-36049: - Summary: Remove IntervalUnit in code Key: SPARK-36049 URL: https://issues.apache.org/jira/browse/SPARK-36049 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36029) Interval str should handle start field == end Field

2021-07-06 Thread angerszhu (Jira)
angerszhu created SPARK-36029: - Summary: Interval str should handle start field == end Field Key: SPARK-36029 URL: https://issues.apache.org/jira/browse/SPARK-36029 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36021) Incorrect parsing of the start field in interval literals

2021-07-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375170#comment-17375170 ] angerszhu commented on SPARK-36021: --- [~maxgekk] Got it, raise a pr soon > Incorrect parsing of the

[jira] [Commented] (SPARK-36023) Confusing error from casting a string to ANSI interval

2021-07-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375085#comment-17375085 ] angerszhu commented on SPARK-36023: --- My fault. {code:java} def

[jira] [Created] (SPARK-35991) Add PlanStability suite for TPCH

2021-07-02 Thread angerszhu (Jira)
angerszhu created SPARK-35991: - Summary: Add PlanStability suite for TPCH Key: SPARK-35991 URL: https://issues.apache.org/jira/browse/SPARK-35991 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-35972) NestColumnPruning cause execute loss output

2021-07-01 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372647#comment-17372647 ] angerszhu commented on SPARK-35972: --- We meet a case that it can analyze/optimize and generate

[jira] [Updated] (SPARK-35972) NestColumnPruning cause execute loss output

2021-07-01 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-35972: -- Description: {code:java} Job aborted due to stage failure: Task 47 in stage 1.0 failed 4 times, most

[jira] [Created] (SPARK-35972) NestColumnPruning cause execute loss output

2021-07-01 Thread angerszhu (Jira)
angerszhu created SPARK-35972: - Summary: NestColumnPruning cause execute loss output Key: SPARK-35972 URL: https://issues.apache.org/jira/browse/SPARK-35972 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34537) Repartition miss/duplicated data

2021-06-28 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-34537. --- Resolution: Not A Problem > Repartition miss/duplicated data > > >

[jira] [Created] (SPARK-35905) Adding withTable in SQLQuerySuite about test("SPARK-33338: GROUP BY using literal map should not fail")

2021-06-25 Thread angerszhu (Jira)
angerszhu created SPARK-35905: - Summary: Adding withTable in SQLQuerySuite about test("SPARK-8: GROUP BY using literal map should not fail") Key: SPARK-35905 URL:

[jira] [Created] (SPARK-35890) Unify IntervalUtils.castStringToYMInterval with parser

2021-06-25 Thread angerszhu (Jira)
angerszhu created SPARK-35890: - Summary: Unify IntervalUtils.castStringToYMInterval with parser Key: SPARK-35890 URL: https://issues.apache.org/jira/browse/SPARK-35890 Project: Spark Issue Type:

[jira] [Created] (SPARK-35891) Unify IntervalUtils.castStringToDTInterval with parser

2021-06-25 Thread angerszhu (Jira)
angerszhu created SPARK-35891: - Summary: Unify IntervalUtils.castStringToDTInterval with parser Key: SPARK-35891 URL: https://issues.apache.org/jira/browse/SPARK-35891 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35886) Codegen issue for decimal type

2021-06-24 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369208#comment-17369208 ] angerszhu commented on SPARK-35886: --- Working on this > Codegen issue for decimal type >

[jira] [Created] (SPARK-35871) Literal.create(value, dataType) should support fields

2021-06-24 Thread angerszhu (Jira)
angerszhu created SPARK-35871: - Summary: Literal.create(value, dataType) should support fields Key: SPARK-35871 URL: https://issues.apache.org/jira/browse/SPARK-35871 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35730) Check all day-time interval types in UDF

2021-06-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368556#comment-17368556 ] angerszhu commented on SPARK-35730: --- working on this > Check all day-time interval types in UDF >

[jira] [Created] (SPARK-35860) Support upcast between different field of YearMonthIntervalType/DayTimeIntervalType

2021-06-22 Thread angerszhu (Jira)
angerszhu created SPARK-35860: - Summary: Support upcast between different field of YearMonthIntervalType/DayTimeIntervalType Key: SPARK-35860 URL: https://issues.apache.org/jira/browse/SPARK-35860

[jira] [Commented] (SPARK-35776) Check all year-month interval types in arrow

2021-06-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366401#comment-17366401 ] angerszhu commented on SPARK-35776: --- Working on this > Check all year-month interval types in arrow >

[jira] [Created] (SPARK-35820) Support cast between different DayTimeIntervalType

2021-06-18 Thread angerszhu (Jira)
angerszhu created SPARK-35820: - Summary: Support cast between different DayTimeIntervalType Key: SPARK-35820 URL: https://issues.apache.org/jira/browse/SPARK-35820 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35820) Support cast between different DayTimeIntervalType

2021-06-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365843#comment-17365843 ] angerszhu commented on SPARK-35820: --- Working on this > Support cast between different

[jira] [Updated] (SPARK-35819) Support cast between different field YearMonthIntervalType

2021-06-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-35819: -- Description: Support cast between YearMonthIntervalType  year/tear  year/month month/month > Support

[jira] [Created] (SPARK-35819) Support cast between different field YearMonthIntervalType

2021-06-18 Thread angerszhu (Jira)
angerszhu created SPARK-35819: - Summary: Support cast between different field YearMonthIntervalType Key: SPARK-35819 URL: https://issues.apache.org/jira/browse/SPARK-35819 Project: Spark Issue

[jira] [Commented] (SPARK-35726) Truncate java.time.Duration by fields of day-time interval type

2021-06-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364788#comment-17364788 ] angerszhu commented on SPARK-35726: --- Working on this > Truncate java.time.Duration by fields of

[jira] [Commented] (SPARK-35769) Truncate java.time.Period by fields of year-month interval type

2021-06-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364772#comment-17364772 ] angerszhu commented on SPARK-35769: --- Working on this > Truncate java.time.Period by fields of

[jira] [Commented] (SPARK-35768) Take into account year-month interval fields in cast

2021-06-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364770#comment-17364770 ] angerszhu commented on SPARK-35768: --- [~maxgekk]  Should we move this under

[jira] [Commented] (SPARK-35735) Take into account day-time interval fields in cast

2021-06-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364661#comment-17364661 ] angerszhu commented on SPARK-35735: --- Work on this > Take into account day-time interval fields in

[jira] [Commented] (SPARK-35768) Take into account year-month interval fields in cast

2021-06-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364650#comment-17364650 ] angerszhu commented on SPARK-35768: --- Work on this > Take into account year-month interval fields in

[jira] [Commented] (SPARK-35733) Check all day-time interval types in HiveInspectors tests

2021-06-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364333#comment-17364333 ] angerszhu commented on SPARK-35733: --- Working on this > Check all day-time interval types in

[jira] [Commented] (SPARK-35772) Check all year-month interval types in HiveInspectors tests

2021-06-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364332#comment-17364332 ] angerszhu commented on SPARK-35772: --- Working on this  > Check all year-month interval types in

[jira] [Commented] (SPARK-35732) Parse DayTimeIntervalType from JSON

2021-06-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364172#comment-17364172 ] angerszhu commented on SPARK-35732: --- [~xiaopenglei] Sorry for make pr for this ticket.. since I work

[jira] [Commented] (SPARK-35770) Parse YearMonthIntervalType from JSON

2021-06-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364137#comment-17364137 ] angerszhu commented on SPARK-35770: --- Work on this > Parse YearMonthIntervalType from JSON >

[jira] [Commented] (SPARK-35673) Spark fails on unrecognized hint in subquery

2021-06-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359807#comment-17359807 ] angerszhu commented on SPARK-35673: --- Just check the comment, problem is clear, we need to discuss more

[jira] [Commented] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

2021-06-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359087#comment-17359087 ] angerszhu commented on SPARK-35667: --- checking this. > spark.speculation causes incorrect query

[jira] [Commented] (SPARK-26867) Spark Support of YARN Placement Constraint

2021-06-01 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354987#comment-17354987 ] angerszhu commented on SPARK-26867: --- We have such requirement and I am working on this but something

[jira] [Commented] (SPARK-32166) Metastore problem on Spark3.0 with Hive3.0

2021-05-31 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354759#comment-17354759 ] angerszhu commented on SPARK-32166: ---

[jira] [Commented] (SPARK-35129) Construct year-month interval column from integral fields

2021-05-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347271#comment-17347271 ] angerszhu commented on SPARK-35129: --- Can I take this if no update for a long time? > Construct

[jira] [Updated] (SPARK-35360) Spark make add partition batch size configurable when call RepairTableCommand

2021-05-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-35360: -- Summary: Spark make add partition batch size configurable when call RepairTableCommand (was: Spark

[jira] [Created] (SPARK-35360) Spark make add partition batch size configurable

2021-05-10 Thread angerszhu (Jira)
angerszhu created SPARK-35360: - Summary: Spark make add partition batch size configurable Key: SPARK-35360 URL: https://issues.apache.org/jira/browse/SPARK-35360 Project: Spark Issue Type:

[jira] [Created] (SPARK-35228) Add expression ToHiveString for keep consistent between hive/spark format in df.show and transform

2021-04-26 Thread angerszhu (Jira)
angerszhu created SPARK-35228: - Summary: Add expression ToHiveString for keep consistent between hive/spark format in df.show and transform Key: SPARK-35228 URL: https://issues.apache.org/jira/browse/SPARK-35228

[jira] [Updated] (SPARK-35220) DayTimeIntervalType/YearMonthIntervalString show different in hive serde and row formet delimited

2021-04-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-35220: -- Parent: SPARK-31936 Issue Type: Sub-task (was: Bug) >

[jira] [Created] (SPARK-35220) DayTimeIntervalType/YearMonthIntervalString show different in hive serde and row formet delimited

2021-04-25 Thread angerszhu (Jira)
angerszhu created SPARK-35220: - Summary: DayTimeIntervalType/YearMonthIntervalString show different in hive serde and row formet delimited Key: SPARK-35220 URL: https://issues.apache.org/jira/browse/SPARK-35220

[jira] [Created] (SPARK-35219) YearMonthIntervalType/DayTimeIntervalType 's string value not same in spark default serde and hive serde

2021-04-25 Thread angerszhu (Jira)
angerszhu created SPARK-35219: - Summary: YearMonthIntervalType/DayTimeIntervalType 's string value not same in spark default serde and hive serde Key: SPARK-35219 URL:

[jira] [Resolved] (SPARK-32390) TRANSFORM with hive serde support CalendarIntervalType and UserDefinedType

2021-04-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-32390. --- Resolution: Won't Fix > TRANSFORM with hive serde support CalendarIntervalType and UserDefinedType

[jira] [Closed] (SPARK-33309) Replace origin GROUPING SETS with new expression

2021-04-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu closed SPARK-33309. - Fixed in other pr > Replace origin GROUPING SETS with new expression >

[jira] [Closed] (SPARK-33296) Format exception when use cube func && with cube

2021-04-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu closed SPARK-33296. - Not a problem now > Format exception when use cube func && with cube >

[jira] [Closed] (SPARK-33378) Update doc about grouping analytics

2021-04-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu closed SPARK-33378. - Fix in other pr > Update doc about grouping analytics > > >

[jira] [Closed] (SPARK-33377) Support composite columns in cube/rollup

2021-04-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu closed SPARK-33377. - > Support composite columns in cube/rollup > > >

[jira] [Commented] (SPARK-35169) Wrong result of min ANSI interval division by -1

2021-04-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17330241#comment-17330241 ] angerszhu commented on SPARK-35169: --- It's guava IntMath.divude's bug.. > Wrong result of min ANSI

[jira] [Created] (SPARK-35201) Format empty grouping set exception in CUBE/ROLLUP

2021-04-23 Thread angerszhu (Jira)
angerszhu created SPARK-35201: - Summary: Format empty grouping set exception in CUBE/ROLLUP Key: SPARK-35201 URL: https://issues.apache.org/jira/browse/SPARK-35201 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35187) Failure on minimal interval literal

2021-04-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17327238#comment-17327238 ] angerszhu commented on SPARK-35187: --- Yea, got it > Failure on minimal interval literal >

[jira] [Created] (SPARK-35177) IntervalUtils.fromYearMonthString can't handle Int.MinValue correctly

2021-04-21 Thread angerszhu (Jira)
angerszhu created SPARK-35177: - Summary: IntervalUtils.fromYearMonthString can't handle Int.MinValue correctly Key: SPARK-35177 URL: https://issues.apache.org/jira/browse/SPARK-35177 Project: Spark

[jira] [Commented] (SPARK-35177) IntervalUtils.fromYearMonthString can't handle Int.MinValue correctly

2021-04-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326643#comment-17326643 ] angerszhu commented on SPARK-35177: --- Raise a pr soon > IntervalUtils.fromYearMonthString can't handle

[jira] [Resolved] (SPARK-34902) Support cast long to DayTimeIntervalType and cast Int to YearMonthIntervalType

2021-04-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-34902. --- Resolution: Won't Do > Support cast long to DayTimeIntervalType and cast Int to

[jira] [Commented] (SPARK-35161) Safe version SQL functions

2021-04-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326272#comment-17326272 ] angerszhu commented on SPARK-35161: --- Got it. > Safe version SQL functions >

[jira] [Commented] (SPARK-35112) Cast string to day-time interval

2021-04-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326252#comment-17326252 ] angerszhu commented on SPARK-35112: --- Working on this > Cast string to day-time interval >

[jira] [Commented] (SPARK-35111) Cast string to year-month interval

2021-04-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326251#comment-17326251 ] angerszhu commented on SPARK-35111: --- Working on this. > Cast string to year-month interval >

[jira] [Created] (SPARK-35159) extract doc of hive format

2021-04-20 Thread angerszhu (Jira)
angerszhu created SPARK-35159: - Summary: extract doc of hive format Key: SPARK-35159 URL: https://issues.apache.org/jira/browse/SPARK-35159 Project: Spark Issue Type: Sub-task

<    1   2   3   4   5   6   7   8   9   10   >