[jira] [Commented] (SPARK-24930) Exception information is not accurate when using `LOAD DATA LOCAL INPATH`

2020-10-12 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212201#comment-17212201 ] angerszhu commented on SPARK-24930: --- No, form message I put in comment, seems Hadoop method handle

[jira] [Commented] (SPARK-24930) Exception information is not accurate when using `LOAD DATA LOCAL INPATH`

2020-10-12 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212189#comment-17212189 ] angerszhu commented on SPARK-24930: --- cc [~maropu] Hey, for this jira, I check again and seems solved

[jira] [Comment Edited] (SPARK-24930) Exception information is not accurate when using `LOAD DATA LOCAL INPATH`

2020-10-12 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212188#comment-17212188 ] angerszhu edited comment on SPARK-24930 at 10/12/20, 7:25 AM: -- In current

[jira] [Commented] (SPARK-24930) Exception information is not accurate when using `LOAD DATA LOCAL INPATH`

2020-10-12 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212188#comment-17212188 ] angerszhu commented on SPARK-24930: --- In current version, error message  {code:java} spark-sql> load

[jira] [Commented] (SPARK-32166) Metastore problem on Spark3.0 with Hive3.0

2020-10-12 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212172#comment-17212172 ] angerszhu commented on SPARK-32166: --- Spark Hive client version too low? > Metastore problem on

[jira] [Resolved] (SPARK-30271) dynamic allocation won't release some executor in some case.

2020-10-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-30271. --- Resolution: Fixed > dynamic allocation won't release some executor in some case. >

[jira] [Created] (SPARK-33084) Add jar support ivy path

2020-10-07 Thread angerszhu (Jira)
angerszhu created SPARK-33084: - Summary: Add jar support ivy path Key: SPARK-33084 URL: https://issues.apache.org/jira/browse/SPARK-33084 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-33023) addJar use `Utils.isWindow` to judge windows system

2020-09-29 Thread angerszhu (Jira)
angerszhu created SPARK-33023: - Summary: addJar use `Utils.isWindow` to judge windows system Key: SPARK-33023 URL: https://issues.apache.org/jira/browse/SPARK-33023 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32939) Avoid re-compute expensive expression

2020-09-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32939: -- Description: {code:java} test("Pushdown demo") { withTable("t") { withTempDir { loc =>

[jira] [Created] (SPARK-32939) Avoid re-compute expensive expression

2020-09-18 Thread angerszhu (Jira)
angerszhu created SPARK-32939: - Summary: Avoid re-compute expensive expression Key: SPARK-32939 URL: https://issues.apache.org/jira/browse/SPARK-32939 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32867) HiveTablerelation show too much message of Catalogpartitions

2020-09-13 Thread angerszhu (Jira)
angerszhu created SPARK-32867: - Summary: HiveTablerelation show too much message of Catalogpartitions Key: SPARK-32867 URL: https://issues.apache.org/jira/browse/SPARK-32867 Project: Spark

[jira] [Updated] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

2020-09-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32830: -- Description: For BroadcastNestedLoopJoin, we will broadcast boradcast-side child to all executor and

[jira] [Created] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

2020-09-09 Thread angerszhu (Jira)
angerszhu created SPARK-32830: - Summary: Optimize Skewed BroadcastNestedLoopJoin with AE Key: SPARK-32830 URL: https://issues.apache.org/jira/browse/SPARK-32830 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32818) Make hive metastore convert config can be changed session level

2020-09-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32818: -- Description: There are some cases that we have history hive  table, in origin, it use textfile

[jira] [Created] (SPARK-32818) Make hive metastore convert config can be changed session level

2020-09-08 Thread angerszhu (Jira)
angerszhu created SPARK-32818: - Summary: Make hive metastore convert config can be changed session level Key: SPARK-32818 URL: https://issues.apache.org/jira/browse/SPARK-32818 Project: Spark

[jira] [Created] (SPARK-32807) Spark ThriftServer multisession mode set DB use direct API

2020-09-06 Thread angerszhu (Jira)
angerszhu created SPARK-32807: - Summary: Spark ThriftServer multisession mode set DB use direct API Key: SPARK-32807 URL: https://issues.apache.org/jira/browse/SPARK-32807 Project: Spark Issue

[jira] [Commented] (SPARK-32603) CREATE/REPLACE TABLE AS SELECT not support multi-part identifiers

2020-09-03 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190480#comment-17190480 ] angerszhu commented on SPARK-32603: --- In current grammar {code:java} | replaceTableHeader ('('

[jira] [Commented] (SPARK-32603) CREATE/REPLACE TABLE AS SELECT not support multi-part identifiers

2020-09-03 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189902#comment-17189902 ] angerszhu commented on SPARK-32603: --- | replaceTableHeader ('(' colTypeList ')')? tableProvider

[jira] [Updated] (SPARK-32603) CREATE/REPLACE TABLE AS SELECT not support multi-part identifiers

2020-09-03 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32603: -- Description: {code:java} == SQL == CREATE TABLE h2.test.abc AS SELECT * FROM h2.test.people ^^^

[jira] [Commented] (SPARK-32603) CREATE/REPLACE TABLE AS SELECT not support multi-part identifiers

2020-09-03 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189897#comment-17189897 ] angerszhu commented on SPARK-32603: --- [~huaxingao] Since in current mode, seem we only can connect to

[jira] [Created] (SPARK-32692) Support INSERT OVERWRITE DIR cross cluster

2020-08-24 Thread angerszhu (Jira)
angerszhu created SPARK-32692: - Summary: Support INSERT OVERWRITE DIR cross cluster Key: SPARK-32692 URL: https://issues.apache.org/jira/browse/SPARK-32692 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-32685) Script transform hive serde default field.delimit is '\t'

2020-08-21 Thread angerszhu (Jira)
angerszhu created SPARK-32685: - Summary: Script transform hive serde default field.delimit is '\t' Key: SPARK-32685 URL: https://issues.apache.org/jira/browse/SPARK-32685 Project: Spark Issue

[jira] [Updated] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive as '\\N'

2020-08-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32684: -- Summary: Scrip transform hive serde/default-serde mode null value keep same with hive as '\\N' (was:

[jira] [Updated] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive

2020-08-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32684: -- Description: Hive serde default NULL value is '\N' {code:java} String nullString = tbl.getProperty(

[jira] [Updated] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive

2020-08-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32684: -- Parent: SPARK-31936 Issue Type: Sub-task (was: Bug) > Scrip transform hive

[jira] [Created] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive

2020-08-21 Thread angerszhu (Jira)
angerszhu created SPARK-32684: - Summary: Scrip transform hive serde/default-serde mode null value keep same with hive Key: SPARK-32684 URL: https://issues.apache.org/jira/browse/SPARK-32684 Project:

[jira] [Created] (SPARK-32679) update "no-serde" in the codebase in other TRANSFORM PRs.

2020-08-21 Thread angerszhu (Jira)
angerszhu created SPARK-32679: - Summary: update "no-serde" in the codebase in other TRANSFORM PRs. Key: SPARK-32679 URL: https://issues.apache.org/jira/browse/SPARK-32679 Project: Spark Issue

[jira] [Updated] (SPARK-32667) Scrip transformation no-serde mode when column less then output length , Use null fill

2020-08-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32667: -- Description: Scrip transform no-serde mode should pad null value to filling column {code:java} hive>

[jira] [Created] (SPARK-32667) Scrip transformation no-serde mode when column less then output length , Use null fill

2020-08-20 Thread angerszhu (Jira)
angerszhu created SPARK-32667: - Summary: Scrip transformation no-serde mode when column less then output length , Use null fill Key: SPARK-32667 URL: https://issues.apache.org/jira/browse/SPARK-32667

[jira] [Updated] (SPARK-32607) Script Transformation no-serde `TOK_TABLEROWFORMATLINES` only support `\n`

2020-08-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32607: -- Summary: Script Transformation no-serde `TOK_TABLEROWFORMATLINES` only support `\n` (was: Script

[jira] [Updated] (SPARK-32608) Script Transform DELIMIT value should be formatted

2020-08-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32608: -- Summary: Script Transform DELIMIT value should be formatted (was: Script Transform DELIMIT value

[jira] [Updated] (SPARK-32607) Script Transformation no-serde read line should respect `TOK_TABLEROWFORMATLINES`

2020-08-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32607: -- Description: Scrip Transform no-serde ({{ROW FORMAT DELIMITED}}) mode {{LINE TERMINNATED BY}} only

[jira] [Updated] (SPARK-32608) Script Transform DELIMIT value error

2020-08-13 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32608: -- Description: For SQL   {code:java} SELECT TRANSFORM(a, b, c) ROW FORMAT DELIMITED FIELDS

[jira] [Created] (SPARK-32608) Script Transform DELIMIT value error

2020-08-13 Thread angerszhu (Jira)
angerszhu created SPARK-32608: - Summary: Script Transform DELIMIT value error Key: SPARK-32608 URL: https://issues.apache.org/jira/browse/SPARK-32608 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-32607) Script Transformation no-serde read line should respect `TOK_TABLEROWFORMATLINES`

2020-08-13 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32607: -- Description: reader.readLine() should respect `TOK_TABLEROWFORMATLINES` {code:java} protected def

[jira] [Updated] (SPARK-32607) Script Transformation no-serde read line should respect `TOK_TABLEROWFORMATLINES`

2020-08-13 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32607: -- Description: reader.readLine() should respect `` {code:java} protected def

[jira] [Created] (SPARK-32607) Script Transformation no-serde read line should respect `TOK_TABLEROWFORMATLINES`

2020-08-13 Thread angerszhu (Jira)
angerszhu created SPARK-32607: - Summary: Script Transformation no-serde read line should respect `TOK_TABLEROWFORMATLINES` Key: SPARK-32607 URL: https://issues.apache.org/jira/browse/SPARK-32607 Project:

[jira] [Resolved] (SPARK-31947) Solve string value error about Date/Timestamp in ScriptTransform

2020-08-13 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-31947. --- Resolution: Fixed > Solve string value error about Date/Timestamp in ScriptTransform >

[jira] [Updated] (SPARK-32388) TRANSFORM when schema less should keep same with hive

2020-08-12 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32388: -- Description: Hive transform without schema   {code:java} hive> create table t (c0 int, c1 int, c2

[jira] [Updated] (SPARK-32400) Test coverage of HiveScripTransformationExec

2020-08-11 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32400: -- Description: Add more test case for script transformation to make use case more clear. Doing below

[jira] [Resolved] (SPARK-32404) Catch and adding excetion about HiveInspector can't converted data type

2020-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-32404. --- Resolution: Duplicate > Catch and adding excetion about HiveInspector can't converted data type >

[jira] [Created] (SPARK-32404) Catch and adding excetion about HiveInspector can't converted data type

2020-07-23 Thread angerszhu (Jira)
angerszhu created SPARK-32404: - Summary: Catch and adding excetion about HiveInspector can't converted data type Key: SPARK-32404 URL: https://issues.apache.org/jira/browse/SPARK-32404 Project: Spark

[jira] [Updated] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

2020-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32403: -- Parent: SPARK-31936 Issue Type: Sub-task (was: Bug) > SCRIP TRANSFORM Extract common method

[jira] [Created] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

2020-07-23 Thread angerszhu (Jira)
angerszhu created SPARK-32403: - Summary: SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement Key: SPARK-32403 URL: https://issues.apache.org/jira/browse/SPARK-32403

[jira] [Created] (SPARK-32400) Test coverage of HiveScripTransformationExec

2020-07-22 Thread angerszhu (Jira)
angerszhu created SPARK-32400: - Summary: Test coverage of HiveScripTransformationExec Key: SPARK-32400 URL: https://issues.apache.org/jira/browse/SPARK-32400 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-31937) Support processing array and map type using spark noserde mode

2020-07-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163160#comment-17163160 ] angerszhu commented on SPARK-31937: --- raise a pr soon {code:java} -- SPARK-31937 transform with defined

[jira] [Updated] (SPARK-31937) Support processing array and map type using spark noserde mode

2020-07-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31937: -- Summary: Support processing array and map type using spark noserde mode (was: Support processing

[jira] [Commented] (SPARK-32388) TRANSFORM when schema less should keep same with hive

2020-07-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162681#comment-17162681 ] angerszhu commented on SPARK-32388: ---

[jira] [Created] (SPARK-32390) TRANSFORM with hive serde support CalendarIntervalType and UserDefinedType

2020-07-22 Thread angerszhu (Jira)
angerszhu created SPARK-32390: - Summary: TRANSFORM with hive serde support CalendarIntervalType and UserDefinedType Key: SPARK-32390 URL: https://issues.apache.org/jira/browse/SPARK-32390 Project: Spark

[jira] [Created] (SPARK-32388) TRANSFORM when schema less should keep same with hive

2020-07-22 Thread angerszhu (Jira)
angerszhu created SPARK-32388: - Summary: TRANSFORM when schema less should keep same with hive Key: SPARK-32388 URL: https://issues.apache.org/jira/browse/SPARK-32388 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

2020-07-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161760#comment-17161760 ] angerszhu commented on SPARK-32352: --- Looking into this > Partially push down support data filter if

[jira] [Commented] (SPARK-32289) Chinese characters are garbled when opening csv files with Excel

2020-07-13 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156548#comment-17156548 ] angerszhu commented on SPARK-32289: --- [https://bugs.java.com/bugdatabase/view_bug.do?bug_id=4508058] >

[jira] [Updated] (SPARK-32243) HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32243: -- Description: When we create a UDAF function use class extended UserDefinedAggregetFunction,  when we

[jira] [Created] (SPARK-32243) HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-09 Thread angerszhu (Jira)
angerszhu created SPARK-32243: - Summary: HiveSessionCatalog call super.makeFunctionExpression should show error message Key: SPARK-32243 URL: https://issues.apache.org/jira/browse/SPARK-32243 Project:

[jira] [Commented] (SPARK-32213) saveAsTable deletes all files in path

2020-07-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153312#comment-17153312 ] angerszhu commented on SPARK-32213: --- [~yuvalr] You can review my pr and give some suggestions.   >

[jira] [Commented] (SPARK-32220) Cartesian Product Hint cause data error

2020-07-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153260#comment-17153260 ] angerszhu commented on SPARK-32220: --- raise a pr soon > Cartesian Product Hint cause data error >

[jira] [Updated] (SPARK-32220) Cartesian Product Hint cause data error

2020-07-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32220: -- Description: {code:java} spark-sql> select * from test4 order by a asc; 1 2 Time taken: 1.063

[jira] [Updated] (SPARK-32220) Cartesian Product Hint cause data error

2020-07-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32220: -- Description: {code:java} spark-sql> select * from test4 order by a asc; 1 2 Time taken: 1.063

[jira] [Updated] (SPARK-32220) Cartesian Product Hint cause data error

2020-07-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32220: -- Description: {code:java} spark-sql> select * from test1 order by a asc; 1 2 1 4 2 3 3 4 Time taken:

[jira] [Created] (SPARK-32220) Cartesian Product Hint cause data error

2020-07-08 Thread angerszhu (Jira)
angerszhu created SPARK-32220: - Summary: Cartesian Product Hint cause data error Key: SPARK-32220 URL: https://issues.apache.org/jira/browse/SPARK-32220 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-32213) saveAsTable deletes all files in path

2020-07-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153200#comment-17153200 ] angerszhu edited comment on SPARK-32213 at 7/8/20, 3:13 AM:

[jira] [Commented] (SPARK-32213) saveAsTable deletes all files in path

2020-07-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153200#comment-17153200 ] angerszhu commented on SPARK-32213: --- https://issues.apache.org/jira/browse/SPARK-

[jira] [Commented] (SPARK-30037) Customize krb5.conf to test Kafka delegation token with MiniKDC

2020-07-01 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149226#comment-17149226 ] angerszhu commented on SPARK-30037: --- These days I will work on this > Customize krb5.conf to test

[jira] [Commented] (SPARK-32018) Fix UnsafeRow set overflowed decimal

2020-06-28 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147313#comment-17147313 ] angerszhu commented on SPARK-32018: --- [~allisonwang-db]  Can you show a test case to reproduce this?

[jira] [Created] (SPARK-32106) Implement script transform in sql/core

2020-06-26 Thread angerszhu (Jira)
angerszhu created SPARK-32106: - Summary: Implement script transform in sql/core Key: SPARK-32106 URL: https://issues.apache.org/jira/browse/SPARK-32106 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-32105) Refactor current script transform code

2020-06-26 Thread angerszhu (Jira)
angerszhu created SPARK-32105: - Summary: Refactor current script transform code Key: SPARK-32105 URL: https://issues.apache.org/jira/browse/SPARK-32105 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-30037) Customize krb5.conf to test Kafka delegation token with MiniKDC

2020-06-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146008#comment-17146008 ] angerszhu commented on SPARK-30037: --- [~gsomogyi]  No, that pr solve jdk11 problem by change krb5.conf

[jira] [Comment Edited] (SPARK-32002) spark error while select nest data

2020-06-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139249#comment-17139249 ] angerszhu edited comment on SPARK-32002 at 6/18/20, 9:39 AM: - this is

[jira] [Comment Edited] (SPARK-32002) spark error while select nest data

2020-06-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139249#comment-17139249 ] angerszhu edited comment on SPARK-32002 at 6/18/20, 9:17 AM: - for B there is

[jira] [Commented] (SPARK-32002) spark error while select nest data

2020-06-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139249#comment-17139249 ] angerszhu commented on SPARK-32002: --- for B there is tow level ArrayType > spark error while select

[jira] [Commented] (SPARK-32002) spark error while select nest data

2020-06-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139248#comment-17139248 ] angerszhu commented on SPARK-32002: --- {code:java} // code placeholder scala> sql("select a.b from

[jira] [Commented] (SPARK-32018) Fix UnsafeRow set overflowed decimal

2020-06-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139229#comment-17139229 ] angerszhu commented on SPARK-32018: --- Work On this > Fix UnsafeRow set overflowed decimal >

[jira] [Updated] (SPARK-31947) Solve string value error about Date/Timestamp in ScriptTransform

2020-06-12 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31947: -- Description: For test case   {code:java} test("SPARK-25990: TRANSFORM should handle different data

[jira] [Commented] (SPARK-31947) Solve string value error about Date/Timestamp in ScriptTransform

2020-06-11 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133915#comment-17133915 ] angerszhu commented on SPARK-31947: --- [~hyukjin.kwon] Yea, later > Solve string value error about

[jira] [Commented] (SPARK-19169) columns changed orc table encouter 'IndexOutOfBoundsException' when read the old schema files

2020-06-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130033#comment-17130033 ] angerszhu commented on SPARK-19169: --- [~hyukjin.kwon]   Today our user meet this error. that table

[jira] [Commented] (SPARK-31947) Solve string value error about Date/Timestamp in ScriptTransform

2020-06-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129973#comment-17129973 ] angerszhu commented on SPARK-31947: --- raise pr soon > Solve string value error about Date/Timestamp in

[jira] [Created] (SPARK-31947) Solve string value error about Date/Timestamp in ScriptTransform

2020-06-09 Thread angerszhu (Jira)
angerszhu created SPARK-31947: - Summary: Solve string value error about Date/Timestamp in ScriptTransform Key: SPARK-31947 URL: https://issues.apache.org/jira/browse/SPARK-31947 Project: Spark

[jira] [Created] (SPARK-31938) To perfect using constraints of script transform

2020-06-08 Thread angerszhu (Jira)
angerszhu created SPARK-31938: - Summary: To perfect using constraints of script transform Key: SPARK-31938 URL: https://issues.apache.org/jira/browse/SPARK-31938 Project: Spark Issue Type:

[jira] [Created] (SPARK-31937) Support processing array and map type using script transform

2020-06-08 Thread angerszhu (Jira)
angerszhu created SPARK-31937: - Summary: Support processing array and map type using script transform Key: SPARK-31937 URL: https://issues.apache.org/jira/browse/SPARK-31937 Project: Spark

[jira] [Updated] (SPARK-28227) Spark can’t support TRANSFORM with aggregation

2020-06-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28227: -- Parent: SPARK-31936 Issue Type: Sub-task (was: Improvement) > Spark can’t support TRANSFORM

[jira] [Created] (SPARK-31936) Implement ScriptTransform in sql/core

2020-06-08 Thread angerszhu (Jira)
angerszhu created SPARK-31936: - Summary: Implement ScriptTransform in sql/core Key: SPARK-31936 URL: https://issues.apache.org/jira/browse/SPARK-31936 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-31720) TaskMemoryManager allocate failed

2020-05-15 Thread angerszhu (Jira)
angerszhu created SPARK-31720: - Summary: TaskMemoryManager allocate failed Key: SPARK-31720 URL: https://issues.apache.org/jira/browse/SPARK-31720 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-31699) Optimize OpenSession speed in thriftserver

2020-05-13 Thread angerszhu (Jira)
angerszhu created SPARK-31699: - Summary: Optimize OpenSession speed in thriftserver Key: SPARK-31699 URL: https://issues.apache.org/jira/browse/SPARK-31699 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-31670) Using complex type in Aggregation with cube failed Analysis error

2020-05-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1710#comment-1710 ] angerszhu commented on SPARK-31670: --- raise a pr soon > Using complex type in Aggregation with cube

[jira] [Commented] (SPARK-31670) Using complex type in Aggregation with cube failed Analysis error

2020-05-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103327#comment-17103327 ] angerszhu commented on SPARK-31670: --- It is because for Complex type Field, it will add a Alias by

[jira] [Updated] (SPARK-31670) Using complex type in Aggregation with cube failed Analysis error

2020-05-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31670: -- Description: Will wrong with below SQL {code:java} test("TEST STRUCT FIELD WITH GROUP BY with CUBE")

[jira] [Created] (SPARK-31670) Using complex type in Aggregation with cube failed Analysis error

2020-05-09 Thread angerszhu (Jira)
angerszhu created SPARK-31670: - Summary: Using complex type in Aggregation with cube failed Analysis error Key: SPARK-31670 URL: https://issues.apache.org/jira/browse/SPARK-31670 Project: Spark

[jira] [Resolved] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-05-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-31334. --- Resolution: Fixed > Use agg column in Having clause behave different with column type >

[jira] [Issue Comment Deleted] (SPARK-31663) Grouping sets with having clause returns the wrong result

2020-05-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31663: -- Comment: was deleted (was: cc [~dongjoon] [~XuanYuan] Seems this problem  a little like  

[jira] [Commented] (SPARK-31663) Grouping sets with having clause returns the wrong result

2020-05-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103039#comment-17103039 ] angerszhu commented on SPARK-31663: --- cc [~dongjoon] [~XuanYuan] Seems this problem  a little like  

[jira] [Commented] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

2020-05-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102216#comment-17102216 ] angerszhu commented on SPARK-31620: --- cc [~cloud_fan] > TreeNodeException: Binding attribute, tree:

[jira] [Commented] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

2020-05-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101862#comment-17101862 ] angerszhu commented on SPARK-31620: --- It is because in  PlanSubqueries, we have scalar-subquery in

[jira] [Created] (SPARK-31655) Upgrade snappy to version 1.1.7.5

2020-05-06 Thread angerszhu (Jira)
angerszhu created SPARK-31655: - Summary: Upgrade snappy to version 1.1.7.5 Key: SPARK-31655 URL: https://issues.apache.org/jira/browse/SPARK-31655 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-31648) Filtering is supported only on partition keys of type string Issue

2020-05-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100820#comment-17100820 ] angerszhu edited comment on SPARK-31648 at 5/6/20, 1:51 PM: [~Rajesh Tadi]

[jira] [Commented] (SPARK-31648) Filtering is supported only on partition keys of type string Issue

2020-05-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100820#comment-17100820 ] angerszhu commented on SPARK-31648: --- [~Rajesh Tadi] Can you show your reproduce detail code process?

[jira] [Commented] (SPARK-31648) Filtering is supported only on partition keys of type string Issue

2020-05-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100639#comment-17100639 ] angerszhu commented on SPARK-31648: --- [~Rajesh Tadi] Anyway to reproduce this bug? > Filtering is

[jira] [Commented] (SPARK-31648) Filtering is supported only on partition keys of type string Issue

2020-05-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100551#comment-17100551 ] angerszhu commented on SPARK-31648: --- [~Rajesh Tadi] Can you show your sql and table schema detail? >

[jira] [Commented] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095124#comment-17095124 ] angerszhu commented on SPARK-31602: --- cc [~cloud_fan]  > memory leak of JobConf >

[jira] [Updated] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31602: -- Description: !image-2020-04-29-14-34-39-496.png! !image-2020-04-29-14-35-55-986.png! was:

[jira] [Updated] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31602: -- Description: !image-2020-04-29-14-34-39-496.png! Screen Shot 2020-04-29 at 2.08.28 PM was:

<    2   3   4   5   6   7   8   9   10   >