[jira] [Updated] (SPARK-33738) Add timeout info for ShuffleBlockFetcherIterator when get remote block

2020-12-10 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-33738: -- Description: In order to facilitate the troubleshooting of hotspots or data skew, it's better to add

[jira] [Updated] (SPARK-33738) Add timeout info for ShuffleBlockFetcherIterator when get remote block

2020-12-10 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-33738: -- Description: In order to facilitate the troubleshooting of hotspots or data skew, it's better to add

[jira] [Created] (SPARK-33738) Add timeout info for ShuffleBlockFetcherIterator when get remote block

2020-12-10 Thread chenliang (Jira)
chenliang created SPARK-33738: - Summary: Add timeout info for ShuffleBlockFetcherIterator when get remote block Key: SPARK-33738 URL: https://issues.apache.org/jira/browse/SPARK-33738 Project: Spark

[jira] [Updated] (SPARK-32208) Spark SQL throw Illegal character exception when load certain abnormal path of HDFS

2020-12-10 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-32208: -- Summary: Spark SQL throw Illegal character exception when load certain abnormal path of HDFS (was:

[jira] [Reopened] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

2020-12-10 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang reopened SPARK-32208: --- [~hyukjin.kwon] Thanks a lot , I have filled the PR description. > SparkSQL throw Illegal character ex

[jira] [Updated] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

2020-12-10 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-32208: -- Description: In the distributed hdfs storage system,Space and other special character are allowed in

[jira] [Updated] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

2020-12-10 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-32208: -- Description: In the distributed hdfs storage system,Space and other special character are allowed in

[jira] [Updated] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

2020-12-10 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-32208: -- Description: In the distributed hdfs storage system,Space and other special character are allowed in

[jira] [Updated] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

2020-12-10 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-32208: -- Affects Version/s: 3.2.0 Description: In the distributed hdfs storage system,Space and other

[jira] [Updated] (SPARK-33721) Support to use Hive build-in functions by configuration

2020-12-09 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-33721: -- Description: Hive and Spark SQL engines have many differences in built-in functions.The differences b

[jira] [Updated] (SPARK-33721) Support to use Hive build-in functions by configuration

2020-12-09 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-33721: -- Description: Hive and Spark SQL engines have many differences in built-in functions.The differences b

[jira] [Created] (SPARK-33721) Support to use Hive build-in functions by configuration

2020-12-09 Thread chenliang (Jira)
chenliang created SPARK-33721: - Summary: Support to use Hive build-in functions by configuration Key: SPARK-33721 URL: https://issues.apache.org/jira/browse/SPARK-33721 Project: Spark Issue Type:

[jira] [Reopened] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

2020-12-08 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang reopened SPARK-33707: --- [~hyukjin.kwon] thanks for your time, I have resolved some commonly used functions  and I will submit t

[jira] [Created] (SPARK-33707) Support multiple types of function partition pruning on hive metastore

2020-12-08 Thread chenliang (Jira)
chenliang created SPARK-33707: - Summary: Support multiple types of function partition pruning on hive metastore Key: SPARK-33707 URL: https://issues.apache.org/jira/browse/SPARK-33707 Project: Spark

[jira] [Created] (SPARK-33704) Support latest version of initialize() in HiveGenericUDTF

2020-12-07 Thread chenliang (Jira)
chenliang created SPARK-33704: - Summary: Support latest version of initialize() in HiveGenericUDTF Key: SPARK-33704 URL: https://issues.apache.org/jira/browse/SPARK-33704 Project: Spark Issue Typ

[jira] [Created] (SPARK-32208) SparkSQL throw Illegal character exception when load certain abnormal path of HDFS

2020-07-07 Thread chenliang (Jira)
chenliang created SPARK-32208: - Summary: SparkSQL throw Illegal character exception when load certain abnormal path of HDFS Key: SPARK-32208 URL: https://issues.apache.org/jira/browse/SPARK-32208 Projec

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Attachment: screenshot-1.png > Fix NumberFormatException when totalSize is empty > --

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Description: For Spark2.3.0+, we could get the Partitions Statistics Info.But in some specail case, T

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Description: For Spark2.3.0+, we could get the Partitions Statistics Info.But in some specail case, T

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Description: For Spark2.3.0+, we could get the Partitions Statistics Info.But in some specail case, T

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Description: For Spark2.3.0+, we could get the Partitions Statistics Info.But in some specail case, T

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Description: For Spark2.3.0+, we could get the Partitions Statistics Info.But in some specail case, T

[jira] [Created] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-13 Thread chenliang (Jira)
chenliang created SPARK-30262: - Summary: Fix NumberFormatException when totalSize is empty Key: SPARK-30262 URL: https://issues.apache.org/jira/browse/SPARK-30262 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-30261) Should not change owner of hive table for some commands like 'alter' operation

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30261: -- Description: For SparkSQL,When we do some alter operations on hive table, the owner of hive table wou

[jira] [Updated] (SPARK-30261) Should not change owner of hive table for some commands like 'alter' operation

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30261: -- Description: For SparkSQL,When we do some alter operations on hive table, the owner of hive table wou

[jira] [Updated] (SPARK-30261) Should not change owner of hive table for some commands like 'alter' operation

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30261: -- Description: For SparkSQL,When we do some alter operations on hive table, the owner of hive table wou

[jira] [Created] (SPARK-30261) Should not change owner of hive table for some commands like 'alter' operation

2019-12-13 Thread chenliang (Jira)
chenliang created SPARK-30261: - Summary: Should not change owner of hive table for some commands like 'alter' operation Key: SPARK-30261 URL: https://issues.apache.org/jira/browse/SPARK-30261 Project: S

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Target Version/s: 2.4.3, 2.3.0 (was: 2.4.3) > Spark-Shell throw ClassNotFoundException exception for

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Fix Version/s: 2.3.0 > Spark-Shell throw ClassNotFoundException exception for more than one > stateme

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Description: When we start spark-shell and use the udf for the first statement ,it's ok. But for the

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Description: When we start spark-shell and use the udf for the first statement ,it's ok. But for the

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Description: When we start spark-shell and use the udf for the first statement ,it's ok. But for the

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Description: When we start spark-shell and use the udf for the first statement ,it's ok. But for th

[jira] [Updated] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

2019-12-13 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30260: -- Description: When we start spark-shell and use the udf for the first statement ,it's ok. But for the

[jira] [Created] (SPARK-30260) Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar

2019-12-13 Thread chenliang (Jira)
chenliang created SPARK-30260: - Summary: Spark-Shell throw ClassNotFoundException exception for more than one statement to use UDF jar Key: SPARK-30260 URL: https://issues.apache.org/jira/browse/SPARK-30260

[jira] [Commented] (SPARK-26543) Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-07 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736653#comment-16736653 ] chenliang commented on SPARK-26543: --- [~yhuai] [~aaronmarkham]  Could you please have a

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-07 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: (was: SPARK-26334.patch) > NullPointerException in CallMethodViaReflection when we ap

[jira] [Reopened] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-07 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang reopened SPARK-26334: --- I have create a PR for this. > NullPointerException in CallMethodViaReflection when we apply reflect

[jira] [Updated] (SPARK-26557) The configuration of maven-checkstyle-plugin is error for mvn install

2019-01-06 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26557: -- Attachment: (was: image-2019-01-07-14-48-39-190.png) > The configuration of maven-checkstyle-plugi

[jira] [Updated] (SPARK-26557) The configuration of maven-checkstyle-plugin is error for mvn install

2019-01-06 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26557: -- Description: When I build the Spark with the maven script: {code:java} mvn install -Psparkr -Pyarn -Ph

[jira] [Updated] (SPARK-26557) The configuration of maven-checkstyle-plugin is error for mvn install

2019-01-06 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26557: -- Attachment: image-2019-01-07-14-49-07-113.png > The configuration of maven-checkstyle-plugin is error

[jira] [Updated] (SPARK-26557) The configuration of maven-checkstyle-plugin is error for mvn install

2019-01-06 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26557: -- Attachment: image-2019-01-07-14-48-39-190.png > The configuration of maven-checkstyle-plugin is error

[jira] [Updated] (SPARK-26557) The configuration of maven-checkstyle-plugin is error for mvn install

2019-01-06 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26557: -- Description: When I build the Spark with the maven script: {code:java} mvn install -Psparkr -Pyarn -Ph

[jira] [Created] (SPARK-26557) The configuration of maven-checkstyle-plugin is error for mvn install

2019-01-06 Thread chenliang (JIRA)
chenliang created SPARK-26557: - Summary: The configuration of maven-checkstyle-plugin is error for mvn install Key: SPARK-26557 URL: https://issues.apache.org/jira/browse/SPARK-26557 Project: Spark

[jira] [Commented] (SPARK-26543) Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-06 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735415#comment-16735415 ] chenliang commented on SPARK-26543: --- [~hyukjin.kwon] thanks for your help, I have crea

[jira] [Updated] (SPARK-26543) Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-06 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: (was: SPARK-26543.patch) > Support the coordinator to determine post-shuffle partition

[jira] [Updated] (SPARK-26543) Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-06 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Summary: Support the coordinator to determine post-shuffle partitions more reasonably (was: Support t

[jira] [Comment Edited] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-05 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734810#comment-16734810 ] chenliang edited comment on SPARK-26543 at 1/5/19 8:30 AM: --- [~

[jira] [Commented] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-05 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734810#comment-16734810 ] chenliang commented on SPARK-26543: --- [~r...@databricks.com][~markhamstra][~cloud_fan]

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-05 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: SPARK-26543.patch > Support the coordinator to demerminte post-shuffle partitions more rea

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true',the ExchangeCoord

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: image-2019-01-05-13-18-30-487.png > Support the coordinator to demerminte post-shuffle par

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: screenshot-1.png > Support the coordinator to demerminte post-shuffle partitions more reas

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: (was: screenshot-1.png) > Support the coordinator to demerminte post-shuffle partition

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true',the ExchangeCoord

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true',the ExchangeCoord

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true',the ExchangeCoord

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true',the ExchangeCoord

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: (was: 15_24_38__12_27_2018.jpg) > Support the coordinator to demerminte post-shuffle p

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true',the ExchangeCoo

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true',the ExchangeCoor

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: 15_24_38__12_27_2018.jpg > Support the coordinator to demerminte post-shuffle partitions m

[jira] [Created] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
chenliang created SPARK-26543: - Summary: Support the coordinator to demerminte post-shuffle partitions more reasonably Key: SPARK-26543 URL: https://issues.apache.org/jira/browse/SPARK-26543 Project: Spar

[jira] [Created] (SPARK-26542) Support the coordinator to demerminte post-shuffle partitions more reasonably

2019-01-04 Thread chenliang (JIRA)
chenliang created SPARK-26542: - Summary: Support the coordinator to demerminte post-shuffle partitions more reasonably Key: SPARK-26542 URL: https://issues.apache.org/jira/browse/SPARK-26542 Project: Spar

[jira] [Commented] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734182#comment-16734182 ] chenliang commented on SPARK-26334: --- Anyway,thanks. > NullPointerException in CallMe

[jira] [Commented] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734142#comment-16734142 ] chenliang commented on SPARK-26334: --- [~hyukjin.kwon]Thanks for your attention,I did kn

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: (was: 1537537286575.jpg) > NullPointerException in CallMethodViaReflection when we ap

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: 21_47_01__01_04_2019.jpg > NullPointerException in CallMethodViaReflection when we apply

[jira] [Issue Comment Deleted] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Comment: was deleted (was: [~hyukjin.kwon] Thank you ,I did know that the method itself throws an NPE

[jira] [Commented] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734138#comment-16734138 ] chenliang commented on SPARK-26334: --- [~hyukjin.kwon] Thank you ,I did know that the me

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-04 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: 1537537286575.jpg > NullPointerException in CallMethodViaReflection when we apply reflect

[jira] [Commented] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717077#comment-16717077 ] chenliang commented on SPARK-26334: --- [~hyukjin.kwon] Could you please have a look at t

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: SPARK-26334.patch > NullPointerException in CallMethodViaReflection when we apply reflect

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Description: In the table shown below: {code:sql} CREATE EXTERNAL TABLE `test_db4`(`a` string, `b` st

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: screenshot-1.png > NullPointerException in CallMethodViaReflection when we apply reflect

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Description: In the table shown below: CREATE EXTERNAL TABLE `test_db4`(`a` string, `b` string, `url`

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Description: In the table shown below: {code:sql} CREATE EXTERNAL TABLE `test_db4`(`a` string, `b` s

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Description: In the table shown below: CREATE EXTERNAL TABLE `test_db4`(`a` string, `b` string, `url`

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: (was: image-2018-12-11-16-54-50-659.png) > NullPointerException in CallMethodViaRefle

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: (was: image-2018-12-11-16-48-27-305.png) > NullPointerException in CallMethodViaRefle

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Description: {panel:title=NPE} org.apache.spark.SparkException: Job aborted due to stage failure: Tas

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: (was: image-2018-12-11-17-00-00-171.png) > NullPointerException in CallMethodViaRefle

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: (was: image-2018-12-11-16-47-26-369.png) > NullPointerException in CallMethodViaRefle

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Description: In the table shown below: {code:sql} CREATE EXTERNAL TABLE `test_db4`(`a` string, `b` st

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Description: In the table shown below: CREATE EXTERNAL TABLE `test_db4`(`a` string, `b` string, `url`

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: image-2018-12-11-17-00-00-171.png > NullPointerException in CallMethodViaReflection when

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Description: In the table shown below: CREATE EXTERNAL TABLE `test_db4`(`a` string, `b` string, `url`

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Description: In the table shown below: CREATE EXTERNAL TABLE `test_db4`(`a` string, `b` string, `url`

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: image-2018-12-11-16-54-50-659.png > NullPointerException in CallMethodViaReflection when

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Description: In the table shown below: CREATE EXTERNAL TABLE `test_db4`(`a` string, `b` string, `url`

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: image-2018-12-11-16-48-27-305.png > NullPointerException in CallMethodViaReflection when

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: image-2018-12-11-16-47-26-369.png > NullPointerException in CallMethodViaReflection when

[jira] [Created] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2018-12-11 Thread chenliang (JIRA)
chenliang created SPARK-26334: - Summary: NullPointerException in CallMethodViaReflection when we apply reflect function for empty field Key: SPARK-26334 URL: https://issues.apache.org/jira/browse/SPARK-26334