[GitHub] [spark] maropu commented on a change in pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-19 Thread GitBox
maropu commented on a change in pull request #28863: URL: https://github.com/apache/spark/pull/28863#discussion_r443104744 ## File path: external/docker-integration-tests/pom.xml ## @@ -130,15 +130,9 @@ postgresql test - - - com.oracle -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28616: [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28616: URL: https://github.com/apache/spark/pull/28616#issuecomment-646945193 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28616: [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28616: URL: https://github.com/apache/spark/pull/28616#issuecomment-646945191 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28616: [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28616: URL: https://github.com/apache/spark/pull/28616#issuecomment-646945191 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28616: [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

2020-06-19 Thread GitBox
SparkQA commented on pull request #28616: URL: https://github.com/apache/spark/pull/28616#issuecomment-646945067 **[Test build #124308 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124308/testReport)** for PR 28616 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28616: [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28616: URL: https://github.com/apache/spark/pull/28616#issuecomment-646927958 **[Test build #124308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124308/testReport)** for PR 28616 at commit

[GitHub] [spark] gatorsmile commented on pull request #28850: [SPARK-32015][Core]Remote inheritable thread local variables after spark context is stopped

2020-06-19 Thread GitBox
gatorsmile commented on pull request #28850: URL: https://github.com/apache/spark/pull/28850#issuecomment-646944392 cc @Ngone51 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] gatorsmile commented on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-19 Thread GitBox
gatorsmile commented on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646940577 cc @maropu @MaxGekk This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] gatorsmile commented on pull request #28860: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

2020-06-19 Thread GitBox
gatorsmile commented on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-646940477 cc @MaxGekk @HyukjinKwon This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] gatorsmile commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-06-19 Thread GitBox
gatorsmile commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-646937829 cc @gengliangwang This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add REFRESH FUNCTION command

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-646937453 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28840: [SPARK-31999][SQL] Add REFRESH FUNCTION command

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-646937453 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28868: [SPARK-32029][SQL] Make active session null when application end

2020-06-19 Thread GitBox
SparkQA commented on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-646937285 **[Test build #124312 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124312/testReport)** for PR 28868 at commit

[GitHub] [spark] SparkQA commented on pull request #28840: [SPARK-31999][SQL] Add REFRESH FUNCTION command

2020-06-19 Thread GitBox
SparkQA commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-646937314 **[Test build #124313 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124313/testReport)** for PR 28840 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28868: [SPARK-32029][SQL] Make active session null when application end

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-646936353 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646936393 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28868: [SPARK-32029][SQL] Make active session null when application end

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-646936353 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646936393 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
SparkQA commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646936144 **[Test build #124311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124311/testReport)** for PR 28853 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-646935915 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-646935915 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-646893545 **[Test build #124304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124304/testReport)** for PR 28804 at commit

[GitHub] [spark] SparkQA commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-19 Thread GitBox
SparkQA commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-646935525 **[Test build #124304 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124304/testReport)** for PR 28804 at commit

[GitHub] [spark] siknezevic edited a comment on pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements

2020-06-19 Thread GitBox
siknezevic edited a comment on pull request #27246: URL: https://github.com/apache/spark/pull/27246#issuecomment-646931795 > > Could you please let me know would it be OK to hard-code the read buffer size to 1024? > > You think the performance is independent of running platforms,

[GitHub] [spark] TJX2014 commented on pull request #28819: [SPARK-31980][SQL]Function sequence() fails if start and end of range are equal dates

2020-06-19 Thread GitBox
TJX2014 commented on pull request #28819: URL: https://github.com/apache/spark/pull/28819#issuecomment-646934894 Thanks, I will make a PR for branch-2.4. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] TJX2014 removed a comment on pull request #28819: [SPARK-31980][SQL]Function sequence() fails if start and end of range are equal dates

2020-06-19 Thread GitBox
TJX2014 removed a comment on pull request #28819: URL: https://github.com/apache/spark/pull/28819#issuecomment-646933713 @dongjoon-hyun Thanks, I am willing to, I still have a question, Could you please help me check.Could I base `master` to use `CalendarInterval.fromString` instead of

[GitHub] [spark] TJX2014 commented on pull request #28819: [SPARK-31980][SQL]Function sequence() fails if start and end of range are equal dates

2020-06-19 Thread GitBox
TJX2014 commented on pull request #28819: URL: https://github.com/apache/spark/pull/28819#issuecomment-646933713 @dongjoon-hyun Thanks, I am willing to, I still have a question, Could you please help me check.Could I base `master` to use `CalendarInterval.fromString` instead of

[GitHub] [spark] siknezevic commented on pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements

2020-06-19 Thread GitBox
siknezevic commented on pull request #27246: URL: https://github.com/apache/spark/pull/27246#issuecomment-646931795 > > Could you please let me know would it be OK to hard-code the read buffer size to 1024? > > You think the performance is independent of running platforms, e.g., CPU

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-646931118 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-646931118 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dilipbiswal commented on a change in pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-06-19 Thread GitBox
dilipbiswal commented on a change in pull request #28683: URL: https://github.com/apache/spark/pull/28683#discussion_r443096878 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2065,6 +2065,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] SparkQA commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-06-19 Thread GitBox
SparkQA commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-646930991 **[Test build #124310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124310/testReport)** for PR 28683 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-646929406 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-646929024 **[Test build #124309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124309/testReport)** for PR 28528 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-646929403 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-646929403 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-646929262 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-06-19 Thread GitBox
SparkQA commented on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-646929396 **[Test build #124309 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124309/testReport)** for PR 28528 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-646929262 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-06-19 Thread GitBox
SparkQA commented on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-646929024 **[Test build #124309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124309/testReport)** for PR 28528 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-646928295 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-646928529 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-646928291 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-646927922 **[Test build #124307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124307/testReport)** for PR 28618 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-646928291 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28616: [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28616: URL: https://github.com/apache/spark/pull/28616#issuecomment-646928173 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-19 Thread GitBox
SparkQA commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-646928282 **[Test build #124307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124307/testReport)** for PR 28618 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-646928142 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28616: [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28616: URL: https://github.com/apache/spark/pull/28616#issuecomment-646928173 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-646928142 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28616: [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

2020-06-19 Thread GitBox
SparkQA commented on pull request #28616: URL: https://github.com/apache/spark/pull/28616#issuecomment-646927958 **[Test build #124308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124308/testReport)** for PR 28616 at commit

[GitHub] [spark] SparkQA commented on pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-19 Thread GitBox
SparkQA commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-646927922 **[Test build #124307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124307/testReport)** for PR 28618 at commit

[GitHub] [spark] yaooqinn commented on pull request #28784: [SPARK-31957][SQL] Cleanup hive scratch dir for the developer api startWithContext

2020-06-19 Thread GitBox
yaooqinn commented on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-646927538 Thank you all for reviewing and merging This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] dongjoon-hyun commented on pull request #28616: [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28616: URL: https://github.com/apache/spark/pull/28616#issuecomment-646927265 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun commented on pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-646927049 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun closed pull request #28784: [SPARK-31957][SQL] Cleanup hive scratch dir for the developer api startWithContext

2020-06-19 Thread GitBox
dongjoon-hyun closed pull request #28784: URL: https://github.com/apache/spark/pull/28784 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-646925511 Thank you, @dilipbiswal . The feature looks useful to me. This is an automated message from the Apache

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-06-19 Thread GitBox
dongjoon-hyun commented on a change in pull request #28683: URL: https://github.com/apache/spark/pull/28683#discussion_r443094576 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2065,6 +2065,15 @@ object SQLConf {

[GitHub] [spark] dongjoon-hyun commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-646924782 Could you resolve a conflict, @dilipbiswal ? This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #28873: [SPARK-32021][SQL] Increase precision of seconds and fractions of `make_interval`

2020-06-19 Thread GitBox
dongjoon-hyun edited a comment on pull request #28873: URL: https://github.com/apache/spark/pull/28873#issuecomment-646923926 Could you make a backporting PR to branch-3.0? We need to regenerate some files. This is an

[GitHub] [spark] dongjoon-hyun commented on pull request #28873: [SPARK-32021][SQL] Increase precision of seconds and fractions of `make_interval`

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28873: URL: https://github.com/apache/spark/pull/28873#issuecomment-646923926 Could you make a backporting PR to branch-3.0? This is an automated message from the Apache Git Service.

[GitHub] [spark] dongjoon-hyun closed pull request #28873: [SPARK-32021][SQL] Increase precision of seconds and fractions of `make_interval`

2020-06-19 Thread GitBox
dongjoon-hyun closed pull request #28873: URL: https://github.com/apache/spark/pull/28873 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #28819: [SPARK-31980][SQL]Function sequence() fails if start and end of range are equal dates

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28819: URL: https://github.com/apache/spark/pull/28819#issuecomment-646923541 Hi, @TJX2014 . In branch-2.4, `stringToInterval` doesn't exist. Could you make a PR for Apache Spark 2.4.7 please?

[GitHub] [spark] holdenk commented on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting feature.

2020-06-19 Thread GitBox
holdenk commented on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-646923353 Sure, I'm taking this weekend away from coding so I'll get to this early next week. This is an automated

[GitHub] [spark] dongjoon-hyun closed pull request #28819: [SPARK-31980][SQL]Function sequence() fails if start and end of range are equal dates

2020-06-19 Thread GitBox
dongjoon-hyun closed pull request #28819: URL: https://github.com/apache/spark/pull/28819 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28873: [SPARK-32021][SQL] Increase precision of seconds and fractions of `make_interval`

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28873: URL: https://github.com/apache/spark/pull/28873#issuecomment-646920959 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28873: [SPARK-32021][SQL] Increase precision of seconds and fractions of `make_interval`

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28873: URL: https://github.com/apache/spark/pull/28873#issuecomment-646920959 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28873: [SPARK-32021][SQL] Increase precision of seconds and fractions of `make_interval`

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28873: URL: https://github.com/apache/spark/pull/28873#issuecomment-646867588 **[Test build #124301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124301/testReport)** for PR 28873 at commit

[GitHub] [spark] SparkQA commented on pull request #28873: [SPARK-32021][SQL] Increase precision of seconds and fractions of `make_interval`

2020-06-19 Thread GitBox
SparkQA commented on pull request #28873: URL: https://github.com/apache/spark/pull/28873#issuecomment-646920751 **[Test build #124301 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124301/testReport)** for PR 28873 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28868: [SPARK-32029][SQL] Make active session null when application end

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-646916561 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28868: [SPARK-32029][SQL] Make active session null when application end

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-646881818 **[Test build #124302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124302/testReport)** for PR 28868 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28868: [SPARK-32029][SQL] Make active session null when application end

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-646916553 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28868: [SPARK-32029][SQL] Make active session null when application end

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-646916553 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28868: [SPARK-32029][SQL] Make active session null when application end

2020-06-19 Thread GitBox
SparkQA commented on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-646916428 **[Test build #124302 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124302/testReport)** for PR 28868 at commit

[GitHub] [spark] venkata91 commented on a change in pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting

2020-06-19 Thread GitBox
venkata91 commented on a change in pull request #28874: URL: https://github.com/apache/spark/pull/28874#discussion_r443089270 ## File path: core/src/test/scala/org/apache/spark/ui/UISeleniumSuite.scala ## @@ -48,24 +48,24 @@ import org.apache.spark.util.CallSite

[GitHub] [spark] xianyinxin commented on pull request #28875: [SPARK-32030][SQL] Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

2020-06-19 Thread GitBox
xianyinxin commented on pull request #28875: URL: https://github.com/apache/spark/pull/28875#issuecomment-646915406 @cloud-fan @brkyvz , pls take a look. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] dongjoon-hyun commented on pull request #28826: [SPARK-31988][SQL] Schema pruning may discard attribute metadata

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28826: URL: https://github.com/apache/spark/pull/28826#issuecomment-646914222 BTW, @guykhazma . Is the example in the PR description enough? If I follow the direction, the metadata is not lost. ``` scala> sc.version res1: String = 3.0.0

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #28826: [SPARK-31988][SQL] Schema pruning may discard attribute metadata

2020-06-19 Thread GitBox
dongjoon-hyun edited a comment on pull request #28826: URL: https://github.com/apache/spark/pull/28826#issuecomment-646914222 BTW, @guykhazma . Is the example in the PR description enough? If I follow the direction, the metadata is not lost. If that is insufficient, please add more steps

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28875: [SPARK-32030][SQL] Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28875: URL: https://github.com/apache/spark/pull/28875#issuecomment-646914223 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28875: [SPARK-32030][SQL] Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28875: URL: https://github.com/apache/spark/pull/28875#issuecomment-646914223 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28875: [SPARK-32030][SQL] Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

2020-06-19 Thread GitBox
SparkQA commented on pull request #28875: URL: https://github.com/apache/spark/pull/28875#issuecomment-646914074 **[Test build #124306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124306/testReport)** for PR 28875 at commit

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #28826: [SPARK-31988][SQL] Schema pruning may discard attribute metadata

2020-06-19 Thread GitBox
dongjoon-hyun edited a comment on pull request #28826: URL: https://github.com/apache/spark/pull/28826#issuecomment-646913172 +1, for @maropu 's suggestion. You can use your example in the PR description, @guykhazma . Also, I have the same question like @viirya . This seems to

[GitHub] [spark] dongjoon-hyun commented on pull request #28826: [SPARK-31988][SQL] Schema pruning may discard attribute metadata

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28826: URL: https://github.com/apache/spark/pull/28826#issuecomment-646913172 +1, for @maropu 's suggestion. You can use your example in the PR description, @guykhazma . This is an

[GitHub] [spark] xianyinxin opened a new pull request #28875: [SPARK-32030][SQL] Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

2020-06-19 Thread GitBox
xianyinxin opened a new pull request #28875: URL: https://github.com/apache/spark/pull/28875 ### What changes were proposed in this pull request? This PR add unlimited MATCHED and NOT MATCHED clauses in MERGE INTO statement. ### Why are the changes needed? Now the MERGE INTO

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28867: [SPARK-32028][WEBUI] fix app id link for multi attempts app in history summary page

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28867: URL: https://github.com/apache/spark/pull/28867#issuecomment-646911984 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28867: [SPARK-32028][WEBUI] fix app id link for multi attempts app in history summary page

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28867: URL: https://github.com/apache/spark/pull/28867#issuecomment-646911984 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28867: [SPARK-32028][WEBUI] fix app id link for multi attempts app in history summary page

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28867: URL: https://github.com/apache/spark/pull/28867#issuecomment-646881817 **[Test build #124303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124303/testReport)** for PR 28867 at commit

[GitHub] [spark] SparkQA commented on pull request #28867: [SPARK-32028][WEBUI] fix app id link for multi attempts app in history summary page

2020-06-19 Thread GitBox
SparkQA commented on pull request #28867: URL: https://github.com/apache/spark/pull/28867#issuecomment-646911587 **[Test build #124303 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124303/testReport)** for PR 28867 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-646911317 BTW, welcome to the Apache Spark community and thank you for your first contribution, @cchighman . This

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

2020-06-19 Thread GitBox
dongjoon-hyun commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r443087420 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala ## @@ -356,26 +380,35 @@ object

[GitHub] [spark] cchighman commented on a change in pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

2020-06-19 Thread GitBox
cchighman commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r443087412 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala ## @@ -356,26 +380,35 @@ object

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

2020-06-19 Thread GitBox
dongjoon-hyun commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r443087259 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala ## @@ -356,26 +380,35 @@ object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #23531: URL: https://github.com/apache/spark/pull/23531#issuecomment-646910123 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #23531: URL: https://github.com/apache/spark/pull/23531#issuecomment-646910123 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #23531: URL: https://github.com/apache/spark/pull/23531#issuecomment-646843922 **[Test build #124299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124299/testReport)** for PR 23531 at commit

[GitHub] [spark] SparkQA commented on pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2020-06-19 Thread GitBox
SparkQA commented on pull request #23531: URL: https://github.com/apache/spark/pull/23531#issuecomment-646909740 **[Test build #124299 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124299/testReport)** for PR 23531 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

2020-06-19 Thread GitBox
dongjoon-hyun commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-646909066 Thank you so much for this contribution, @wypoon and @attilapiros . This is an automated message from the

[GitHub] [spark] maropu commented on a change in pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
maropu commented on a change in pull request #28853: URL: https://github.com/apache/spark/pull/28853#discussion_r443085104 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala ## @@ -528,6 +528,41 @@ class

[GitHub] [spark] maropu commented on a change in pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
maropu commented on a change in pull request #28853: URL: https://github.com/apache/spark/pull/28853#discussion_r443085083 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala ## @@ -528,6 +528,41 @@ class

[GitHub] [spark] maropu commented on a change in pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
maropu commented on a change in pull request #28853: URL: https://github.com/apache/spark/pull/28853#discussion_r443085037 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala ## @@ -528,6 +528,41 @@ class

  1   2   3   4   5   6   7   >