[GitHub] [spark] SparkQA commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's blac

2020-07-12 Thread GitBox
SparkQA commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657263279 **[Test build #125723 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125723/testReport)** for PR 28287 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29075: [SPARK-32284][SQL] Avoid expanding too many CNF predicates in partition pruning

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29075: URL: https://github.com/apache/spark/pull/29075#issuecomment-657258623 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29075: [SPARK-32284][SQL] Avoid expanding too many CNF predicates in partition pruning

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29075: URL: https://github.com/apache/spark/pull/29075#issuecomment-657258623 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29075: [SPARK-32284][SQL] Avoid expanding too many CNF predicates in partition pruning

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #29075: URL: https://github.com/apache/spark/pull/29075#issuecomment-657222046 **[Test build #125715 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125715/testReport)** for PR 29075 at commit

[GitHub] [spark] SparkQA commented on pull request #29075: [SPARK-32284][SQL] Avoid expanding too many CNF predicates in partition pruning

2020-07-12 Thread GitBox
SparkQA commented on pull request #29075: URL: https://github.com/apache/spark/pull/29075#issuecomment-657258446 **[Test build #125715 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125715/testReport)** for PR 29075 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-657256769 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-657256769 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-07-12 Thread GitBox
SparkQA commented on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-657256615 **[Test build #125722 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125722/testReport)** for PR 29074 at commit

[GitHub] [spark] imback82 commented on pull request #29074: [SPARK-32282][SQL] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

2020-07-12 Thread GitBox
imback82 commented on pull request #29074: URL: https://github.com/apache/spark/pull/29074#issuecomment-657256410 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657253688 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657253687 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657253687 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657232576 **[Test build #125716 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125716/testReport)** for PR 28953 at commit

[GitHub] [spark] SparkQA commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
SparkQA commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657253595 **[Test build #125716 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125716/testReport)** for PR 28953 at commit

[GitHub] [spark] viirya commented on a change in pull request #29076: [SPARK-32245][INFRA][FOLLOWUP] Reenable Github Actions on commit

2020-07-12 Thread GitBox
viirya commented on a change in pull request #29076: URL: https://github.com/apache/spark/pull/29076#discussion_r453341871 ## File path: .github/workflows/master.yml ## @@ -1,6 +1,9 @@ name: master on: + push: +branches: +- master Review comment: For

[GitHub] [spark] SparkQA removed a comment on pull request #28960: [SPARK-32140][ML][PySpark] Add training summary to FMClassificationModel

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #28960: URL: https://github.com/apache/spark/pull/28960#issuecomment-657242031 **[Test build #125718 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125718/testReport)** for PR 28960 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28960: [SPARK-32140][ML][PySpark] Add training summary to FMClassificationModel

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28960: URL: https://github.com/apache/spark/pull/28960#issuecomment-657250546 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28960: [SPARK-32140][ML][PySpark] Add training summary to FMClassificationModel

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28960: URL: https://github.com/apache/spark/pull/28960#issuecomment-657250546 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28960: [SPARK-32140][ML][PySpark] Add training summary to FMClassificationModel

2020-07-12 Thread GitBox
SparkQA commented on pull request #28960: URL: https://github.com/apache/spark/pull/28960#issuecomment-657250473 **[Test build #125718 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125718/testReport)** for PR 28960 at commit

[GitHub] [spark] gengliangwang commented on pull request #29075: [SPARK-32284][SQL] Avoid expanding too many CNF predicates in partition pruning

2020-07-12 Thread GitBox
gengliangwang commented on pull request #29075: URL: https://github.com/apache/spark/pull/29075#issuecomment-657250180 @dongjoon-hyun Thanks for the suggestion. I have updated the title. This is an automated message from the

[GitHub] [spark] huaxingao commented on a change in pull request #28960: [SPARK-32140][ML][PySpark] Add training summary to FMClassificationModel

2020-07-12 Thread GitBox
huaxingao commented on a change in pull request #28960: URL: https://github.com/apache/spark/pull/28960#discussion_r453338481 ## File path: mllib/src/main/scala/org/apache/spark/mllib/optimization/GradientDescent.scala ## @@ -226,45 +239,48 @@ object GradientDescent extends

[GitHub] [spark] dongjoon-hyun closed pull request #29063: [SPARK-32270][SQL] Use TextFileFormat in CSV's schema inference with a different encoding

2020-07-12 Thread GitBox
dongjoon-hyun closed pull request #29063: URL: https://github.com/apache/spark/pull/29063 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29076: [SPARK-32245][INFRA][FOLLOWUP] Reenable Github Actions on commit

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29076: URL: https://github.com/apache/spark/pull/29076#issuecomment-657246810 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29076: [SPARK-32245][INFRA][FOLLOWUP] Reenable Github Actions on commit

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29076: URL: https://github.com/apache/spark/pull/29076#issuecomment-657246810 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] gatorsmile edited a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-12 Thread GitBox
gatorsmile edited a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-657246517 Great work! @HyukjinKwon Could you send a note to the dev list and explain the best practice for reading the log generated by Github Actions? We also need to update

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29076: [SPARK-32245][INFRA][FOLLOWUP] Reenable Github Actions on commit

2020-07-12 Thread GitBox
dongjoon-hyun edited a comment on pull request #29076: URL: https://github.com/apache/spark/pull/29076#issuecomment-657246290 Hi, @HyukjinKwon , @gengliangwang , @viirya . As a next step, I want to enable this back. This is

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29076: [SPARK-32245][INFRA][FOLLOWUP] Reenable Github Actions on commit

2020-07-12 Thread GitBox
dongjoon-hyun edited a comment on pull request #29076: URL: https://github.com/apache/spark/pull/29076#issuecomment-657246290 Hi, @HyukjinKwon , @gengliangwang , @viirya . As a next step, I want to enable this back and see the traffic.

[GitHub] [spark] SparkQA commented on pull request #29076: [SPARK-32245][INFRA][FOLLOWUP] Reenable Github Actions on commit

2020-07-12 Thread GitBox
SparkQA commented on pull request #29076: URL: https://github.com/apache/spark/pull/29076#issuecomment-657246675 **[Test build #125721 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125721/testReport)** for PR 29076 at commit

[GitHub] [spark] gatorsmile commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-12 Thread GitBox
gatorsmile commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-657246517 Great work! @HyukjinKwon Could you send a note to the dev list and explain the best practice for reading the log generated by Github Actions?

[GitHub] [spark] dongjoon-hyun commented on pull request #29076: [SPARK-32245][INFRA][FOLLOWUP] Reenable Github Actions on commit

2020-07-12 Thread GitBox
dongjoon-hyun commented on pull request #29076: URL: https://github.com/apache/spark/pull/29076#issuecomment-657246290 Hi, @HyukjinKwon and @gengliangwang . As a next step, I want to enable this back. This is an automated

[GitHub] [spark] dongjoon-hyun opened a new pull request #29076: [SPARK-32245][INFRA][FOLLOWUP] Reenable Github Actions on commit

2020-07-12 Thread GitBox
dongjoon-hyun opened a new pull request #29076: URL: https://github.com/apache/spark/pull/29076 ### What changes were proposed in this pull request? This PR reenables GitHub Action on every commit. ### Why are the changes needed? As we see at

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453335860 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/HiveOrcQuerySuite.scala ## @@ -288,4 +288,56 @@ class HiveOrcQuerySuite

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453335860 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/HiveOrcQuerySuite.scala ## @@ -288,4 +288,56 @@ class HiveOrcQuerySuite

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453335630 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFileFormat.scala ## @@ -185,10 +185,15 @@ class

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453335679 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/orc/OrcPartitionReaderFactory.scala ## @@ -80,10 +80,10 @@

[GitHub] [spark] srowen commented on a change in pull request #28960: [SPARK-32140][ML][PySpark] Add training summary to FMClassificationModel

2020-07-12 Thread GitBox
srowen commented on a change in pull request #28960: URL: https://github.com/apache/spark/pull/28960#discussion_r453335160 ## File path: mllib/src/main/scala/org/apache/spark/mllib/optimization/GradientDescent.scala ## @@ -226,45 +239,48 @@ object GradientDescent extends

[GitHub] [spark] AmplabJenkins commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers directly normalizes IF/CaseWhen/Coalesce child expressions

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657243134 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers directly normalizes IF/CaseWhen/Coalesce child expressions

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657243134 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-657243146 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-657243146 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-12 Thread GitBox
SparkQA commented on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-657242990 **[Test build #125720 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125720/testReport)** for PR 29053 at commit

[GitHub] [spark] SparkQA commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers directly normalizes IF/CaseWhen/Coalesce child expressions

2020-07-12 Thread GitBox
SparkQA commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657242968 **[Test build #125719 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125719/testReport)** for PR 29061 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28960: [SPARK-32140][ML][PySpark] Add training summary to FMClassificationModel

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28960: URL: https://github.com/apache/spark/pull/28960#issuecomment-657242216 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-12 Thread GitBox
dongjoon-hyun commented on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-657242338 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] viirya commented on a change in pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers directly normalizes IF/CaseWhen/Coalesce child expressions

2020-07-12 Thread GitBox
viirya commented on a change in pull request #29061: URL: https://github.com/apache/spark/pull/29061#discussion_r453334357 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/NormalizeFloatingPointNumbersSuite.scala ## @@ -85,8 +85,60 @@ class

[GitHub] [spark] AmplabJenkins commented on pull request #28960: [SPARK-32140][ML][PySpark] Add training summary to FMClassificationModel

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28960: URL: https://github.com/apache/spark/pull/28960#issuecomment-657242216 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-12 Thread GitBox
dongjoon-hyun commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-657242137 Hi, @aokolnychyi . Could you fix the following UT failure? - org.apache.spark.sql.execution.arrow.ArrowConvertersSuite.test Arrow Validator cc @rdblue since

[GitHub] [spark] SparkQA commented on pull request #28960: [SPARK-32140][ML][PySpark] Add training summary to FMClassificationModel

2020-07-12 Thread GitBox
SparkQA commented on pull request #28960: URL: https://github.com/apache/spark/pull/28960#issuecomment-657242031 **[Test build #125718 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125718/testReport)** for PR 28960 at commit

[GitHub] [spark] dongjoon-hyun closed pull request #29073: [MINOR][DOCS] Fix typo in PySpark example in ml-datasource.md

2020-07-12 Thread GitBox
dongjoon-hyun closed pull request #29073: URL: https://github.com/apache/spark/pull/29073 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers directly normalizes IF/CaseWhen/Coalesce child expressions

2020-07-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #29061: URL: https://github.com/apache/spark/pull/29061#discussion_r45379 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/NormalizeFloatingPointNumbersSuite.scala ## @@ -85,8 +85,60 @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers directly normalizes IF/CaseWhen/Coalesce child expressions

2020-07-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #29061: URL: https://github.com/apache/spark/pull/29061#discussion_r45379 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/NormalizeFloatingPointNumbersSuite.scala ## @@ -85,8 +85,60 @@

[GitHub] [spark] dongjoon-hyun closed pull request #29072: [WIP] New GitHub Action PR Builder Health Check

2020-07-12 Thread GitBox
dongjoon-hyun closed pull request #29072: URL: https://github.com/apache/spark/pull/29072 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use subclasses for mock in HiveSessionImplSuite

2020-07-12 Thread GitBox
dongjoon-hyun commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-657240325 Thanks for working on this, @HeartSaVioR and @frankyin-factual . This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657234832 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657233451 **[Test build #125717 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125717/testReport)** for PR 29073 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657234832 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
SparkQA commented on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657234796 **[Test build #125717 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125717/testReport)** for PR 29073 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657233593 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657233593 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
SparkQA commented on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657233451 **[Test build #125717 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125717/testReport)** for PR 29073 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-65716 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] srowen commented on pull request #29073: Update ml-datasource.md

2020-07-12 Thread GitBox
srowen commented on pull request #29073: URL: https://github.com/apache/spark/pull/29073#issuecomment-657232920 Jenkins test this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657232726 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657232726 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] srowen commented on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting feature.

2020-07-12 Thread GitBox
srowen commented on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-657232646 LGTM but we have a merge conflict now This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] srowen closed pull request #29007: [MINOR][SQL][DOCS] consistency in argument naming for time functions

2020-07-12 Thread GitBox
srowen closed pull request #29007: URL: https://github.com/apache/spark/pull/29007 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] srowen commented on pull request #29007: [MINOR][SQL][DOCS] consistency in argument naming for time functions

2020-07-12 Thread GitBox
srowen commented on pull request #29007: URL: https://github.com/apache/spark/pull/29007#issuecomment-657232569 Merged to master This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] SparkQA commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
SparkQA commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657232576 **[Test build #125716 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125716/testReport)** for PR 28953 at commit

[GitHub] [spark] moomindani commented on pull request #28953: [SPARK-32013][SQL] Support query execution before reading DataFrame and before/after writing DataFrame over JDBC

2020-07-12 Thread GitBox
moomindani commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-657232337 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-657230025 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-657230025 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-657199034 **[Test build #125714 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125714/testReport)** for PR 28898 at commit

[GitHub] [spark] SparkQA commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-12 Thread GitBox
SparkQA commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-657229858 **[Test build #125714 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125714/testReport)** for PR 28898 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29075: [SPARK-32284][SQL] Avoid pushing down too many predicated in partition pruning

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29075: URL: https://github.com/apache/spark/pull/29075#issuecomment-65785 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29075: [SPARK-32284][SQL] Avoid pushing down too many predicated in partition pruning

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29075: URL: https://github.com/apache/spark/pull/29075#issuecomment-65785 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29075: [SPARK-32284][SQL] Avoid pushing down too many predicated in partition pruning

2020-07-12 Thread GitBox
SparkQA commented on pull request #29075: URL: https://github.com/apache/spark/pull/29075#issuecomment-657222046 **[Test build #125715 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125715/testReport)** for PR 29075 at commit

[GitHub] [spark] gengliangwang commented on pull request #29075: [SPARK-32284][SQL] Avoid pushing down too many predicated in partition pruning

2020-07-12 Thread GitBox
gengliangwang commented on pull request #29075: URL: https://github.com/apache/spark/pull/29075#issuecomment-657222077 cc @AngersZh @cloud-fan This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] gengliangwang opened a new pull request #29075: [SPARK-32284][SQL] Avoid pushing down too many predicated in partition pruning

2020-07-12 Thread GitBox
gengliangwang opened a new pull request #29075: URL: https://github.com/apache/spark/pull/29075 ### What changes were proposed in this pull request? After https://github.com/apache/spark/pull/28805, the pushed down predicates for partition pruning can be very long.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-657217567 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-657217567 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-657188395 **[Test build #125712 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125712/testReport)** for PR 27690 at commit

[GitHub] [spark] SparkQA commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-12 Thread GitBox
SparkQA commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-657217405 **[Test build #125712 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125712/testReport)** for PR 27690 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657215513 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657215513 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657187134 **[Test build #125710 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125710/testReport)** for PR 29045 at commit

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657215383 **[Test build #125710 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125710/testReport)** for PR 29045 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657212938 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657185105 **[Test build #125709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125709/testReport)** for PR 29045 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657212938 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-12 Thread GitBox
SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657212746 **[Test build #125709 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125709/testReport)** for PR 29045 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657212351 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657212351 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657184487 **[Test build #125708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125708/testReport)** for PR 28425 at commit

[GitHub] [spark] SparkQA commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-12 Thread GitBox
SparkQA commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657212199 **[Test build #125708 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125708/testReport)** for PR 28425 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657212019 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
AmplabJenkins removed a comment on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657212016 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
AmplabJenkins commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657212016 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
SparkQA removed a comment on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657184482 **[Test build #125707 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125707/testReport)** for PR 29061 at commit

[GitHub] [spark] SparkQA commented on pull request #29061: [SPARK-32258][SQL] NormalizeFloatingNumbers can directly normalize on IF and CaseWhen children expressions

2020-07-12 Thread GitBox
SparkQA commented on pull request #29061: URL: https://github.com/apache/spark/pull/29061#issuecomment-657211831 **[Test build #125707 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125707/testReport)** for PR 29061 at commit

[GitHub] [spark] TJX2014 commented on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-12 Thread GitBox
TJX2014 commented on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657210050 @huaxingao Yeah, One of these could happen when user use mysql client in spark to execute `SET TIME_ZONE = "america/new_york"` to use mysql timezone index feature between

<    1   2   3   4   5   >