[GitHub] [spark] SparkQA removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673247771 **[Test build #127396 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127396/testReport)** for PR 29422 at commit [`aaacf30`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673300278 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673300278 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673300286 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127

[GitHub] [spark] SparkQA commented on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
SparkQA commented on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673301476 **[Test build #127400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127400/testReport)** for PR 29422 at commit [`626e285`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
SparkQA commented on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673301930 **[Test build #127395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127395/testReport)** for PR 29342 at commit [`f4f0b0f`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #29322: [SPARK-32511][SQL] Add dropFields method to Column class

2020-08-13 Thread GitBox
SparkQA commented on pull request #29322: URL: https://github.com/apache/spark/pull/29322#issuecomment-673301934 **[Test build #127394 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127394/testReport)** for PR 29322 at commit [`2b0ac34`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673301941 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673301941 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #29322: [SPARK-32511][SQL] Add dropFields method to Column class

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29322: URL: https://github.com/apache/spark/pull/29322#issuecomment-673224836 **[Test build #127394 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127394/testReport)** for PR 29322 at commit [`2b0ac34`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29322: [SPARK-32511][SQL] Add dropFields method to Column class

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29322: URL: https://github.com/apache/spark/pull/29322#issuecomment-673302440 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673301952 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] SparkQA removed a comment on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673245513 **[Test build #127395 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127395/testReport)** for PR 29342 at commit [`f4f0b0f`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29322: [SPARK-32511][SQL] Add dropFields method to Column class

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29322: URL: https://github.com/apache/spark/pull/29322#issuecomment-673302440 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673302813 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673302813 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29322: [SPARK-32511][SQL] Add dropFields method to Column class

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29322: URL: https://github.com/apache/spark/pull/29322#issuecomment-673302448 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673302821 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127

[GitHub] [spark] SparkQA commented on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
SparkQA commented on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673313561 **[Test build #127401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127401/testReport)** for PR 29422 at commit [`16d0bc8`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673314005 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673314005 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-13 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r469756911 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/pathFilters.scala ## @@ -0,0 +1,214 @@ +/* + * Licensed to the Apache Sof

[GitHub] [spark] maropu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
maropu commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469763191 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkScriptTransformationExec.scala ## @@ -0,0 +1,89 @@ +/* + * Licensed to the Apach

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469772259 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkScriptTransformationExec.scala ## @@ -0,0 +1,89 @@ +/* + * Licensed to the

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469772903 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/PlanParserSuite.scala ## @@ -1031,4 +1031,115 @@ class PlanParserSuit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469774925 ## File path: sql/core/src/test/resources/sql-tests/inputs/transform.sql ## @@ -0,0 +1,114 @@ +-- Test data. +CREATE OR REPLACE TEMPORARY VIEW t AS S

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469772903 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/PlanParserSuite.scala ## @@ -1031,4 +1031,115 @@ class PlanParserSuit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469772259 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkScriptTransformationExec.scala ## @@ -0,0 +1,89 @@ +/* + * Licensed to the

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469781475 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/PlanParserSuite.scala ## @@ -1031,4 +1031,115 @@ class PlanParserSuit

[GitHub] [spark] SparkQA commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
SparkQA commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-673341123 **[Test build #127402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127402/testReport)** for PR 29414 at commit [`fc5bbce`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-673342179 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-673342179 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on a change in pull request #29415: [SPARK-32590][SQL] Remove fullOutput from RowDataSourceScanExec

2020-08-13 Thread GitBox
cloud-fan commented on a change in pull request #29415: URL: https://github.com/apache/spark/pull/29415#discussion_r469789913 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala ## @@ -143,7 +140,6 @@ case class RowDataSourceScanExec(

[GitHub] [spark] cloud-fan commented on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
cloud-fan commented on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673347928 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
SparkQA commented on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673348390 **[Test build #127403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127403/testReport)** for PR 29342 at commit [`f4f0b0f`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673349025 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673349025 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
SparkQA commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673352065 **[Test build #127404 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127404/testReport)** for PR 29360 at commit [`4a1350c`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
SparkQA commented on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673352418 **[Test build #127400 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127400/testReport)** for PR 29422 at commit [`626e285`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673301476 **[Test build #127400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127400/testReport)** for PR 29422 at commit [`626e285`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673353011 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673352784 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673352784 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673353011 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673353025 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127

[GitHub] [spark] cloud-fan commented on a change in pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
cloud-fan commented on a change in pull request #29342: URL: https://github.com/apache/spark/pull/29342#discussion_r469807522 ## File path: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java ## @@ -428,6 +428,62 @@ public MapIterator destructiveIterator() {

[GitHub] [spark] cloud-fan commented on a change in pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
cloud-fan commented on a change in pull request #29342: URL: https://github.com/apache/spark/pull/29342#discussion_r469809836 ## File path: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java ## @@ -428,6 +428,62 @@ public MapIterator destructiveIterator() {

[GitHub] [spark] SparkQA commented on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
SparkQA commented on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673366252 **[Test build #127401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127401/testReport)** for PR 29422 at commit [`16d0bc8`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673313561 **[Test build #127401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127401/testReport)** for PR 29422 at commit [`16d0bc8`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673366831 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673366831 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29422: [wip][testing][dnr] Decom fixes

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29422: URL: https://github.com/apache/spark/pull/29422#issuecomment-673366843 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127

[GitHub] [spark] cloud-fan commented on a change in pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
cloud-fan commented on a change in pull request #29342: URL: https://github.com/apache/spark/pull/29342#discussion_r469819019 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/ShuffledHashJoinExec.scala ## @@ -71,8 +85,210 @@ case class ShuffledHashJoi

[GitHub] [spark] cloud-fan commented on a change in pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
cloud-fan commented on a change in pull request #29342: URL: https://github.com/apache/spark/pull/29342#discussion_r469821082 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/ShuffledHashJoinExec.scala ## @@ -71,8 +85,210 @@ case class ShuffledHashJoi

[GitHub] [spark] cloud-fan commented on a change in pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
cloud-fan commented on a change in pull request #29342: URL: https://github.com/apache/spark/pull/29342#discussion_r469823249 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/ShuffledHashJoinExec.scala ## @@ -71,8 +85,210 @@ case class ShuffledHashJoi

[GitHub] [spark] cloud-fan commented on a change in pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
cloud-fan commented on a change in pull request #29342: URL: https://github.com/apache/spark/pull/29342#discussion_r469825588 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/ShuffledHashJoinExec.scala ## @@ -71,8 +85,210 @@ case class ShuffledHashJoi

[GitHub] [spark] maropu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
maropu commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469833812 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkScriptTransformationExec.scala ## @@ -0,0 +1,91 @@ +/* + * Licensed to the Apach

[GitHub] [spark] maropu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
maropu commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469834208 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkScriptTransformationExec.scala ## @@ -0,0 +1,91 @@ +/* + * Licensed to the Apach

[GitHub] [spark] maropu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
maropu commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469833912 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationExec.scala ## @@ -45,6 +45,8 @@ import org.apache.spark.

[GitHub] [spark] Karl-WangSK commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
Karl-WangSK commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673382458 retest this please This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [spark] beliefer commented on a change in pull request #28685: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

2020-08-13 Thread GitBox
beliefer commented on a change in pull request #28685: URL: https://github.com/apache/spark/pull/28685#discussion_r469835363 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/window/WindowFunctionFrame.scala ## @@ -151,10 +168,41 @@ final class OffsetWindowF

[GitHub] [spark] Karl-WangSK removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
Karl-WangSK removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673382458 retest this please This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [spark] SparkQA commented on pull request #28685: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

2020-08-13 Thread GitBox
SparkQA commented on pull request #28685: URL: https://github.com/apache/spark/pull/28685#issuecomment-673384225 **[Test build #127405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127405/testReport)** for PR 28685 at commit [`1ed69e1`](https://github.com

[GitHub] [spark] maropu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
maropu commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469834208 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkScriptTransformationExec.scala ## @@ -0,0 +1,91 @@ +/* + * Licensed to the Apach

[GitHub] [spark] maropu commented on a change in pull request #29421: [SPARK-32388][SQL]TRANSFORM when schema less should keep same with hive[

2020-08-13 Thread GitBox
maropu commented on a change in pull request #29421: URL: https://github.com/apache/spark/pull/29421#discussion_r469838596 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationExec.scala ## @@ -274,6 +275,14 @@ object HiveScriptIOSc

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28685: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28685: URL: https://github.com/apache/spark/pull/28685#issuecomment-673384776 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28685: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #28685: URL: https://github.com/apache/spark/pull/28685#issuecomment-673384776 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469852514 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkScriptTransformationExec.scala ## @@ -0,0 +1,91 @@ +/* + * Licensed to the

[GitHub] [spark] SaurabhChawla100 commented on pull request #29413: [SPARK-32597][CORE] Tune Event Drop in Async Event Queue

2020-08-13 Thread GitBox
SaurabhChawla100 commented on pull request #29413: URL: https://github.com/apache/spark/pull/29413#issuecomment-673398423 > sorry I'm still not seeing any difference here then increasing the size of the current queue? If both are not really allocating memory for the entire amount until run

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r469854572 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkScriptTransformationExec.scala ## @@ -0,0 +1,91 @@ +/* + * Licensed to the

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29421: [SPARK-32388][SQL]TRANSFORM when schema less should keep same with hive

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29421: URL: https://github.com/apache/spark/pull/29421#discussion_r469855638 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationExec.scala ## @@ -274,6 +275,14 @@ object HiveScri

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29421: [SPARK-32388][SQL]TRANSFORM when schema less should keep same with hive

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29421: URL: https://github.com/apache/spark/pull/29421#discussion_r469855638 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationExec.scala ## @@ -274,6 +275,14 @@ object HiveScri

[GitHub] [spark] SparkQA commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
SparkQA commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-673399976 **[Test build #127406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127406/testReport)** for PR 29414 at commit [`fdfc987`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-673400583 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-673400583 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SaurabhChawla100 edited a comment on pull request #29413: [SPARK-32597][CORE] Tune Event Drop in Async Event Queue

2020-08-13 Thread GitBox
SaurabhChawla100 edited a comment on pull request #29413: URL: https://github.com/apache/spark/pull/29413#issuecomment-673398423 > sorry I'm still not seeing any difference here then increasing the size of the current queue? If both are not really allocating memory for the entire amount un

[GitHub] [spark] SparkQA commented on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
SparkQA commented on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673413402 **[Test build #127403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127403/testReport)** for PR 29342 at commit [`f4f0b0f`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673348390 **[Test build #127403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127403/testReport)** for PR 29342 at commit [`f4f0b0f`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673414173 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29342: URL: https://github.com/apache/spark/pull/29342#issuecomment-673414173 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29333: [WIP][SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
SparkQA commented on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673417245 **[Test build #127407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127407/testReport)** for PR 29333 at commit [`2888457`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29333: [WIP][SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673417732 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29333: [WIP][SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673417732 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] ulysses-you commented on a change in pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
ulysses-you commented on a change in pull request #29423: URL: https://github.com/apache/spark/pull/29423#discussion_r469883959 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala ## @@ -1005,7 +1006,8 @@ private[hive] object HiveClientI

[GitHub] [spark] ulysses-you commented on a change in pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
ulysses-you commented on a change in pull request #29423: URL: https://github.com/apache/spark/pull/29423#discussion_r469884015 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveSQLViewSuite.scala ## @@ -137,4 +137,24 @@ class HiveSQLViewSuite exten

[GitHub] [spark] AmplabJenkins commented on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673423659 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673423659 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
SparkQA commented on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673426253 **[Test build #127408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127408/testReport)** for PR 29423 at commit [`5150279`](https://github.com

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29333: [WIP][SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
HyukjinKwon commented on a change in pull request #29333: URL: https://github.com/apache/spark/pull/29333#discussion_r469888319 ## File path: .github/workflows/master.yml ## @@ -9,7 +9,6 @@ on: - master jobs: - # TODO(SPARK-32248): Recover JDK 11 builds Review comment

[GitHub] [spark] HyukjinKwon commented on pull request #29333: [WIP][SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
HyukjinKwon commented on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673426729 I elaborated it in the PR description how it works and why I had to fork two plugins. This is an automated

[GitHub] [spark] Karl-WangSK commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
Karl-WangSK commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673426929 retest this please This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [spark] maropu commented on a change in pull request #29421: [SPARK-32388][SQL]TRANSFORM when schema less should keep same with hive

2020-08-13 Thread GitBox
maropu commented on a change in pull request #29421: URL: https://github.com/apache/spark/pull/29421#discussion_r469889057 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationExec.scala ## @@ -274,6 +275,14 @@ object HiveScriptIOSc

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29333: [WIP][SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
HyukjinKwon commented on a change in pull request #29333: URL: https://github.com/apache/spark/pull/29333#discussion_r469888902 ## File path: .github/workflows/master.yml ## @@ -27,21 +26,21 @@ jobs: # Kinesis tests depends on external Amazon kinesis service.

[GitHub] [spark] maropu commented on a change in pull request #29421: [SPARK-32388][SQL]TRANSFORM when schema less should keep same with hive

2020-08-13 Thread GitBox
maropu commented on a change in pull request #29421: URL: https://github.com/apache/spark/pull/29421#discussion_r469889057 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationExec.scala ## @@ -274,6 +275,14 @@ object HiveScriptIOSc

[GitHub] [spark] maropu commented on a change in pull request #29421: [SPARK-32388][SQL]TRANSFORM when schema less should keep same with hive

2020-08-13 Thread GitBox
maropu commented on a change in pull request #29421: URL: https://github.com/apache/spark/pull/29421#discussion_r469889961 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationExec.scala ## @@ -274,6 +275,14 @@ object HiveScriptIOSc

[GitHub] [spark] Karl-WangSK removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
Karl-WangSK removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673426929 retest this please This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [spark] AmplabJenkins commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673429679 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673429679 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on a change in pull request #29421: [SPARK-32388][SQL]TRANSFORM when schema less should keep same with hive

2020-08-13 Thread GitBox
maropu commented on a change in pull request #29421: URL: https://github.com/apache/spark/pull/29421#discussion_r469892680 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationSuite.scala ## @@ -182,7 +182,11 @@ class HiveScriptTran

[GitHub] [spark] SparkQA commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
SparkQA commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673432002 **[Test build #127409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127409/testReport)** for PR 29360 at commit [`5c2e630`](https://github.com

  1   2   3   4   5   >