[GitHub] [spark] SparkQA commented on pull request #30340: [SPARK-33426][SQL][TESTS] Unify Hive SHOW TABLES tests

SparkQA commented on pull request #30340: URL: https://github.com/apache/spark/pull/30340#issuecomment-725906218 **[Test build #130978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130978/testReport)** for PR 30340 at commit

[GitHub] [spark] MaxGekk commented on a change in pull request #30340: [SPARK-33426][SQL][TESTS] Unify Hive SHOW TABLES tests

MaxGekk commented on a change in pull request #30340: URL: https://github.com/apache/spark/pull/30340#discussion_r521899535 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/ShowTablesSuite.scala ## @@ -39,7 +39,7 @@ trait ShowTablesSuite extends

[GitHub] [spark] MaxGekk commented on a change in pull request #30340: [SPARK-33426][SQL][TESTS] Unify Hive SHOW TABLES tests

MaxGekk commented on a change in pull request #30340: URL: https://github.com/apache/spark/pull/30340#discussion_r521899269 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/ShowTablesSuite.scala ## @@ -58,35 +58,38 @@ trait ShowTablesSuite extends

[GitHub] [spark] mridulm commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

mridulm commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-725904598 Can you make a followup patch for this @otterc ? Please do test it locally on both hadoop-2.7 and default, thanks !

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30178: [SPARK-33278][SQL] Improve the performance for FIRST_VALUE

AmplabJenkins removed a comment on pull request #30178: URL: https://github.com/apache/spark/pull/30178#issuecomment-725903800 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30178: [SPARK-33278][SQL] Improve the performance for FIRST_VALUE

AmplabJenkins commented on pull request #30178: URL: https://github.com/apache/spark/pull/30178#issuecomment-725903800 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30178: [SPARK-33278][SQL] Improve the performance for FIRST_VALUE

SparkQA removed a comment on pull request #30178: URL: https://github.com/apache/spark/pull/30178#issuecomment-725797504 **[Test build #130959 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130959/testReport)** for PR 30178 at commit

[GitHub] [spark] SparkQA commented on pull request #30178: [SPARK-33278][SQL] Improve the performance for FIRST_VALUE

SparkQA commented on pull request #30178: URL: https://github.com/apache/spark/pull/30178#issuecomment-725902747 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #30009: [SPARK-32907][ML][PYTHON] adaptively blockify instances - LinearSVC

SparkQA commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725902842 **[Test build #130977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130977/testReport)** for PR 30009 at commit

[GitHub] [spark] beliefer commented on a change in pull request #30178: [SPARK-33278][SQL] Improve the performance for FIRST_VALUE

beliefer commented on a change in pull request #30178: URL: https://github.com/apache/spark/pull/30178#discussion_r521894055 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeWindowFunctionsSuite.scala ## @@ -0,0 +1,76 @@ +/* + *

[GitHub] [spark] zhengruifeng commented on pull request #30009: [SPARK-32907][ML][PYTHON] adaptively blockify instances - LinearSVC

zhengruifeng commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725899630 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

AmplabJenkins removed a comment on pull request #29950: URL: https://github.com/apache/spark/pull/29950#issuecomment-725898127 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

AmplabJenkins commented on pull request #29950: URL: https://github.com/apache/spark/pull/29950#issuecomment-725898127 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

SparkQA commented on pull request #29950: URL: https://github.com/apache/spark/pull/29950#issuecomment-725898102 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35578/

[GitHub] [spark] cloud-fan commented on a change in pull request #30178: [SPARK-33278][SQL] Improve the performance for FIRST_VALUE

cloud-fan commented on a change in pull request #30178: URL: https://github.com/apache/spark/pull/30178#discussion_r521890293 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeWindowFunctionsSuite.scala ## @@ -0,0 +1,76 @@ +/* + *

[GitHub] [spark] MaxGekk commented on a change in pull request #30340: [SPARK-33426][SQL][TESTS] Unify Hive SHOW TABLES tests

MaxGekk commented on a change in pull request #30340: URL: https://github.com/apache/spark/pull/30340#discussion_r521888901 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/command/ShowTablesSuite.scala ## @@ -0,0 +1,49 @@ +/* + * Licensed to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

AmplabJenkins removed a comment on pull request #30341: URL: https://github.com/apache/spark/pull/30341#issuecomment-725894068 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] cloud-fan commented on a change in pull request #30340: [SPARK-33426][SQL][TESTS] Unify Hive SHOW TABLES tests

cloud-fan commented on a change in pull request #30340: URL: https://github.com/apache/spark/pull/30340#discussion_r521888344 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/command/ShowTablesSuite.scala ## @@ -0,0 +1,49 @@ +/* + * Licensed to the

[GitHub] [spark] AmplabJenkins commented on pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

AmplabJenkins commented on pull request #30341: URL: https://github.com/apache/spark/pull/30341#issuecomment-725894068 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] MaxGekk commented on a change in pull request #30340: [SPARK-33426][SQL][TESTS] Unify Hive SHOW TABLES tests

MaxGekk commented on a change in pull request #30340: URL: https://github.com/apache/spark/pull/30340#discussion_r521887126 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/command/ShowTablesSuite.scala ## @@ -0,0 +1,49 @@ +/* + * Licensed to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30332: [SPARK-33419][SQL] Unexpected behavior when using SET commands before a query in SparkSession.sql

AmplabJenkins removed a comment on pull request #30332: URL: https://github.com/apache/spark/pull/30332#issuecomment-725892301 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30332: [SPARK-33419][SQL] Unexpected behavior when using SET commands before a query in SparkSession.sql

SparkQA commented on pull request #30332: URL: https://github.com/apache/spark/pull/30332#issuecomment-725892279 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35577/

[GitHub] [spark] AmplabJenkins commented on pull request #30332: [SPARK-33419][SQL] Unexpected behavior when using SET commands before a query in SparkSession.sql

AmplabJenkins commented on pull request #30332: URL: https://github.com/apache/spark/pull/30332#issuecomment-725892301 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30346: [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

AmplabJenkins removed a comment on pull request #30346: URL: https://github.com/apache/spark/pull/30346#issuecomment-725887862 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30346: [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

AmplabJenkins removed a comment on pull request #30346: URL: https://github.com/apache/spark/pull/30346#issuecomment-725887860 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30346: [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

SparkQA commented on pull request #30346: URL: https://github.com/apache/spark/pull/30346#issuecomment-725887848 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35576/

[GitHub] [spark] AmplabJenkins commented on pull request #30346: [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

AmplabJenkins commented on pull request #30346: URL: https://github.com/apache/spark/pull/30346#issuecomment-725887860 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

SparkQA commented on pull request #29950: URL: https://github.com/apache/spark/pull/29950#issuecomment-725886039 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35578/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30210: [SPARK-33259][SS] Disable streaming query with possible correctness issue by default

dongjoon-hyun commented on a change in pull request #30210: URL: https://github.com/apache/spark/pull/30210#discussion_r521880433 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1382,8 +1382,8 @@ object SQLConf {

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30009: [SPARK-32907][ML][PYTHON] adaptively blockify instances - LinearSVC

AmplabJenkins removed a comment on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725884560 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30009: [SPARK-32907][ML][PYTHON] adaptively blockify instances - LinearSVC

AmplabJenkins removed a comment on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725884551 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30009: [SPARK-32907][ML][PYTHON] adaptively blockify instances - LinearSVC

AmplabJenkins commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725884551 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30009: [SPARK-32907][ML][PYTHON] adaptively blockify instances - LinearSVC

SparkQA commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725884545 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35575/

[GitHub] [spark] SparkQA commented on pull request #30210: [SPARK-33259][SS] Disable streaming query with possible correctness issue by default

SparkQA commented on pull request #30210: URL: https://github.com/apache/spark/pull/30210#issuecomment-725882783 **[Test build #130975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130975/testReport)** for PR 30210 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30310: [SPARK-33408][K8S][R][3.0] Use R 3.6.3 in K8s R image

dongjoon-hyun commented on pull request #30310: URL: https://github.com/apache/spark/pull/30310#issuecomment-725882366 Thank you, @HyukjinKwon and @viirya ! This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on pull request #30130: [SPARK-33408][SPARK-32354][K8S][R] Use R 3.6.3 in K8s R image and re-enable RTestsSuite

dongjoon-hyun commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-725882115 Thank you, @HyukjinKwon and @viirya ! This is an automated message from the Apache Git Service. To

[GitHub] [spark] c21 commented on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

c21 commented on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-725881102 cc @cloud-fan , @HeartSaVioR , @xuanyuanking , @sameeragarwal if you guys have time to take a look, thanks. This

[GitHub] [spark] c21 commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

c21 commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r521876131 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -384,239 +384,166 @@ class

[GitHub] [spark] c21 commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

c21 commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r521876356 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -384,239 +384,166 @@ class

[GitHub] [spark] SparkQA commented on pull request #30332: [SPARK-33419][SQL] Unexpected behavior when using SET commands before a query in SparkSession.sql

SparkQA commented on pull request #30332: URL: https://github.com/apache/spark/pull/30332#issuecomment-725879801 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35577/

[GitHub] [spark] SparkQA commented on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

SparkQA commented on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-725879513 **[Test build #130974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130974/testReport)** for PR 30347 at commit

[GitHub] [spark] c21 commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

c21 commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r521875415 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -384,239 +384,166 @@ class

[GitHub] [spark] c21 commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

c21 commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r521875309 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -384,239 +384,166 @@ class

[GitHub] [spark] c21 commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

c21 commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r521874667 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -384,239 +384,166 @@ class

[GitHub] [spark] c21 opened a new pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

c21 opened a new pull request #30347: URL: https://github.com/apache/spark/pull/30347 ### What changes were proposed in this pull request? This PR is a followup from https://github.com/apache/spark/pull/30076 to refactor unit test of stream-stream join in

[GitHub] [spark] SparkQA commented on pull request #30346: [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

SparkQA commented on pull request #30346: URL: https://github.com/apache/spark/pull/30346#issuecomment-725877267 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35576/

[GitHub] [spark] SparkQA commented on pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

SparkQA commented on pull request #30341: URL: https://github.com/apache/spark/pull/30341#issuecomment-725876366 **[Test build #130973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130973/testReport)** for PR 30341 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30178: [SPARK-33278][SQL] Improve the performance for FIRST_VALUE

AmplabJenkins removed a comment on pull request #30178: URL: https://github.com/apache/spark/pull/30178#issuecomment-725868615 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30297: [SPARK-33386][SQL] Accessing array elements in ElementAt/Elt/GetArrayItem should failed if index is out of bound

AmplabJenkins removed a comment on pull request #30297: URL: https://github.com/apache/spark/pull/30297#issuecomment-725873931 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

AmplabJenkins removed a comment on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725872196 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30178: [SPARK-33278][SQL] Improve the performance for FIRST_VALUE

AmplabJenkins removed a comment on pull request #30178: URL: https://github.com/apache/spark/pull/30178#issuecomment-725868607 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #30344: [SPARK-30294][SS][FOLLOW-UP] Directly override RDD methods

SparkQA removed a comment on pull request #30344: URL: https://github.com/apache/spark/pull/30344#issuecomment-725771625 **[Test build #130954 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130954/testReport)** for PR 30344 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

SparkQA removed a comment on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725848161 **[Test build #130969 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130969/testReport)** for PR 30009 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30344: [SPARK-30294][SS][FOLLOW-UP] Directly override RDD methods

AmplabJenkins removed a comment on pull request #30344: URL: https://github.com/apache/spark/pull/30344#issuecomment-725868947 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30346: [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

SparkQA removed a comment on pull request #30346: URL: https://github.com/apache/spark/pull/30346#issuecomment-725858399 **[Test build #130970 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130970/testReport)** for PR 30346 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

AmplabJenkins removed a comment on pull request #30341: URL: https://github.com/apache/spark/pull/30341#issuecomment-725867045 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

SparkQA removed a comment on pull request #30341: URL: https://github.com/apache/spark/pull/30341#issuecomment-725776270 **[Test build #130955 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130955/testReport)** for PR 30341 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30346: [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

AmplabJenkins removed a comment on pull request #30346: URL: https://github.com/apache/spark/pull/30346#issuecomment-725868043 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] viirya commented on pull request #30210: [SPARK-33259][SS] Disable streaming query with possible correctness issue by default

viirya commented on pull request #30210: URL: https://github.com/apache/spark/pull/30210#issuecomment-725874258 > Shall we finalize and merge this PR by address @HeartSaVioR 's comments, @viirya ? Yeah, I will address these comments.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30297: [SPARK-33386][SQL] Accessing array elements in ElementAt/Elt/GetArrayItem should failed if index is out of bound

AmplabJenkins removed a comment on pull request #30297: URL: https://github.com/apache/spark/pull/30297#issuecomment-725873924 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

SparkQA commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725874235 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35575/

[GitHub] [spark] SparkQA commented on pull request #30297: [SPARK-33386][SQL] Accessing array elements in ElementAt/Elt/GetArrayItem should failed if index is out of bound

SparkQA commented on pull request #30297: URL: https://github.com/apache/spark/pull/30297#issuecomment-725873907 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35574/

[GitHub] [spark] AmplabJenkins commented on pull request #30297: [SPARK-33386][SQL] Accessing array elements in ElementAt/Elt/GetArrayItem should failed if index is out of bound

AmplabJenkins commented on pull request #30297: URL: https://github.com/apache/spark/pull/30297#issuecomment-725873924 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

AmplabJenkins commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725872196 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon closed pull request #30310: [SPARK-33408][K8S][R][3.0] Use R 3.6.3 in K8s R image

HyukjinKwon closed pull request #30310: URL: https://github.com/apache/spark/pull/30310 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon closed pull request #30130: [SPARK-33408][SPARK-32354][K8S][R] Use R 3.6.3 in K8s R image and re-enable RTestsSuite

HyukjinKwon closed pull request #30130: URL: https://github.com/apache/spark/pull/30130 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30310: [SPARK-33408][K8S][R][3.0] Use R 3.6.3 in K8s R image

HyukjinKwon commented on pull request #30310: URL: https://github.com/apache/spark/pull/30310#issuecomment-725871785 Merged to branch-3.0. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

SparkQA commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-725871798 **[Test build #130969 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130969/testReport)** for PR 30009 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #30130: [SPARK-33408][SPARK-32354][K8S][R] Use R 3.6.3 in K8s R image and re-enable RTestsSuite

HyukjinKwon commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-725871736 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] viirya commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

viirya commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r521867969 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -539,6 +539,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] viirya commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

viirya commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r521867300 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ExpressionProxy.scala ## @@ -0,0 +1,57 @@ +/* + * Licensed to the

[GitHub] [spark] AmplabJenkins commented on pull request #30344: [SPARK-30294][SS][FOLLOW-UP] Directly override RDD methods

AmplabJenkins commented on pull request #30344: URL: https://github.com/apache/spark/pull/30344#issuecomment-725868947 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] otterc commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

otterc commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-725868760 I think there is something different with how the `network-yarn` module is build. I see that there existed

[GitHub] [spark] viirya commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

viirya commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r521866385 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -539,6 +539,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] HyukjinKwon commented on pull request #30346: [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

HyukjinKwon commented on pull request #30346: URL: https://github.com/apache/spark/pull/30346#issuecomment-725868654 It's pretty short, nice. @zero323 mind taking a quick look when you're available? This is an automated

[GitHub] [spark] AmplabJenkins commented on pull request #30178: [SPARK-33278][SQL] Improve the performance for FIRST_VALUE

AmplabJenkins commented on pull request #30178: URL: https://github.com/apache/spark/pull/30178#issuecomment-725868607 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] liucht-inspur commented on a change in pull request #30335: [SPARK-33422][SQL][DOC] Fix the correct display of left menu item

liucht-inspur commented on a change in pull request #30335: URL: https://github.com/apache/spark/pull/30335#discussion_r521866229 ## File path: docs/css/main.css ## @@ -325,6 +325,7 @@ a.anchorjs-link:hover { text-decoration: none; } border-bottom-width: 0px; margin-top:

[GitHub] [spark] SparkQA commented on pull request #30178: [SPARK-33278][SQL] Improve the performance for FIRST_VALUE

SparkQA commented on pull request #30178: URL: https://github.com/apache/spark/pull/30178#issuecomment-725868588 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35573/

[GitHub] [spark] AmplabJenkins commented on pull request #30346: [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

AmplabJenkins commented on pull request #30346: URL: https://github.com/apache/spark/pull/30346#issuecomment-725868043 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30344: [SPARK-30294][SS][FOLLOW-UP] Directly override RDD methods

SparkQA commented on pull request #30344: URL: https://github.com/apache/spark/pull/30344#issuecomment-725867813 **[Test build #130954 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130954/testReport)** for PR 30344 at commit

[GitHub] [spark] SparkQA commented on pull request #30346: [SPARK-33253][PYTHON][DOCS] Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

SparkQA commented on pull request #30346: URL: https://github.com/apache/spark/pull/30346#issuecomment-725867759 **[Test build #130970 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130970/testReport)** for PR 30346 at commit

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

dongjoon-hyun commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r521865514 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -539,6 +539,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] HeartSaVioR commented on pull request #30210: [SPARK-33259][SS] Disable streaming query with possible correctness issue by default

HeartSaVioR commented on pull request #30210: URL: https://github.com/apache/spark/pull/30210#issuecomment-725867167 > Let's also mention the behavior change in ss-migration-guide.md Let's make sure this review comment is also addressed as well. I just skipped mentioning it as it's

[GitHub] [spark] AmplabJenkins commented on pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

AmplabJenkins commented on pull request #30341: URL: https://github.com/apache/spark/pull/30341#issuecomment-725867045 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

SparkQA commented on pull request #29950: URL: https://github.com/apache/spark/pull/29950#issuecomment-725866882 **[Test build #130972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130972/testReport)** for PR 29950 at commit

[GitHub] [spark] SparkQA commented on pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

SparkQA commented on pull request #30341: URL: https://github.com/apache/spark/pull/30341#issuecomment-725866165 **[Test build #130955 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130955/testReport)** for PR 30341 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

dongjoon-hyun commented on pull request #29950: URL: https://github.com/apache/spark/pull/29950#issuecomment-725865830 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun commented on pull request #29950: [SPARK-32945][SQL] Avoid collapsing projects if reaching max allowed common exprs

dongjoon-hyun commented on pull request #29950: URL: https://github.com/apache/spark/pull/29950#issuecomment-725865698 Oops. Sorry for being late, @viirya . This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #30210: [SPARK-33259][SS] Disable streaming query with possible correctness issue by default

dongjoon-hyun edited a comment on pull request #30210: URL: https://github.com/apache/spark/pull/30210#issuecomment-725865245 Shall we finalize and merge this PR by address @HeartSaVioR 's comments, @viirya ? This is an

[GitHub] [spark] dongjoon-hyun commented on pull request #30210: [SPARK-33259][SS] Disable streaming query with possible correctness issue by default

dongjoon-hyun commented on pull request #30210: URL: https://github.com/apache/spark/pull/30210#issuecomment-725865245 Shall we finalize and merge this PR by address @HeartSaVioR 's comments? This is an automated message

[GitHub] [spark] dongjoon-hyun commented on pull request #30310: [SPARK-33408][K8S][R][3.0] Use R 3.6.3 in K8s R image

dongjoon-hyun commented on pull request #30310: URL: https://github.com/apache/spark/pull/30310#issuecomment-725864414 Hi, @viirya Could you review this? This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #30130: [SPARK-33408][SPARK-32354][K8S][R] Use R 3.6.3 in K8s R image and re-enable RTestsSuite

dongjoon-hyun edited a comment on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-725863868 Hi, @viirya . Could you review this? This recovers K8s R integration test for Apache Spark 3.1. All tests including K8s IT passed.

[GitHub] [spark] dongjoon-hyun commented on pull request #30130: [SPARK-33408][SPARK-32354][K8S][R] Use R 3.6.3 in K8s R image and re-enable RTestsSuite

dongjoon-hyun commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-725863868 Hi, @viirya . Could you review this? This recovers K8s R integration test for Apache Spark 3.1. This is

[GitHub] [spark] SparkQA commented on pull request #30297: [SPARK-33386][SQL] Accessing array elements in ElementAt/Elt/GetArrayItem should failed if index is out of bound

SparkQA commented on pull request #30297: URL: https://github.com/apache/spark/pull/30297#issuecomment-725863799 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35574/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

dongjoon-hyun commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r521862019 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -539,6 +539,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

dongjoon-hyun commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r521861854 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -539,6 +539,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30330: [SPARK-33421][SQL] Support Greatest and Least in Expression Canonicalize

AmplabJenkins removed a comment on pull request #30330: URL: https://github.com/apache/spark/pull/30330#issuecomment-725862216 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30330: [SPARK-33421][SQL] Support Greatest and Least in Expression Canonicalize

SparkQA commented on pull request #30330: URL: https://github.com/apache/spark/pull/30330#issuecomment-725862195 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35572/

[GitHub] [spark] AmplabJenkins commented on pull request #30330: [SPARK-33421][SQL] Support Greatest and Least in Expression Canonicalize

AmplabJenkins commented on pull request #30330: URL: https://github.com/apache/spark/pull/30330#issuecomment-725862216 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

dongjoon-hyun commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r521861048 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ExpressionProxy.scala ## @@ -0,0 +1,57 @@ +/* + * Licensed to

  1   2   3   4   5   6   7   8   9   10   >