[GitHub] [spark] SparkQA commented on pull request #32213: [SPARK-35114][SQL][TESTS] Add checks for ANSI intervals to `LiteralExpressionSuite`

2021-04-17 Thread GitBox
SparkQA commented on pull request #32213: URL: https://github.com/apache/spark/pull/32213#issuecomment-821939160 **[Test build #137526 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137526/testReport)** for PR 32213 at commit

[GitHub] [spark] SparkQA commented on pull request #32220: [SPARK-35122][SQL] Migrate CACHE/UNCACHE TABLE to use AnalysisOnlyCommand

2021-04-17 Thread GitBox
SparkQA commented on pull request #32220: URL: https://github.com/apache/spark/pull/32220#issuecomment-821939164 **[Test build #137525 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137525/testReport)** for PR 32220 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821933284 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32217: URL: https://github.com/apache/spark/pull/32217#issuecomment-821938983 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137518/

[GitHub] [spark] AmplabJenkins commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821938984 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137524/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32217: URL: https://github.com/apache/spark/pull/32217#issuecomment-821938983 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137518/ -- This

[GitHub] [spark] zhouyejoe commented on a change in pull request #32007: [SPARK-33350][SHUFFLE] Add support to DiskBlockManager to create merge directory and to get the local shuffle merged data

2021-04-17 Thread GitBox
zhouyejoe commented on a change in pull request #32007: URL: https://github.com/apache/spark/pull/32007#discussion_r615345038 ## File path: core/src/main/scala/org/apache/spark/storage/BlockId.scala ## @@ -87,6 +87,29 @@ case class ShufflePushBlockId(shuffleId: Int, mapIndex:

[GitHub] [spark] SparkQA removed a comment on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
SparkQA removed a comment on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821932631 **[Test build #137524 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137524/testReport)** for PR 30957 at commit

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821937078 **[Test build #137524 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137524/testReport)** for PR 30957 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
SparkQA removed a comment on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821916101 **[Test build #137517 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137517/testReport)** for PR 30957 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
SparkQA removed a comment on pull request #32217: URL: https://github.com/apache/spark/pull/32217#issuecomment-821921884 **[Test build #137518 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137518/testReport)** for PR 32217 at commit

[GitHub] [spark] MaxGekk commented on a change in pull request #32213: [SPARK-35114][SQL][TESTS] Add checks for ANSI intervals to `LiteralExpressionSuite`

2021-04-17 Thread GitBox
MaxGekk commented on a change in pull request #32213: URL: https://github.com/apache/spark/pull/32213#discussion_r615344413 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/LiteralExpressionSuite.scala ## @@ -200,8 +204,8 @@ class

[GitHub] [spark] MaxGekk commented on a change in pull request #32213: [SPARK-35114][SQL][TESTS] Add checks for ANSI intervals to `LiteralExpressionSuite`

2021-04-17 Thread GitBox
MaxGekk commented on a change in pull request #32213: URL: https://github.com/apache/spark/pull/32213#discussion_r615344413 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/LiteralExpressionSuite.scala ## @@ -200,8 +204,8 @@ class

[GitHub] [spark] imback82 opened a new pull request #32220: [SPARK-35122][SQL] Migrate CACHE/UNCACHE TABLE to use AnalysisOnlyCommand

2021-04-17 Thread GitBox
imback82 opened a new pull request #32220: URL: https://github.com/apache/spark/pull/32220 ### What changes were proposed in this pull request? Now that `AnalysisOnlyCommand` in introduced in #32032, `CacheTable` and `UncacheTable` can extend `AnalysisOnlyCommand` to

[GitHub] [spark] SparkQA commented on pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
SparkQA commented on pull request #32217: URL: https://github.com/apache/spark/pull/32217#issuecomment-821934714 **[Test build #137518 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137518/testReport)** for PR 32217 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821933284 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137517/ -- This

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821933184 **[Test build #137517 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137517/testReport)** for PR 30957 at commit

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821932631 **[Test build #137524 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137524/testReport)** for PR 30957 at commit

[GitHub] [spark] c21 commented on a change in pull request #32218: [SPARK-35121][SQL] Improve JoinSelection when join condition is not defined

2021-04-17 Thread GitBox
c21 commented on a change in pull request #32218: URL: https://github.com/apache/spark/pull/32218#discussion_r615341591 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala ## @@ -283,10 +283,13 @@ abstract class SparkStrategies extends

[GitHub] [spark] SparkQA commented on pull request #32218: [SPARK-35121][SQL] Improve JoinSelection when join condition is not defined

2021-04-17 Thread GitBox
SparkQA commented on pull request #32218: URL: https://github.com/apache/spark/pull/32218#issuecomment-821932550 **[Test build #137522 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137522/testReport)** for PR 32218 at commit

[GitHub] [spark] SparkQA commented on pull request #32219: [WIP][SPARK-35097][SQL] Add column name to SparkUpgradeException about ancient datetime

2021-04-17 Thread GitBox
SparkQA commented on pull request #32219: URL: https://github.com/apache/spark/pull/32219#issuecomment-821932552 **[Test build #137521 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137521/testReport)** for PR 32219 at commit

[GitHub] [spark] SparkQA commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
SparkQA commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821932566 **[Test build #137523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137523/testReport)** for PR 32216 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821932386 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137519/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32136: [WIP][SPARK-35022][CORE] Task Scheduling Plugin in Spark

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32136: URL: https://github.com/apache/spark/pull/32136#issuecomment-821932387 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42094/

[GitHub] [spark] AmplabJenkins commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821932386 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137519/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32136: [WIP][SPARK-35022][CORE] Task Scheduling Plugin in Spark

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32136: URL: https://github.com/apache/spark/pull/32136#issuecomment-821932387 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42094/ --

[GitHub] [spark] SparkQA commented on pull request #32136: [WIP][SPARK-35022][CORE] Task Scheduling Plugin in Spark

2021-04-17 Thread GitBox
SparkQA commented on pull request #32136: URL: https://github.com/apache/spark/pull/32136#issuecomment-821931345 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] c21 commented on a change in pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
c21 commented on a change in pull request #32216: URL: https://github.com/apache/spark/pull/32216#discussion_r615340012 ## File path: sql/core/src/test/resources/sql-tests/results/join-empty-relation.sql.out ## @@ -71,15 +71,15 @@ SELECT * FROM t1 LEFT SEMI JOIN empty_table

[GitHub] [spark] SparkQA removed a comment on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
SparkQA removed a comment on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821922125 **[Test build #137519 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137519/testReport)** for PR 32216 at commit

[GitHub] [spark] SparkQA commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
SparkQA commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821930154 **[Test build #137519 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137519/testReport)** for PR 32216 at commit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
AngersZh commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r615339162 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroDeserializer.scala ## @@ -62,10 +62,10 @@ private[sql] class

[GitHub] [spark] AngersZhuuuu opened a new pull request #32219: [WIP][SPARK-35097][SQL] Add column name to SparkUpgradeException about ancient datetime

2021-04-17 Thread GitBox
AngersZh opened a new pull request #32219: URL: https://github.com/apache/spark/pull/32219 ### What changes were proposed in this pull request? Improve error message ### Why are the changes needed? Improve error message ### Does this PR introduce _any_

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
AngersZh commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r615338825 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroDeserializer.scala ## @@ -62,10 +62,10 @@ private[sql] class

[GitHub] [spark] wangyum opened a new pull request #32218: [SPARK-35121][SQL] Improve JoinSelection when join condition is not defined

2021-04-17 Thread GitBox
wangyum opened a new pull request #32218: URL: https://github.com/apache/spark/pull/32218 ### What changes were proposed in this pull request? This pr improves `JoinSelection` when join condition is not defined. For example: ```scala spark.sql("set

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821927422 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137515/

[GitHub] [spark] AmplabJenkins commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821927422 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137515/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
SparkQA removed a comment on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821916008 **[Test build #137515 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137515/testReport)** for PR 32216 at commit

[GitHub] [spark] SparkQA commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
SparkQA commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821927303 **[Test build #137515 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137515/testReport)** for PR 32216 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821926956 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42093/

[GitHub] [spark] AmplabJenkins commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821926956 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42093/ --

[GitHub] [spark] SparkQA commented on pull request #32136: [WIP][SPARK-35022][CORE] Task Scheduling Plugin in Spark

2021-04-17 Thread GitBox
SparkQA commented on pull request #32136: URL: https://github.com/apache/spark/pull/32136#issuecomment-821926941 **[Test build #137520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137520/testReport)** for PR 32136 at commit

[GitHub] [spark] SparkQA commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
SparkQA commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821926950 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42093/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32217: URL: https://github.com/apache/spark/pull/32217#issuecomment-821926798 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42092/

[GitHub] [spark] AmplabJenkins commented on pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32217: URL: https://github.com/apache/spark/pull/32217#issuecomment-821926798 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42092/ --

[GitHub] [spark] SparkQA commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
SparkQA commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821926377 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42093/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
SparkQA commented on pull request #32217: URL: https://github.com/apache/spark/pull/32217#issuecomment-821925158 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] HyukjinKwon closed pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
HyukjinKwon closed pull request #32217: URL: https://github.com/apache/spark/pull/32217 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] HyukjinKwon commented on pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
HyukjinKwon commented on pull request #32217: URL: https://github.com/apache/spark/pull/32217#issuecomment-821924344 Seems working great! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] HyukjinKwon commented on pull request #32214: [SPARK-35117][UI] Change progress bar back to highlight ratio of tasks in progress

2021-04-17 Thread GitBox
HyukjinKwon commented on pull request #32214: URL: https://github.com/apache/spark/pull/32214#issuecomment-821924127 cc @sarutak and @gengliangwang FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #32215: [MINOR][INFRA] Upgrade Jira client to 2.0.0

2021-04-17 Thread GitBox
dongjoon-hyun commented on pull request #32215: URL: https://github.com/apache/spark/pull/32215#issuecomment-821923871 Thank you, @HyukjinKwon ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] HyukjinKwon commented on pull request #32163: [SPARK-35086][SQL][CORE] --verbose should be passed to Spark SQL CLI too

2021-04-17 Thread GitBox
HyukjinKwon commented on pull request #32163: URL: https://github.com/apache/spark/pull/32163#issuecomment-821923361 I switched the JIRA between SPARK-35068 and SPARK-35086. cc @MaxGekk FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] HyukjinKwon commented on pull request #32163: [SPARK-35086][SQL][CORE] --verbose should be passed to Spark SQL CLI too

2021-04-17 Thread GitBox
HyukjinKwon commented on pull request #32163: URL: https://github.com/apache/spark/pull/32163#issuecomment-821923100 The JIRA number here was incorrect. It had to be SPARK-35068. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
SparkQA commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821922125 **[Test build #137519 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137519/testReport)** for PR 32216 at commit

[GitHub] [spark] SparkQA commented on pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
SparkQA commented on pull request #32217: URL: https://github.com/apache/spark/pull/32217#issuecomment-821921884 **[Test build #137518 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137518/testReport)** for PR 32217 at commit

[GitHub] [spark] HyukjinKwon opened a new pull request #32217: [DO-NOT-MERGE] GitHub Actions build check

2021-04-17 Thread GitBox
HyukjinKwon opened a new pull request #32217: URL: https://github.com/apache/spark/pull/32217 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821921499 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42089/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821921498 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42091/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32212: [SPARK-35116][SQL][TESTS] The generated data fits the precision of DayTimeIntervalType in spark

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32212: URL: https://github.com/apache/spark/pull/32212#issuecomment-821921500 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42090/

[GitHub] [spark] AmplabJenkins commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821921498 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42091/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821921499 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42089/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32212: [SPARK-35116][SQL][TESTS] The generated data fits the precision of DayTimeIntervalType in spark

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32212: URL: https://github.com/apache/spark/pull/32212#issuecomment-821921500 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42090/ --

[GitHub] [spark] HyukjinKwon commented on pull request #32205: [SPARK-35105][SQL] Support multiple paths for ADD FILE/JAR/ARCHIVE commands

2021-04-17 Thread GitBox
HyukjinKwon commented on pull request #32205: URL: https://github.com/apache/spark/pull/32205#issuecomment-821921300 @sarutak would you mind rebasing your branch against the latest master branch in Apache Spark? there have been a couple of CI updates so it has to be synced. -- This is

[GitHub] [spark] HyukjinKwon commented on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

2021-04-17 Thread GitBox
HyukjinKwon commented on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-821920716 (I will address the disabled GitHub Actions in forked repo, and unsynced branch issue soon this week to properly guide users) -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
HyukjinKwon commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r615331427 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroDeserializer.scala ## @@ -62,10 +62,10 @@ private[sql] class

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
HyukjinKwon commented on a change in pull request #30957: URL: https://github.com/apache/spark/pull/30957#discussion_r615331372 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroDeserializer.scala ## @@ -62,10 +62,10 @@ private[sql] class

[GitHub] [spark] SparkQA commented on pull request #32212: [SPARK-35116][SQL][TESTS] The generated data fits the precision of DayTimeIntervalType in spark

2021-04-17 Thread GitBox
SparkQA commented on pull request #32212: URL: https://github.com/apache/spark/pull/32212#issuecomment-821920551 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42090/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
HyukjinKwon commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821920261 @wangyum, looks like your branch was not synced to the latest branch in Apache Spark. do you mind rebasing it please? -- This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821920219 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32212: [SPARK-35116][SQL][TESTS] The generated data fits the precision of DayTimeIntervalType in spark

2021-04-17 Thread GitBox
SparkQA commented on pull request #32212: URL: https://github.com/apache/spark/pull/32212#issuecomment-821920199 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42090/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
SparkQA commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821920135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] HyukjinKwon closed pull request #32215: [MINOR][INFRA] Upgrade Jira client to 2.0.0

2021-04-17 Thread GitBox
HyukjinKwon closed pull request #32215: URL: https://github.com/apache/spark/pull/32215 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] HyukjinKwon closed pull request #32193: [SPARK-35101][INFRA] Add GitHub status check in PR instead of a comment

2021-04-17 Thread GitBox
HyukjinKwon closed pull request #32193: URL: https://github.com/apache/spark/pull/32193 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] HyukjinKwon commented on pull request #32215: [MINOR][INFRA] Upgrade Jira client to 2.0.0

2021-04-17 Thread GitBox
HyukjinKwon commented on pull request #32215: URL: https://github.com/apache/spark/pull/32215#issuecomment-821920060 Merged to master -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] HyukjinKwon commented on pull request #32193: [SPARK-35101][INFRA] Add GitHub status check in PR instead of a comment

2021-04-17 Thread GitBox
HyukjinKwon commented on pull request #32193: URL: https://github.com/apache/spark/pull/32193#issuecomment-821919995 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
SparkQA commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821916101 **[Test build #137517 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137517/testReport)** for PR 30957 at commit

[GitHub] [spark] SparkQA commented on pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
SparkQA commented on pull request #32216: URL: https://github.com/apache/spark/pull/32216#issuecomment-821916008 **[Test build #137515 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137515/testReport)** for PR 32216 at commit

[GitHub] [spark] SparkQA commented on pull request #32212: [SPARK-35116][SQL][TESTS] The generated data fits the precision of DayTimeIntervalType in spark

2021-04-17 Thread GitBox
SparkQA commented on pull request #32212: URL: https://github.com/apache/spark/pull/32212#issuecomment-821916024 **[Test build #137516 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137516/testReport)** for PR 32212 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32215: [MINOR][INFRA] Upgrade Jira client to 2.0.0

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32215: URL: https://github.com/apache/spark/pull/32215#issuecomment-821915911 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137513/

[GitHub] [spark] AmplabJenkins commented on pull request #32215: [MINOR][INFRA] Upgrade Jira client to 2.0.0

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32215: URL: https://github.com/apache/spark/pull/32215#issuecomment-821915911 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137513/ -- This

[GitHub] [spark] AngersZhuuuu commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
AngersZh commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821915593 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] github-actions[bot] commented on pull request #30957: [SPARK-31937][SQL] Support processing ArrayType/MapType/StructType data using no-serde mode script transform

2021-04-17 Thread GitBox
github-actions[bot] commented on pull request #30957: URL: https://github.com/apache/spark/pull/30957#issuecomment-821915581 **[Test build #759730241](https://github.com/AngersZh/spark/actions/runs/759730241)** for PR 30957 at commit

[GitHub] [spark] github-actions[bot] commented on pull request #32212: [SPARK-35116] The generated data fits the precision of DayTimeIntervalType in spark

2021-04-17 Thread GitBox
github-actions[bot] commented on pull request #32212: URL: https://github.com/apache/spark/pull/32212#issuecomment-821915542 **[Test build #759729498](https://github.com/beliefer/spark/actions/runs/759729498)** for PR 32212 at commit

[GitHub] [spark] github-actions[bot] commented on pull request #32212: [SPARK-35116] The generated data fits the precision of DayTimeIntervalType in spark

2021-04-17 Thread GitBox
github-actions[bot] commented on pull request #32212: URL: https://github.com/apache/spark/pull/32212#issuecomment-821914105 **[Test build #759707876](https://github.com/beliefer/spark/actions/runs/759707876)** for PR 32212 at commit

[GitHub] [spark] beliefer commented on a change in pull request #32212: [SPARK-35116] The generated data fits the precision of DayTimeIntervalType in spark

2021-04-17 Thread GitBox
beliefer commented on a change in pull request #32212: URL: https://github.com/apache/spark/pull/32212#discussion_r615325950 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/RandomDataGenerator.scala ## @@ -275,8 +275,13 @@ object RandomDataGenerator {

[GitHub] [spark] SparkQA removed a comment on pull request #32215: [MINOR][INFRA] Upgrade Jira client to 2.0.0

2021-04-17 Thread GitBox
SparkQA removed a comment on pull request #32215: URL: https://github.com/apache/spark/pull/32215#issuecomment-821898290 **[Test build #137513 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137513/testReport)** for PR 32215 at commit

[GitHub] [spark] wangyum opened a new pull request #32216: [SPARK-35118][SQL] Propagate empty relation through Join if join condition is empty

2021-04-17 Thread GitBox
wangyum opened a new pull request #32216: URL: https://github.com/apache/spark/pull/32216 ### What changes were proposed in this pull request? This pr makes propagate empty relation through Join if join condition is empty. For example: ```scala spark.sql("create table t1 using

[GitHub] [spark] SparkQA commented on pull request #32215: [MINOR][INFRA] Upgrade Jira client to 2.0.0

2021-04-17 Thread GitBox
SparkQA commented on pull request #32215: URL: https://github.com/apache/spark/pull/32215#issuecomment-821912068 **[Test build #137513 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137513/testReport)** for PR 32215 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

2021-04-17 Thread GitBox
SparkQA removed a comment on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-821904142 **[Test build #137514 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137514/testReport)** for PR 32146 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-821910040 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137514/

[GitHub] [spark] AmplabJenkins commented on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-821910040 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137514/ -- This

[GitHub] [spark] SparkQA commented on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

2021-04-17 Thread GitBox
SparkQA commented on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-821909981 **[Test build #137514 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137514/testReport)** for PR 32146 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32213: [SPARK-35114][SQL][TESTS] Add checks for ANSI intervals to `LiteralExpressionSuite`

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32213: URL: https://github.com/apache/spark/pull/32213#issuecomment-821909953 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137510/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

2021-04-17 Thread GitBox
AmplabJenkins removed a comment on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-821909951 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42088/

[GitHub] [spark] AmplabJenkins commented on pull request #32213: [SPARK-35114][SQL][TESTS] Add checks for ANSI intervals to `LiteralExpressionSuite`

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32213: URL: https://github.com/apache/spark/pull/32213#issuecomment-821909953 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137510/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

2021-04-17 Thread GitBox
AmplabJenkins commented on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-821909951 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42088/ --

[GitHub] [spark] SparkQA commented on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

2021-04-17 Thread GitBox
SparkQA commented on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-821908442 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] github-actions[bot] commented on pull request #29922: [SPARK-32723] [WEBUI] Upgrade to jQuery 3.5.1, 2.4 backport.

2021-04-17 Thread GitBox
github-actions[bot] commented on pull request #29922: URL: https://github.com/apache/spark/pull/29922#issuecomment-821906992 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue

[GitHub] [spark] github-actions[bot] commented on pull request #30619: [SPARK-31711][CORE][FOLLOWUP] Move executorSourceLocalModeOnly to sparkEnv

2021-04-17 Thread GitBox
github-actions[bot] commented on pull request #30619: URL: https://github.com/apache/spark/pull/30619#issuecomment-821906987 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue

[GitHub] [spark] github-actions[bot] closed pull request #30891: [WIP][SPARK-33880][BUILD] Replace Hadoop profile names by using hadoop-2 and hadoop-3

2021-04-17 Thread GitBox
github-actions[bot] closed pull request #30891: URL: https://github.com/apache/spark/pull/30891 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [spark] github-actions[bot] commented on pull request #30812: [SPARK-33814][SS] Provide preferred locations for stateful operations without reported state store locations

2021-04-17 Thread GitBox
github-actions[bot] commented on pull request #30812: URL: https://github.com/apache/spark/pull/30812#issuecomment-821906981 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue

  1   2   3   >