[GitHub] [spark] SparkQA commented on pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
SparkQA commented on pull request #33238: URL: https://github.com/apache/spark/pull/33238#issuecomment-875305184 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45251/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33239: [WIP][SPARK-36030][SQL] Support DS v2 metrics at writing path

2021-07-06 Thread GitBox
SparkQA commented on pull request #33239: URL: https://github.com/apache/spark/pull/33239#issuecomment-875304144 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45250/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-06 Thread GitBox
SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-875303768 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45247/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33243: [SPARK-36016][SQL] Support TimestampNTZType in expression ApproxCountDistinctForIntervals

2021-07-06 Thread GitBox
SparkQA commented on pull request #33243: URL: https://github.com/apache/spark/pull/33243#issuecomment-875303096 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45249/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
SparkQA commented on pull request #33238: URL: https://github.com/apache/spark/pull/33238#issuecomment-875301851 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45248/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-06 Thread GitBox
SparkQA removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-875237620 **[Test build #140730 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140730/testReport)** for PR 32959 at commit

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-06 Thread GitBox
SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-875301018 **[Test build #140730 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140730/testReport)** for PR 32959 at commit

[GitHub] [spark] SparkQA commented on pull request #33242: [SPARK-35735][SQL][FOLLOWUP] Fix case minute to second regex can cover by hour to minute

2021-07-06 Thread GitBox
SparkQA commented on pull request #33242: URL: https://github.com/apache/spark/pull/33242#issuecomment-875297418 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45243/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #33164: [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java

2021-07-06 Thread GitBox
SparkQA removed a comment on pull request #33164: URL: https://github.com/apache/spark/pull/33164#issuecomment-875234189 **[Test build #140729 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140729/testReport)** for PR 33164 at commit

[GitHub] [spark] SparkQA commented on pull request #33164: [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java

2021-07-06 Thread GitBox
SparkQA commented on pull request #33164: URL: https://github.com/apache/spark/pull/33164#issuecomment-875293430 **[Test build #140729 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140729/testReport)** for PR 33164 at commit

[GitHub] [spark] HyukjinKwon closed pull request #33240: [SPARK-35906][SQL][FOLLOWUP] Recursive remove sort if the maximum number of rows less than or equal to 1

2021-07-06 Thread GitBox
HyukjinKwon closed pull request #33240: URL: https://github.com/apache/spark/pull/33240 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #33231: [SPARK-36021][SQL] Parse interval literals should support more than 2 digits

2021-07-06 Thread GitBox
SparkQA commented on pull request #33231: URL: https://github.com/apache/spark/pull/33231#issuecomment-875293070 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45245/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on pull request #33240: [SPARK-35906][SQL][FOLLOWUP] Recursive remove sort if the maximum number of rows less than or equal to 1

2021-07-06 Thread GitBox
HyukjinKwon commented on pull request #33240: URL: https://github.com/apache/spark/pull/33240#issuecomment-875293047 Merged to master and branch-3.2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #33223: [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions

2021-07-06 Thread GitBox
SparkQA commented on pull request #33223: URL: https://github.com/apache/spark/pull/33223#issuecomment-875293024 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45246/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #33214: [SPARK-35929][PYTHON] Support to infer nested dict as a struct when creating a DataFrame

2021-07-06 Thread GitBox
SparkQA removed a comment on pull request #33214: URL: https://github.com/apache/spark/pull/33214#issuecomment-875188042 **[Test build #140723 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140723/testReport)** for PR 33214 at commit

[GitHub] [spark] SparkQA commented on pull request #33214: [SPARK-35929][PYTHON] Support to infer nested dict as a struct when creating a DataFrame

2021-07-06 Thread GitBox
SparkQA commented on pull request #33214: URL: https://github.com/apache/spark/pull/33214#issuecomment-875291908 **[Test build #140723 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140723/testReport)** for PR 33214 at commit

[GitHub] [spark] SparkQA commented on pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
SparkQA commented on pull request #33238: URL: https://github.com/apache/spark/pull/33238#issuecomment-875282707 **[Test build #140741 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140741/testReport)** for PR 33238 at commit

[GitHub] [spark] SparkQA commented on pull request #33239: [WIP][SPARK-36030][SQL] Support DS v2 metrics at writing path

2021-07-06 Thread GitBox
SparkQA commented on pull request #33239: URL: https://github.com/apache/spark/pull/33239#issuecomment-875282623 **[Test build #140740 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140740/testReport)** for PR 33239 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
SparkQA removed a comment on pull request #33238: URL: https://github.com/apache/spark/pull/33238#issuecomment-875215847 **[Test build #140724 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140724/testReport)** for PR 33238 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33238: URL: https://github.com/apache/spark/pull/33238#issuecomment-875281167 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140724/

[GitHub] [spark] AmplabJenkins commented on pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33238: URL: https://github.com/apache/spark/pull/33238#issuecomment-875281167 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140724/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33241: [SPARK-36017][SQL] Support TimestampNTZType in expression ApproximatePercentile

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33241: URL: https://github.com/apache/spark/pull/33241#issuecomment-875280594 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45244/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-875280599 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45241/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33164: [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33164: URL: https://github.com/apache/spark/pull/33164#issuecomment-875280597 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45239/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33223: [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33223: URL: https://github.com/apache/spark/pull/33223#issuecomment-875280593 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140736/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33239: [WIP][SPARK-36030][SQL] Support DS v2 metrics at writing path

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33239: URL: https://github.com/apache/spark/pull/33239#issuecomment-875280595 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45238/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33240: [SPARK-35906][SQL][FOLLOWUP] Recursive remove sort if the maximum number of rows less than or equal to 1

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33240: URL: https://github.com/apache/spark/pull/33240#issuecomment-875280596 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45240/

[GitHub] [spark] SparkQA commented on pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
SparkQA commented on pull request #33238: URL: https://github.com/apache/spark/pull/33238#issuecomment-875280746 **[Test build #140724 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140724/testReport)** for PR 33238 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33164: [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33164: URL: https://github.com/apache/spark/pull/33164#issuecomment-875280597 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45239/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33223: [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33223: URL: https://github.com/apache/spark/pull/33223#issuecomment-875280593 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140736/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33240: [SPARK-35906][SQL][FOLLOWUP] Recursive remove sort if the maximum number of rows less than or equal to 1

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33240: URL: https://github.com/apache/spark/pull/33240#issuecomment-875280596 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45240/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33241: [SPARK-36017][SQL] Support TimestampNTZType in expression ApproximatePercentile

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33241: URL: https://github.com/apache/spark/pull/33241#issuecomment-875280594 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45244/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33239: [WIP][SPARK-36030][SQL] Support DS v2 metrics at writing path

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33239: URL: https://github.com/apache/spark/pull/33239#issuecomment-875280595 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45238/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-875280599 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45241/ --

[GitHub] [spark] SparkQA commented on pull request #33242: [SPARK-35735][SQL][FOLLOWUP] Fix case minute to second regex can cover by hour to minute

2021-07-06 Thread GitBox
SparkQA commented on pull request #33242: URL: https://github.com/apache/spark/pull/33242#issuecomment-875280189 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45243/ -- This is an automated message from the Apache

[GitHub] [spark] linhongliu-db commented on a change in pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-06 Thread GitBox
linhongliu-db commented on a change in pull request #32959: URL: https://github.com/apache/spark/pull/32959#discussion_r665015489 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala ## @@ -249,70 +249,107 @@ object DateTimeUtils {

[GitHub] [spark] SparkQA commented on pull request #33231: [SPARK-36021][SQL] Parse interval literals should support more than 2 digits

2021-07-06 Thread GitBox
SparkQA commented on pull request #33231: URL: https://github.com/apache/spark/pull/33231#issuecomment-875276219 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45245/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33223: [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions

2021-07-06 Thread GitBox
SparkQA commented on pull request #33223: URL: https://github.com/apache/spark/pull/33223#issuecomment-875276165 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45246/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33241: [SPARK-36017][SQL] Support TimestampNTZType in expression ApproximatePercentile

2021-07-06 Thread GitBox
SparkQA commented on pull request #33241: URL: https://github.com/apache/spark/pull/33241#issuecomment-875273128 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45244/ --

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-06 Thread GitBox
SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-875272342 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45241/ -- This is an automated message from the

[GitHub] [spark] ulysses-you commented on a change in pull request #32872: [SPARK-35639][SQL] Make hasCoalescedPartition return true if something was actually coalesced

2021-07-06 Thread GitBox
ulysses-you commented on a change in pull request #32872: URL: https://github.com/apache/spark/pull/32872#discussion_r665031937 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -1567,7 +1567,7 @@ class

[GitHub] [spark] ulysses-you commented on a change in pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
ulysses-you commented on a change in pull request #33238: URL: https://github.com/apache/spark/pull/33238#discussion_r665033163 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -1481,4 +1481,26 @@ class

[GitHub] [spark] SparkQA removed a comment on pull request #33223: [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions

2021-07-06 Thread GitBox
SparkQA removed a comment on pull request #33223: URL: https://github.com/apache/spark/pull/33223#issuecomment-875257101 **[Test build #140736 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140736/testReport)** for PR 33223 at commit

[GitHub] [spark] SparkQA commented on pull request #33223: [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions

2021-07-06 Thread GitBox
SparkQA commented on pull request #33223: URL: https://github.com/apache/spark/pull/33223#issuecomment-875268934 **[Test build #140736 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140736/testReport)** for PR 33223 at commit

[GitHub] [spark] ulysses-you commented on a change in pull request #32872: [SPARK-35639][SQL] Make hasCoalescedPartition return true if something was actually coalesced

2021-07-06 Thread GitBox
ulysses-you commented on a change in pull request #32872: URL: https://github.com/apache/spark/pull/32872#discussion_r665031937 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -1567,7 +1567,7 @@ class

[GitHub] [spark] SparkQA commented on pull request #33240: [SPARK-35906][SQL][FOLLOWUP] Recursive remove sort if the maximum number of rows less than or equal to 1

2021-07-06 Thread GitBox
SparkQA commented on pull request #33240: URL: https://github.com/apache/spark/pull/33240#issuecomment-875268157 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45240/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon closed pull request #33223: [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions

2021-07-06 Thread GitBox
HyukjinKwon closed pull request #33223: URL: https://github.com/apache/spark/pull/33223 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #33223: [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions

2021-07-06 Thread GitBox
HyukjinKwon commented on pull request #33223: URL: https://github.com/apache/spark/pull/33223#issuecomment-875266531 Merged to master and branch-3.2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] cloud-fan closed pull request #33235: [SPARK-36028][SQL] Allow Project to host outer references in scalar subqueries

2021-07-06 Thread GitBox
cloud-fan closed pull request #33235: URL: https://github.com/apache/spark/pull/33235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #33223: [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions

2021-07-06 Thread GitBox
HyukjinKwon commented on pull request #33223: URL: https://github.com/apache/spark/pull/33223#issuecomment-875266206 Python linter passed. Let me get this in! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] cloud-fan commented on pull request #33235: [SPARK-36028][SQL] Allow Project to host outer references in scalar subqueries

2021-07-06 Thread GitBox
cloud-fan commented on pull request #33235: URL: https://github.com/apache/spark/pull/33235#issuecomment-875266259 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #33164: [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java

2021-07-06 Thread GitBox
SparkQA commented on pull request #33164: URL: https://github.com/apache/spark/pull/33164#issuecomment-875266249 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45239/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33239: [WIP][SPARK-36030][SQL] Support DS v2 metrics at writing path

2021-07-06 Thread GitBox
SparkQA commented on pull request #33239: URL: https://github.com/apache/spark/pull/33239#issuecomment-875265372 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45238/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33232: [SPARK-36027][SQL] Add the code change to pushdown filter in case of typedFilter

2021-07-06 Thread GitBox
HyukjinKwon commented on a change in pull request #33232: URL: https://github.com/apache/spark/pull/33232#discussion_r665029120 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -1442,6 +1442,12 @@ object

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33232: [SPARK-36027][SQL] Add the code change to pushdown filter in case of typedFilter

2021-07-06 Thread GitBox
HyukjinKwon commented on a change in pull request #33232: URL: https://github.com/apache/spark/pull/33232#discussion_r665029120 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -1442,6 +1442,12 @@ object

[GitHub] [spark] cloud-fan commented on a change in pull request #33242: [SPARK-35735][SQL][FOLLOWUP] Fix case minute to second regex can cover by hour to minute

2021-07-06 Thread GitBox
cloud-fan commented on a change in pull request #33242: URL: https://github.com/apache/spark/pull/33242#discussion_r665028561 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -327,8 +327,8 @@ object IntervalUtils {

[GitHub] [spark] cloud-fan commented on a change in pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
cloud-fan commented on a change in pull request #33238: URL: https://github.com/apache/spark/pull/33238#discussion_r665028096 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -1481,4 +1481,26 @@ class

[GitHub] [spark] SparkQA commented on pull request #33243: [SPARK-36016][SQL] Support TimestampNTZType in expression ApproxCountDistinctForIntervals

2021-07-06 Thread GitBox
SparkQA commented on pull request #33243: URL: https://github.com/apache/spark/pull/33243#issuecomment-875262161 **[Test build #140739 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140739/testReport)** for PR 33243 at commit

[GitHub] [spark] ulysses-you commented on a change in pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
ulysses-you commented on a change in pull request #33238: URL: https://github.com/apache/spark/pull/33238#discussion_r665026154 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -1481,4 +1481,26 @@ class

[GitHub] [spark] beliefer opened a new pull request #33243: [SPARK-36016][SQL] Support TimestampNTZType in expression ApproxCountDistinctForIntervals

2021-07-06 Thread GitBox
beliefer opened a new pull request #33243: URL: https://github.com/apache/spark/pull/33243 ### What changes were proposed in this pull request? The current `ApproxCountDistinctForInterval`s supports `TimestampType`, but not supports timestamp without time zone yet. This PR will add

[GitHub] [spark] SparkQA removed a comment on pull request #33231: [SPARK-36021][SQL] Parse interval literals should support more than 2 digits

2021-07-06 Thread GitBox
SparkQA removed a comment on pull request #33231: URL: https://github.com/apache/spark/pull/33231#issuecomment-875257077 **[Test build #140735 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140735/testReport)** for PR 33231 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33231: [SPARK-36021][SQL] Parse interval literals should support more than 2 digits

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33231: URL: https://github.com/apache/spark/pull/33231#issuecomment-875259534 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140735/

[GitHub] [spark] AmplabJenkins commented on pull request #33231: [SPARK-36021][SQL] Parse interval literals should support more than 2 digits

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33231: URL: https://github.com/apache/spark/pull/33231#issuecomment-875259534 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140735/ -- This

[GitHub] [spark] SparkQA commented on pull request #33231: [SPARK-36021][SQL] Parse interval literals should support more than 2 digits

2021-07-06 Thread GitBox
SparkQA commented on pull request #33231: URL: https://github.com/apache/spark/pull/33231#issuecomment-875259506 **[Test build #140735 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140735/testReport)** for PR 33231 at commit

[GitHub] [spark] SaurabhChawla100 commented on pull request #33232: [SPARK-36027][SQL] Add the code change to pushdown filter in case of typedFilter

2021-07-06 Thread GitBox
SaurabhChawla100 commented on pull request #33232: URL: https://github.com/apache/spark/pull/33232#issuecomment-875259211 cc @cloud-fan @HyukjinKwon @viirya -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] cloud-fan commented on a change in pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
cloud-fan commented on a change in pull request #33238: URL: https://github.com/apache/spark/pull/33238#discussion_r665024445 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -1481,4 +1481,26 @@ class

[GitHub] [spark] akshatb1 edited a comment on pull request #33135: [SPARK-35931][CORE][YARN] Ability to override Yarn Cluster Submit Class with Configuration

2021-07-06 Thread GitBox
akshatb1 edited a comment on pull request #33135: URL: https://github.com/apache/spark/pull/33135#issuecomment-875250761 Thanks @tgravescs for looking into this. Please find my responses below. > Can you give more details about exactly what requires changing here? We have a

[GitHub] [spark] SparkQA commented on pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
SparkQA commented on pull request #33238: URL: https://github.com/apache/spark/pull/33238#issuecomment-875258760 **[Test build #140738 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140738/testReport)** for PR 33238 at commit

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-06 Thread GitBox
SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-875257284 **[Test build #140737 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140737/testReport)** for PR 32959 at commit

[GitHub] [spark] SparkQA commented on pull request #33223: [SPARK-35684][INFRA][PYTHON] Bump up mypy version in GitHub Actions

2021-07-06 Thread GitBox
SparkQA commented on pull request #33223: URL: https://github.com/apache/spark/pull/33223#issuecomment-875257101 **[Test build #140736 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140736/testReport)** for PR 33223 at commit

[GitHub] [spark] SparkQA commented on pull request #33231: [SPARK-36021][SQL] Parse interval literals should support more than 2 digits

2021-07-06 Thread GitBox
SparkQA commented on pull request #33231: URL: https://github.com/apache/spark/pull/33231#issuecomment-875257077 **[Test build #140735 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140735/testReport)** for PR 33231 at commit

[GitHub] [spark] SparkQA commented on pull request #33241: [SPARK-36017][SQL] Support TimestampNTZType in expression ApproximatePercentile

2021-07-06 Thread GitBox
SparkQA commented on pull request #33241: URL: https://github.com/apache/spark/pull/33241#issuecomment-875257043 **[Test build #140734 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140734/testReport)** for PR 33241 at commit

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-06 Thread GitBox
SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-875256952 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45241/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33242: [SPARK-35735][SQL][FOLLOWUP] Fix case minute to second regex can cover by hour to minute

2021-07-06 Thread GitBox
SparkQA commented on pull request #33242: URL: https://github.com/apache/spark/pull/33242#issuecomment-875257016 **[Test build #140733 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140733/testReport)** for PR 33242 at commit

[GitHub] [spark] HyukjinKwon closed pull request #33233: [SPARK-36026][BUILD][K8S] Upgrade kubernetes-client to 5.5.0

2021-07-06 Thread GitBox
HyukjinKwon closed pull request #33233: URL: https://github.com/apache/spark/pull/33233 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #33233: [SPARK-36026][BUILD][K8S] Upgrade kubernetes-client to 5.5.0

2021-07-06 Thread GitBox
HyukjinKwon commented on pull request #33233: URL: https://github.com/apache/spark/pull/33233#issuecomment-875256559 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33237: [SPARK-35340][PYTHON] Standardize TypeError messages for unsupported basic operations

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33237: URL: https://github.com/apache/spark/pull/33237#issuecomment-875255715 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33231: [SPARK-36021][SQL] Parse interval literals should support more than 2 digits

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33231: URL: https://github.com/apache/spark/pull/33231#issuecomment-875255717 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45242/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33238: URL: https://github.com/apache/spark/pull/33238#issuecomment-875255719 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45236/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33239: [WIP][SPARK-36030][SQL] Support DS v2 metrics at writing path

2021-07-06 Thread GitBox
AmplabJenkins removed a comment on pull request #33239: URL: https://github.com/apache/spark/pull/33239#issuecomment-875255716 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140727/

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #33242: [SPARK-35735][SQL][FOLLOWUP] Fix case minute to second regex can cover by hour to minute

2021-07-06 Thread GitBox
AngersZh commented on a change in pull request #33242: URL: https://github.com/apache/spark/pull/33242#discussion_r665022549 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -327,8 +327,8 @@ object IntervalUtils {

[GitHub] [spark] AmplabJenkins commented on pull request #33238: [SPARK-36020][SQL][3.1] Check logical link in remove redundant projects

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33238: URL: https://github.com/apache/spark/pull/33238#issuecomment-875255719 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45236/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33231: [SPARK-36021][SQL] Parse interval literals should support more than 2 digits

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33231: URL: https://github.com/apache/spark/pull/33231#issuecomment-875255717 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45242/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33239: [WIP][SPARK-36030][SQL] Support DS v2 metrics at writing path

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33239: URL: https://github.com/apache/spark/pull/33239#issuecomment-875255716 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140727/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33237: [SPARK-35340][PYTHON] Standardize TypeError messages for unsupported basic operations

2021-07-06 Thread GitBox
AmplabJenkins commented on pull request #33237: URL: https://github.com/apache/spark/pull/33237#issuecomment-875255718 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AngersZhuuuu opened a new pull request #33242: [SPARK-35735][SQL][FOLLOWUP] Fix case minute to second regex can cover by hour to minute

2021-07-06 Thread GitBox
AngersZh opened a new pull request #33242: URL: https://github.com/apache/spark/pull/33242 ### What changes were proposed in this pull request? When cast `10:10` to interval minute to second, it can be catch by hour to minute regex, here to fix this. ### Why are the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33164: [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java

2021-07-06 Thread GitBox
HyukjinKwon commented on a change in pull request #33164: URL: https://github.com/apache/spark/pull/33164#discussion_r665021030 ## File path: core/src/main/java/org/apache/spark/SparkThrowable.java ## @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [spark] SparkQA commented on pull request #33240: [SPARK-35906][SQL][FOLLOWUP] Recursive remove sort if the maximum number of rows less than or equal to 1

2021-07-06 Thread GitBox
SparkQA commented on pull request #33240: URL: https://github.com/apache/spark/pull/33240#issuecomment-875253865 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45240/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33231: [SPARK-36021][SQL] Parse interval literals should support more than 2 digits

2021-07-06 Thread GitBox
SparkQA commented on pull request #33231: URL: https://github.com/apache/spark/pull/33231#issuecomment-875253570 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45242/ --

[GitHub] [spark] SparkQA commented on pull request #33164: [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java

2021-07-06 Thread GitBox
SparkQA commented on pull request #33164: URL: https://github.com/apache/spark/pull/33164#issuecomment-875252182 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45239/ -- This is an automated message from the Apache

[GitHub] [spark] beliefer opened a new pull request #33241: [SPARK-36017][SQL] Support TimestampNTZType in expression ApproximatePercentile

2021-07-06 Thread GitBox
beliefer opened a new pull request #33241: URL: https://github.com/apache/spark/pull/33241 ### What changes were proposed in this pull request? The current `ApproximatePercentile` supports `TimestampType`, but not supports timestamp without time zone yet. This PR will add the

[GitHub] [spark] SparkQA commented on pull request #33239: [WIP][SPARK-36030][SQL] Support DS v2 metrics at writing path

2021-07-06 Thread GitBox
SparkQA commented on pull request #33239: URL: https://github.com/apache/spark/pull/33239#issuecomment-875251767 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45238/ -- This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33164: [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java

2021-07-06 Thread GitBox
HyukjinKwon commented on a change in pull request #33164: URL: https://github.com/apache/spark/pull/33164#discussion_r665018229 ## File path: core/src/main/java/org/apache/spark/SparkThrowable.java ## @@ -0,0 +1,45 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33164: [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java

2021-07-06 Thread GitBox
HyukjinKwon commented on a change in pull request #33164: URL: https://github.com/apache/spark/pull/33164#discussion_r665018109 ## File path: core/src/main/java/org/apache/spark/SparkThrowable.java ## @@ -0,0 +1,45 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [spark] akshatb1 commented on pull request #33135: [SPARK-35931][CORE][YARN] Ability to override Yarn Cluster Submit Class with Configuration

2021-07-06 Thread GitBox
akshatb1 commented on pull request #33135: URL: https://github.com/apache/spark/pull/33135#issuecomment-875250761 Thanks @tgravescs for looking into this. Please find my responses below. > Can you give more details about exactly what requires changing here? We have a

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33164: [SPARK-35958][CORE] Refactor SparkError.scala to SparkThrowable.java

2021-07-06 Thread GitBox
HyukjinKwon commented on a change in pull request #33164: URL: https://github.com/apache/spark/pull/33164#discussion_r665018061 ## File path: core/src/main/java/org/apache/spark/SparkThrowable.java ## @@ -0,0 +1,45 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [spark] allisonwang-db commented on pull request #33235: [SPARK-36028][SQL] Allow Project to host outer references in scalar subqueries

2021-07-06 Thread GitBox
allisonwang-db commented on pull request #33235: URL: https://github.com/apache/spark/pull/33235#issuecomment-875250639 cc @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] ekoifman edited a comment on pull request #32872: [SPARK-35639][SQL] Make hasCoalescedPartition return true if something was actually coalesced

2021-07-06 Thread GitBox
ekoifman edited a comment on pull request #32872: URL: https://github.com/apache/spark/pull/32872#issuecomment-875248394 @ulysses-you I provided a link https://github.com/apache/spark/pull/32872#discussion_r649665188 to an explanation. I haven't seen any response to it - is the

[GitHub] [spark] SparkQA commented on pull request #33239: [WIP][SPARK-36030][SQL] Support DS v2 metrics at writing path

2021-07-06 Thread GitBox
SparkQA commented on pull request #33239: URL: https://github.com/apache/spark/pull/33239#issuecomment-875248525 **[Test build #140727 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140727/testReport)** for PR 33239 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33239: [WIP][SPARK-36030][SQL] Support DS v2 metrics at writing path

2021-07-06 Thread GitBox
SparkQA removed a comment on pull request #33239: URL: https://github.com/apache/spark/pull/33239#issuecomment-875234084 **[Test build #140727 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140727/testReport)** for PR 33239 at commit

  1   2   3   4   5   6   7   8   9   10   >