[GitHub] [spark] SparkQA commented on pull request #34364: [SPARK-37073][AVRO][TEST] Pass all UTs in `external/avro` with Java 17

SparkQA commented on pull request #34364: URL: https://github.com/apache/spark/pull/34364#issuecomment-949309560 **[Test build #144530 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144530/testReport)** for PR 34364 at commit

[GitHub] [spark] LuciferYang opened a new pull request #34364: [SPARK-37073][AVRO][TEST] Pass all UTs in `external/avro` with Java 17

LuciferYang opened a new pull request #34364: URL: https://github.com/apache/spark/pull/34364 ### What changes were proposed in this pull request? The `external/avro` module test with Java 17 has 2 UT failed, the reason for the failure is that the content of the error message used for

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34363: [SPARK-37083][PYTHON] Inline type hints for python/pyspark/accumulators.py

AmplabJenkins removed a comment on pull request #34363: URL: https://github.com/apache/spark/pull/34363#issuecomment-949304531 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144527/

[GitHub] [spark] SparkQA commented on pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

SparkQA commented on pull request #34362: URL: https://github.com/apache/spark/pull/34362#issuecomment-949305726 **[Test build #144529 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144529/testReport)** for PR 34362 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34238: [SPARK-36969][PYTHON] Inline type hints for SparkContext

AmplabJenkins removed a comment on pull request #34238: URL: https://github.com/apache/spark/pull/34238#issuecomment-949304530 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144528/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34337: [SPARK-37066][SQL] Improve error message to show file path when failed to read next file

AmplabJenkins removed a comment on pull request #34337: URL: https://github.com/apache/spark/pull/34337#issuecomment-949304532 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48997/

[GitHub] [spark] AmplabJenkins commented on pull request #34337: [SPARK-37066][SQL] Improve error message to show file path when failed to read next file

AmplabJenkins commented on pull request #34337: URL: https://github.com/apache/spark/pull/34337#issuecomment-949304532 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48997/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34238: [SPARK-36969][PYTHON] Inline type hints for SparkContext

AmplabJenkins commented on pull request #34238: URL: https://github.com/apache/spark/pull/34238#issuecomment-949304530 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144528/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34363: [SPARK-37083][PYTHON] Inline type hints for python/pyspark/accumulators.py

AmplabJenkins commented on pull request #34363: URL: https://github.com/apache/spark/pull/34363#issuecomment-949304531 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144527/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #34238: [SPARK-36969][PYTHON] Inline type hints for SparkContext

SparkQA removed a comment on pull request #34238: URL: https://github.com/apache/spark/pull/34238#issuecomment-949284374 **[Test build #144528 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144528/testReport)** for PR 34238 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34363: [SPARK-37083][PYTHON] Inline type hints for python/pyspark/accumulators.py

SparkQA removed a comment on pull request #34363: URL: https://github.com/apache/spark/pull/34363#issuecomment-949284252 **[Test build #144527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144527/testReport)** for PR 34363 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #34292: [SPARK-37017][SQL] Reduce the scope of synchronized to prevent potential deadlock

HyukjinKwon commented on pull request #34292: URL: https://github.com/apache/spark/pull/34292#issuecomment-949302897 Otherwise, I am going to propose revert this because this patch apparently has not been tested. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] SparkQA commented on pull request #34238: [SPARK-36969][PYTHON] Inline type hints for SparkContext

SparkQA commented on pull request #34238: URL: https://github.com/apache/spark/pull/34238#issuecomment-949302633 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48999/ -- This is an automated message from the Apache

[GitHub] [spark] LuciferYang commented on pull request #34313: [SPARK-37013][SQL] Forbid `%0$` usage explicitly to ensure `format_string` has same behavior when using Java 8 and Java 17

LuciferYang commented on pull request #34313: URL: https://github.com/apache/spark/pull/34313#issuecomment-949302214 thanks all ~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #34363: [SPARK-37083][PYTHON] Inline type hints for python/pyspark/accumulators.py

SparkQA commented on pull request #34363: URL: https://github.com/apache/spark/pull/34363#issuecomment-949300193 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48998/ -- This is an automated message from the Apache

[GitHub] [spark] wangyum commented on a change in pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

wangyum commented on a change in pull request #34362: URL: https://github.com/apache/spark/pull/34362#discussion_r734242476 ## File path: dev/deps/spark-deps-hadoop-3.2-hive-2.3 ## @@ -120,6 +120,7 @@ jakarta.ws.rs-api/2.1.6//jakarta.ws.rs-api-2.1.6.jar

[GitHub] [spark] wangyum commented on a change in pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

wangyum commented on a change in pull request #34362: URL: https://github.com/apache/spark/pull/34362#discussion_r734242476 ## File path: dev/deps/spark-deps-hadoop-3.2-hive-2.3 ## @@ -120,6 +120,7 @@ jakarta.ws.rs-api/2.1.6//jakarta.ws.rs-api-2.1.6.jar

[GitHub] [spark] wangyum commented on a change in pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

wangyum commented on a change in pull request #34362: URL: https://github.com/apache/spark/pull/34362#discussion_r734238451 ## File path: pom.xml ## @@ -2442,6 +2442,10 @@ org.slf4j slf4j-api + +javax.annotation +

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34363: [SPARK-37083][PYTHON] Inline type hints for python/pyspark/accumulators.py

HyukjinKwon commented on a change in pull request #34363: URL: https://github.com/apache/spark/pull/34363#discussion_r734240778 ## File path: python/pyspark/accumulators.py ## @@ -176,44 +193,44 @@ class AccumulatorParam(object): [7.0, 8.0, 9.0] """ -def

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34363: [SPARK-37083][PYTHON] Inline type hints for python/pyspark/accumulators.py

HyukjinKwon commented on a change in pull request #34363: URL: https://github.com/apache/spark/pull/34363#discussion_r734240526 ## File path: python/pyspark/accumulators.py ## @@ -20,20 +20,32 @@ import struct import socketserver as SocketServer import threading +from

[GitHub] [spark] SparkQA commented on pull request #34238: [SPARK-36969][PYTHON] Inline type hints for SparkContext

SparkQA commented on pull request #34238: URL: https://github.com/apache/spark/pull/34238#issuecomment-949294399 **[Test build #144528 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144528/testReport)** for PR 34238 at commit

[GitHub] [spark] wangyum commented on a change in pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

wangyum commented on a change in pull request #34362: URL: https://github.com/apache/spark/pull/34362#discussion_r734240298 ## File path: sql/hive-thriftserver/src/main/java/org/apache/hive/service/auth/TSetIpAddressProcessor.java ## @@ -45,11 +45,12 @@ public

[GitHub] [spark] SparkQA commented on pull request #34363: [SPARK-37083][PYTHON] Inline type hints for python/pyspark/accumulators.py

SparkQA commented on pull request #34363: URL: https://github.com/apache/spark/pull/34363#issuecomment-949294194 **[Test build #144527 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144527/testReport)** for PR 34363 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

HyukjinKwon commented on a change in pull request #34323: URL: https://github.com/apache/spark/pull/34323#discussion_r734239196 ## File path: python/pyspark/streaming/kinesis.py ## @@ -14,17 +14,21 @@ # See the License for the specific language governing permissions and #

[GitHub] [spark] wangyum commented on a change in pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

wangyum commented on a change in pull request #34362: URL: https://github.com/apache/spark/pull/34362#discussion_r734238451 ## File path: pom.xml ## @@ -2442,6 +2442,10 @@ org.slf4j slf4j-api + +javax.annotation +

[GitHub] [spark] SparkQA commented on pull request #34337: [SPARK-37066][SQL] Improve error message to show file path when failed to read next file

SparkQA commented on pull request #34337: URL: https://github.com/apache/spark/pull/34337#issuecomment-949291586 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48997/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34241: [SPARK-36975][SQL] Correct the hive client calls‘s metrics in HiveClientImpl

AmplabJenkins removed a comment on pull request #34241: URL: https://github.com/apache/spark/pull/34241#issuecomment-949285303 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144525/

[GitHub] [spark] AmplabJenkins commented on pull request #34241: [SPARK-36975][SQL] Correct the hive client calls‘s metrics in HiveClientImpl

AmplabJenkins commented on pull request #34241: URL: https://github.com/apache/spark/pull/34241#issuecomment-949285303 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144525/ -- This

[GitHub] [spark] srowen closed pull request #34313: [SPARK-37013][SQL] Forbid `%0$` usage explicitly to ensure `format_string` has same behavior when using Java 8 and Java 17

srowen closed pull request #34313: URL: https://github.com/apache/spark/pull/34313 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] srowen commented on pull request #34313: [SPARK-37013][SQL] Forbid `%0$` usage explicitly to ensure `format_string` has same behavior when using Java 8 and Java 17

srowen commented on pull request #34313: URL: https://github.com/apache/spark/pull/34313#issuecomment-949284674 I copied the release notes change to the JIRA too. I'll merge to master -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #34241: [SPARK-36975][SQL] Correct the hive client calls‘s metrics in HiveClientImpl

SparkQA removed a comment on pull request #34241: URL: https://github.com/apache/spark/pull/34241#issuecomment-949243242 **[Test build #144525 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144525/testReport)** for PR 34241 at commit

[GitHub] [spark] srowen commented on a change in pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

srowen commented on a change in pull request #34362: URL: https://github.com/apache/spark/pull/34362#discussion_r734232033 ## File path: sql/hive-thriftserver/src/main/java/org/apache/hive/service/auth/TSetIpAddressProcessor.java ## @@ -45,11 +45,12 @@ public

[GitHub] [spark] SparkQA commented on pull request #34241: [SPARK-36975][SQL] Correct the hive client calls‘s metrics in HiveClientImpl

SparkQA commented on pull request #34241: URL: https://github.com/apache/spark/pull/34241#issuecomment-949284457 **[Test build #144525 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144525/testReport)** for PR 34241 at commit

[GitHub] [spark] SparkQA commented on pull request #34238: [SPARK-36969][PYTHON] Inline type hints for SparkContext

SparkQA commented on pull request #34238: URL: https://github.com/apache/spark/pull/34238#issuecomment-949284374 **[Test build #144528 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144528/testReport)** for PR 34238 at commit

[GitHub] [spark] srowen commented on a change in pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

srowen commented on a change in pull request #34362: URL: https://github.com/apache/spark/pull/34362#discussion_r734231884 ## File path: dev/deps/spark-deps-hadoop-3.2-hive-2.3 ## @@ -120,6 +120,7 @@ jakarta.ws.rs-api/2.1.6//jakarta.ws.rs-api-2.1.6.jar

[GitHub] [spark] SparkQA commented on pull request #34363: [SPARK-37083][PYTHON] Inline type hints for python/pyspark/accumulators.py

SparkQA commented on pull request #34363: URL: https://github.com/apache/spark/pull/34363#issuecomment-949284252 **[Test build #144527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144527/testReport)** for PR 34363 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

AmplabJenkins removed a comment on pull request #34362: URL: https://github.com/apache/spark/pull/34362#issuecomment-949283731 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144522/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34346: [SPARK-36645][SQL][FOLLOWUP] Disable min/max push down for Parquet Binary

AmplabJenkins removed a comment on pull request #34346: URL: https://github.com/apache/spark/pull/34346#issuecomment-949283727 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144520/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34241: [SPARK-36975][SQL] Correct the hive client calls‘s metrics in HiveClientImpl

AmplabJenkins removed a comment on pull request #34241: URL: https://github.com/apache/spark/pull/34241#issuecomment-949283729 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48996/

[GitHub] [spark] AmplabJenkins commented on pull request #34241: [SPARK-36975][SQL] Correct the hive client calls‘s metrics in HiveClientImpl

AmplabJenkins commented on pull request #34241: URL: https://github.com/apache/spark/pull/34241#issuecomment-949283729 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48996/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

AmplabJenkins commented on pull request #34362: URL: https://github.com/apache/spark/pull/34362#issuecomment-949283731 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144522/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34346: [SPARK-36645][SQL][FOLLOWUP] Disable min/max push down for Parquet Binary

AmplabJenkins commented on pull request #34346: URL: https://github.com/apache/spark/pull/34346#issuecomment-949283727 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144520/ -- This

[GitHub] [spark] dchvn commented on pull request #34363: [SPARK-37083][PYTHON] Inline type hints for python/pyspark/accumulators.py

dchvn commented on pull request #34363: URL: https://github.com/apache/spark/pull/34363#issuecomment-949283715 CC @xinrong-databricks @HyukjinKwon @ueshin @zero323. FYI. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #34346: [SPARK-36645][SQL][FOLLOWUP] Disable min/max push down for Parquet Binary

SparkQA removed a comment on pull request #34346: URL: https://github.com/apache/spark/pull/34346#issuecomment-949083066 **[Test build #144520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144520/testReport)** for PR 34346 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

SparkQA removed a comment on pull request #34362: URL: https://github.com/apache/spark/pull/34362#issuecomment-949192271 **[Test build #144522 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144522/testReport)** for PR 34362 at commit

[GitHub] [spark] dchvn commented on a change in pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

dchvn commented on a change in pull request #34323: URL: https://github.com/apache/spark/pull/34323#discussion_r734229556 ## File path: python/pyspark/streaming/kinesis.py ## @@ -34,11 +38,22 @@ def utf8_decoder(s): class KinesisUtils(object): @staticmethod -def

[GitHub] [spark] HyukjinKwon commented on pull request #34337: [SPARK-37066][SQL] Improve error message to show file path when failed to read next file

HyukjinKwon commented on pull request #34337: URL: https://github.com/apache/spark/pull/34337#issuecomment-949280699 @AngersZh can you fill the PR description on "How was this patch tested?"? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] huaxingao commented on pull request #34346: [SPARK-36645][SQL][FOLLOWUP] Disable min/max push down for Parquet Binary

huaxingao commented on pull request #34346: URL: https://github.com/apache/spark/pull/34346#issuecomment-949280509 Thank you so much, everyone! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] HyukjinKwon closed pull request #34357: [SPARK-37086][R][ML][TESTS] Fix the R test of FPGrowthModel for Scala 2.13

HyukjinKwon closed pull request #34357: URL: https://github.com/apache/spark/pull/34357 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #34357: [SPARK-37086][R][ML][TESTS] Fix the R test of FPGrowthModel for Scala 2.13

HyukjinKwon commented on pull request #34357: URL: https://github.com/apache/spark/pull/34357#issuecomment-949280270 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] HyukjinKwon closed pull request #34315: [SPARK-37050][PYTHON] Update Conda installation instructions

HyukjinKwon closed pull request #34315: URL: https://github.com/apache/spark/pull/34315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #34315: [SPARK-37050][PYTHON] Update Conda installation instructions

HyukjinKwon commented on pull request #34315: URL: https://github.com/apache/spark/pull/34315#issuecomment-949279875 Merged to master and branch-3.2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #34346: [SPARK-36645][SQL][FOLLOWUP] Disable min/max push down for Parquet Binary

SparkQA commented on pull request #34346: URL: https://github.com/apache/spark/pull/34346#issuecomment-949279206 **[Test build #144520 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144520/testReport)** for PR 34346 at commit

[GitHub] [spark] HyukjinKwon closed pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

HyukjinKwon closed pull request #34360: URL: https://github.com/apache/spark/pull/34360 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

HyukjinKwon commented on pull request #34360: URL: https://github.com/apache/spark/pull/34360#issuecomment-94927 Merged to master and branch-3.2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #34337: [SPARK-37066][SQL] Improve error message to show file path when failed to read next file

SparkQA commented on pull request #34337: URL: https://github.com/apache/spark/pull/34337#issuecomment-949278901 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48997/ -- This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

HyukjinKwon commented on a change in pull request #34323: URL: https://github.com/apache/spark/pull/34323#discussion_r734226805 ## File path: python/pyspark/streaming/kinesis.py ## @@ -34,11 +38,22 @@ def utf8_decoder(s): class KinesisUtils(object): @staticmethod -

[GitHub] [spark] HyukjinKwon closed pull request #34346: [SPARK-36645][SQL][FOLLOWUP] Disable min/max push down for Parquet Binary

HyukjinKwon closed pull request #34346: URL: https://github.com/apache/spark/pull/34346 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #34346: [SPARK-36645][SQL][FOLLOWUP] Disable min/max push down for Parquet Binary

HyukjinKwon commented on pull request #34346: URL: https://github.com/apache/spark/pull/34346#issuecomment-949277835 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] dchvn opened a new pull request #34363: [SPARK-37083][PYTHON] Inline type hints for python/pyspark/accumulators.py

dchvn opened a new pull request #34363: URL: https://github.com/apache/spark/pull/34363 ### What changes were proposed in this pull request? Inline type hints for python/pyspark/accumulators.py ### Why are the changes needed? We can take advantage of static type checking within

[GitHub] [spark] SparkQA commented on pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

SparkQA commented on pull request #34362: URL: https://github.com/apache/spark/pull/34362#issuecomment-949275575 **[Test build #144522 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144522/testReport)** for PR 34362 at commit

[GitHub] [spark] SparkQA commented on pull request #34241: [SPARK-36975][SQL] Correct the hive client calls‘s metrics in HiveClientImpl

SparkQA commented on pull request #34241: URL: https://github.com/apache/spark/pull/34241#issuecomment-949273919 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48996/ -- This is an automated message from the

[GitHub] [spark] sarutak commented on pull request #34350: [SPARK-37081][SQL][TESTS] Upgrade the version of RDBMS and corresponding JDBC drivers used by docker-integration-tests

sarutak commented on pull request #34350: URL: https://github.com/apache/spark/pull/34350#issuecomment-949269846 cc: @gaborgsomogyi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

AmplabJenkins removed a comment on pull request #34360: URL: https://github.com/apache/spark/pull/34360#issuecomment-949263886 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144523/

[GitHub] [spark] AmplabJenkins commented on pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

AmplabJenkins commented on pull request #34360: URL: https://github.com/apache/spark/pull/34360#issuecomment-949263886 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144523/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

SparkQA removed a comment on pull request #34360: URL: https://github.com/apache/spark/pull/34360#issuecomment-949192281 **[Test build #144523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144523/testReport)** for PR 34360 at commit

[GitHub] [spark] SparkQA commented on pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

SparkQA commented on pull request #34360: URL: https://github.com/apache/spark/pull/34360#issuecomment-949263364 **[Test build #144523 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144523/testReport)** for PR 34360 at commit

[GitHub] [spark] SparkQA commented on pull request #34337: [SPARK-37066][SQL] Improve error message to show file path when failed to read next file

SparkQA commented on pull request #34337: URL: https://github.com/apache/spark/pull/34337#issuecomment-949262509 **[Test build #144526 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144526/testReport)** for PR 34337 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

AmplabJenkins removed a comment on pull request #34362: URL: https://github.com/apache/spark/pull/34362#issuecomment-949262279 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48993/

[GitHub] [spark] AmplabJenkins commented on pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

AmplabJenkins commented on pull request #34362: URL: https://github.com/apache/spark/pull/34362#issuecomment-949262279 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48993/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

AmplabJenkins commented on pull request #34323: URL: https://github.com/apache/spark/pull/34323#issuecomment-949262280 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48995/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

AmplabJenkins removed a comment on pull request #34323: URL: https://github.com/apache/spark/pull/34323#issuecomment-949262280 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48995/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

AmplabJenkins removed a comment on pull request #34360: URL: https://github.com/apache/spark/pull/34360#issuecomment-949262281 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48994/

[GitHub] [spark] AmplabJenkins commented on pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

AmplabJenkins commented on pull request #34360: URL: https://github.com/apache/spark/pull/34360#issuecomment-949262281 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48994/ --

[GitHub] [spark] SparkQA commented on pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

SparkQA commented on pull request #34360: URL: https://github.com/apache/spark/pull/34360#issuecomment-949259574 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48994/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34241: [SPARK-36975][SQL] Correct the hive client calls‘s metrics in HiveClientImpl

SparkQA commented on pull request #34241: URL: https://github.com/apache/spark/pull/34241#issuecomment-949258708 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48996/ -- This is an automated message from the Apache

[GitHub] [spark] dchvn commented on a change in pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

dchvn commented on a change in pull request #34323: URL: https://github.com/apache/spark/pull/34323#discussion_r734210281 ## File path: python/pyspark/streaming/kinesis.py ## @@ -34,11 +38,22 @@ def utf8_decoder(s): class KinesisUtils(object): @staticmethod -def

[GitHub] [spark] SparkQA commented on pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

SparkQA commented on pull request #34323: URL: https://github.com/apache/spark/pull/34323#issuecomment-949255321 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48995/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

SparkQA commented on pull request #34362: URL: https://github.com/apache/spark/pull/34362#issuecomment-949252676 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48993/ -- This is an automated message from the

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34337: [SPARK-37066][SQL] Improve error message to show file path when failed to read next file

AngersZh commented on a change in pull request #34337: URL: https://github.com/apache/spark/pull/34337#discussion_r734206219 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/errors/QueryExecutionErrors.scala ## @@ -586,10 +586,11 @@ object

[GitHub] [spark] AngersZhuuuu commented on pull request #34337: [SPARK-37066][SQL] Improve error message to show file path when failed to read next file

AngersZh commented on pull request #34337: URL: https://github.com/apache/spark/pull/34337#issuecomment-949251906 > Thank you for generalizing and updating, @AngersZh . Could you check the UT failures? It looks like wrapping exceptions requires us revise the test case asserts.

[GitHub] [spark] SparkQA commented on pull request #34241: [SPARK-36975][SQL] Correct the hive client calls‘s metrics in HiveClientImpl

SparkQA commented on pull request #34241: URL: https://github.com/apache/spark/pull/34241#issuecomment-949243242 **[Test build #144525 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144525/testReport)** for PR 34241 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34291: [SPARK-37020][SQL] DS V2 LIMIT push down

AmplabJenkins removed a comment on pull request #34291: URL: https://github.com/apache/spark/pull/34291#issuecomment-949242840 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144519/

[GitHub] [spark] AmplabJenkins commented on pull request #34291: [SPARK-37020][SQL] DS V2 LIMIT push down

AmplabJenkins commented on pull request #34291: URL: https://github.com/apache/spark/pull/34291#issuecomment-949242840 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144519/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34356: [SPARK-36554][PYTHON] Expose make_date expression in functions.scala

AmplabJenkins removed a comment on pull request #34356: URL: https://github.com/apache/spark/pull/34356#issuecomment-949142458 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

AmplabJenkins removed a comment on pull request #34323: URL: https://github.com/apache/spark/pull/34323#issuecomment-949242139 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144524/

[GitHub] [spark] SparkQA commented on pull request #34291: [SPARK-37020][SQL] DS V2 LIMIT push down

SparkQA commented on pull request #34291: URL: https://github.com/apache/spark/pull/34291#issuecomment-949242065 **[Test build #144519 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144519/testReport)** for PR 34291 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34356: [SPARK-36554][PYTHON] Expose make_date expression in functions.scala

AmplabJenkins commented on pull request #34356: URL: https://github.com/apache/spark/pull/34356#issuecomment-949242138 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48992/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34320: [SPARK-18621][PYTHON] make sql type reprs eval-able

AmplabJenkins commented on pull request #34320: URL: https://github.com/apache/spark/pull/34320#issuecomment-949242152 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] SparkQA removed a comment on pull request #34291: [SPARK-37020][SQL] DS V2 LIMIT push down

SparkQA removed a comment on pull request #34291: URL: https://github.com/apache/spark/pull/34291#issuecomment-949028566 **[Test build #144519 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144519/testReport)** for PR 34291 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

AmplabJenkins commented on pull request #34323: URL: https://github.com/apache/spark/pull/34323#issuecomment-949242139 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144524/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

SparkQA removed a comment on pull request #34323: URL: https://github.com/apache/spark/pull/34323#issuecomment-949192690 **[Test build #144524 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144524/testReport)** for PR 34323 at commit

[GitHub] [spark] SparkQA commented on pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

SparkQA commented on pull request #34323: URL: https://github.com/apache/spark/pull/34323#issuecomment-949239343 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48995/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34356: [SPARK-36554][PYTHON] Expose make_date expression in functions.scala

SparkQA commented on pull request #34356: URL: https://github.com/apache/spark/pull/34356#issuecomment-949239228 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48992/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

SparkQA commented on pull request #34360: URL: https://github.com/apache/spark/pull/34360#issuecomment-949238914 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48994/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34362: [SPARK-37090][BUILD] Upgrade libthrift to avoid security vulnerabilities

SparkQA commented on pull request #34362: URL: https://github.com/apache/spark/pull/34362#issuecomment-949237162 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48993/ -- This is an automated message from the Apache

[GitHub] [spark] LuciferYang commented on pull request #34355: [SPARK-37070][TEST] Pass all UTs in `mllib-local` and `mllib` with Java 17

LuciferYang commented on pull request #34355: URL: https://github.com/apache/spark/pull/34355#issuecomment-949235992 thanks @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

SparkQA commented on pull request #34323: URL: https://github.com/apache/spark/pull/34323#issuecomment-949221254 **[Test build #144524 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144524/testReport)** for PR 34323 at commit

[GitHub] [spark] SparkQA commented on pull request #34360: [SPARK-37069][SQL] Properly fallback when Hive.getWithoutRegisterFns is not available

SparkQA commented on pull request #34360: URL: https://github.com/apache/spark/pull/34360#issuecomment-949192281 **[Test build #144523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144523/testReport)** for PR 34360 at commit

[GitHub] [spark] SparkQA commented on pull request #34323: [SPARK-37042][PYTHON] Inline type hints for kinesis.py and listener.py in python/pyspark/streaming

SparkQA commented on pull request #34323: URL: https://github.com/apache/spark/pull/34323#issuecomment-949192690 **[Test build #144524 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144524/testReport)** for PR 34323 at commit

  1   2   3   4   5   >