[GitHub] [spark] AmplabJenkins removed a comment on pull request #30408: [SPARK-33477][SQL] Hive Metastore support filter by date type

AmplabJenkins removed a comment on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733414030 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

AmplabJenkins removed a comment on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733414026 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30427: [SPARK-33224][SS][WEBUI] Add watermark gap information into SS UI page

AmplabJenkins removed a comment on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733414031 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan closed pull request #30432: [SPARK-33494][SQL][AQE] Do not use local shuffle reader for repartition

cloud-fan closed pull request #30432: URL: https://github.com/apache/spark/pull/30432 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] AmplabJenkins commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

AmplabJenkins commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733414028 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30490: [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use UnresolvedTableOrView to resolve the identifier

AmplabJenkins commented on pull request #30490: URL: https://github.com/apache/spark/pull/30490#issuecomment-733414029 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30427: [SPARK-33224][SS][WEBUI] Add watermark gap information into SS UI page

AmplabJenkins commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733414031 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore support filter by date type

AmplabJenkins commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733414030 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] cloud-fan commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

cloud-fan commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733413366 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AngersZh commented on a change in pull request #30421: URL: https://github.com/apache/spark/pull/30421#discussion_r530058054 ## File path: docs/sql-ref-syntax-dml-insert-into.md ## @@ -198,6 +198,21 @@ SELECT * FROM students; +-+-+--

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AngersZh commented on a change in pull request #30421: URL: https://github.com/apache/spark/pull/30421#discussion_r530058236 ## File path: docs/sql-ref-syntax-dml-insert-overwrite-table.md ## @@ -41,7 +41,7 @@ INSERT OVERWRITE [ TABLE ] table_identifier [ partition_spec [

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AngersZh commented on a change in pull request #30421: URL: https://github.com/apache/spark/pull/30421#discussion_r530057299 ## File path: docs/sql-ref-syntax-dml-insert-into.md ## @@ -198,6 +198,21 @@ SELECT * FROM students; +-+-+--

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AngersZh commented on a change in pull request #30421: URL: https://github.com/apache/spark/pull/30421#discussion_r530057162 ## File path: docs/sql-ref-syntax-dml-insert-into.md ## @@ -41,7 +41,7 @@ INSERT INTO [ TABLE ] table_identifier [ partition_spec ] * **partition_sp

[GitHub] [spark] WeichenXu123 commented on a change in pull request #30471: [WIP][SPARK-33520][ML] make CrossValidator/TrainValidateSplit support Python backend estimator/model

WeichenXu123 commented on a change in pull request #30471: URL: https://github.com/apache/spark/pull/30471#discussion_r530056747 ## File path: python/pyspark/ml/tuning.py ## @@ -207,6 +210,205 @@ def _to_java_impl(self): return java_estimator, java_epms, java_evaluator

[GitHub] [spark] cloud-fan commented on a change in pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

cloud-fan commented on a change in pull request #30491: URL: https://github.com/apache/spark/pull/30491#discussion_r530056766 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2Exec.scala ## @@ -213,15 +213,14 @@ case class A

[GitHub] [spark] AngersZhuuuu commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

AngersZh commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733411177 Hope someone have time to reconfirm https://github.com/apache/spark/pull/30470#discussion_r528870549 and https://github.com/apache/spark/pull/30470#discussion_r528742847.

[GitHub] [spark] WeichenXu123 commented on a change in pull request #30471: [WIP][SPARK-33520][ML] make CrossValidator/TrainValidateSplit support Python backend estimator/model

WeichenXu123 commented on a change in pull request #30471: URL: https://github.com/apache/spark/pull/30471#discussion_r530055236 ## File path: python/pyspark/ml/tuning.py ## @@ -207,6 +210,205 @@ def _to_java_impl(self): return java_estimator, java_epms, java_evaluator

[GitHub] [spark] cloud-fan commented on a change in pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

cloud-fan commented on a change in pull request #30491: URL: https://github.com/apache/spark/pull/30491#discussion_r530056229 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2Exec.scala ## @@ -213,15 +213,14 @@ case class A

[GitHub] [spark] AngersZhuuuu commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

AngersZh commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733410697 > Good to see this cleanup! @AngersZh I guess you have checked for any remaining outstanding `commons-logging` transitive dependencies using `mvn dependency:tree` or si

[GitHub] [spark] WeichenXu123 commented on a change in pull request #30471: [WIP][SPARK-33520][ML] make CrossValidator/TrainValidateSplit support Python backend estimator/model

WeichenXu123 commented on a change in pull request #30471: URL: https://github.com/apache/spark/pull/30471#discussion_r530055236 ## File path: python/pyspark/ml/tuning.py ## @@ -207,6 +210,205 @@ def _to_java_impl(self): return java_estimator, java_epms, java_evaluator

[GitHub] [spark] cloud-fan commented on a change in pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

cloud-fan commented on a change in pull request #30403: URL: https://github.com/apache/spark/pull/30403#discussion_r530055643 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -679,3 +679,30 @@ case class TruncateTable

[GitHub] [spark] WeichenXu123 commented on a change in pull request #30471: [WIP][SPARK-33520][ML] make CrossValidator/TrainValidateSplit support Python backend estimator/model

WeichenXu123 commented on a change in pull request #30471: URL: https://github.com/apache/spark/pull/30471#discussion_r530055236 ## File path: python/pyspark/ml/tuning.py ## @@ -207,6 +210,205 @@ def _to_java_impl(self): return java_estimator, java_epms, java_evaluator

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

HyukjinKwon commented on a change in pull request #30491: URL: https://github.com/apache/spark/pull/30491#discussion_r530054985 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2Exec.scala ## @@ -213,15 +213,14 @@ case class

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

HyukjinKwon commented on a change in pull request #30491: URL: https://github.com/apache/spark/pull/30491#discussion_r530054985 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2Exec.scala ## @@ -213,15 +213,14 @@ case class

[GitHub] [spark] wangyum commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

wangyum commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733408494 retest this please This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [spark] shaneknapp commented on pull request #29994: [DONOTMERGE][WHITESPACE] workflow exercise

shaneknapp commented on pull request #29994: URL: https://github.com/apache/spark/pull/29994#issuecomment-733406986 test this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] ueshin commented on a change in pull request #30242: [SPARK-33277][PYSPARK][SQL] Use ContextAwareIterator to stop consuming after the task ends.

ueshin commented on a change in pull request #30242: URL: https://github.com/apache/spark/pull/30242#discussion_r530044246 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/python/EvalPythonExec.scala ## @@ -137,3 +139,47 @@ trait EvalPythonExec extends Unar

[GitHub] [spark] SparkQA removed a comment on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

SparkQA removed a comment on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733397169 **[Test build #131709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131709/testReport)** for PR 30486 at commit [`7b95396`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

SparkQA commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733403870 **[Test build #131709 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131709/testReport)** for PR 30486 at commit [`7b95396`](https://github.co

[GitHub] [spark] HyukjinKwon commented on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

HyukjinKwon commented on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733403353 Merged to master. This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [spark] HyukjinKwon closed pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

HyukjinKwon closed pull request #30413: URL: https://github.com/apache/spark/pull/30413 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] SparkQA commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

SparkQA commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-733402973 **[Test build #131713 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131713/testReport)** for PR 28026 at commit [`25ec746`](https://github.com

[GitHub] [spark] rdblue commented on a change in pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

rdblue commented on a change in pull request #30491: URL: https://github.com/apache/spark/pull/30491#discussion_r530047977 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2Exec.scala ## @@ -213,15 +213,14 @@ case class Atom

[GitHub] [spark] AmplabJenkins commented on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

AmplabJenkins commented on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-733402520 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] cloud-fan commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

cloud-fan commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-733402087 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

AmplabJenkins commented on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733401990 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

AmplabJenkins commented on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-733400778 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

SparkQA commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733398510 **[Test build #131712 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131712/testReport)** for PR 30486 at commit [`c87577e`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30402: Spelling r common dev mlib external project streaming resource managers python

AmplabJenkins removed a comment on pull request #30402: URL: https://github.com/apache/spark/pull/30402#issuecomment-733121757 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30402: Spelling r common dev mlib external project streaming resource managers python

AmplabJenkins commented on pull request #30402: URL: https://github.com/apache/spark/pull/30402#issuecomment-733398169 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733397199 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733397199 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

SparkQA commented on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-733397215 **[Test build #131711 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131711/testReport)** for PR 30468 at commit [`8ca7d56`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

SparkQA commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733397169 **[Test build #131709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131709/testReport)** for PR 30486 at commit [`7b95396`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733397123 **[Test build #131710 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131710/testReport)** for PR 30480 at commit [`cc1c077`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733353638 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

AmplabJenkins removed a comment on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-733396500 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

AmplabJenkins removed a comment on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733350697 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

AmplabJenkins removed a comment on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733396536 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

AmplabJenkins removed a comment on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733396499 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

AmplabJenkins removed a comment on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-733396496 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

AmplabJenkins removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733396501 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

AmplabJenkins removed a comment on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733396497 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

AmplabJenkins commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733396536 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

AmplabJenkins commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-733396496 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

AmplabJenkins commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-733396500 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

AmplabJenkins commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733396501 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

AmplabJenkins commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733396497 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

AmplabJenkins commented on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733396507 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

AmplabJenkins commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733396505 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] sunchao commented on a change in pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

sunchao commented on a change in pull request #30491: URL: https://github.com/apache/spark/pull/30491#discussion_r530040128 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2Exec.scala ## @@ -213,15 +213,14 @@ case class Ato

[GitHub] [spark] SparkQA removed a comment on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

SparkQA removed a comment on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-733265228 **[Test build #131701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131701/testReport)** for PR 29122 at commit [`b628156`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

SparkQA commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-733394429 **[Test build #131701 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131701/testReport)** for PR 29122 at commit [`b628156`](https://github.co

[GitHub] [spark] zhengruifeng commented on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

zhengruifeng commented on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-733394297 retest this please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] SparkQA removed a comment on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

SparkQA removed a comment on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733283090 **[Test build #131702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131702/testReport)** for PR 30478 at commit [`43d90ca`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

SparkQA removed a comment on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733283106 **[Test build #131703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131703/testReport)** for PR 30470 at commit [`bc3cb8b`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

SparkQA commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733390401 **[Test build #131703 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131703/testReport)** for PR 30470 at commit [`bc3cb8b`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

SparkQA commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733389811 **[Test build #131702 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131702/testReport)** for PR 30478 at commit [`43d90ca`](https://github.co

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

HyukjinKwon commented on a change in pull request #30491: URL: https://github.com/apache/spark/pull/30491#discussion_r530033229 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2Exec.scala ## @@ -213,15 +213,14 @@ case class

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

HyukjinKwon commented on a change in pull request #30491: URL: https://github.com/apache/spark/pull/30491#discussion_r530033142 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2Exec.scala ## @@ -213,15 +213,14 @@ case class

[GitHub] [spark] SparkQA removed a comment on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

SparkQA removed a comment on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733327260 **[Test build #131706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131706/testReport)** for PR 30413 at commit [`eca86aa`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

SparkQA commented on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733367808 **[Test build #131706 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131706/testReport)** for PR 30413 at commit [`eca86aa`](https://github.co

[GitHub] [spark] liangz1 commented on a change in pull request #30471: [WIP][SPARK-33520][ML] make CrossValidator/TrainValidateSplit support Python backend estimator/model

liangz1 commented on a change in pull request #30471: URL: https://github.com/apache/spark/pull/30471#discussion_r530029579 ## File path: python/pyspark/ml/tuning.py ## @@ -207,6 +210,205 @@ def _to_java_impl(self): return java_estimator, java_epms, java_evaluator

[GitHub] [spark] HyukjinKwon closed pull request #30382: [SPARK-33457][PYTHON] Adjust mypy configuration

HyukjinKwon closed pull request #30382: URL: https://github.com/apache/spark/pull/30382 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] HyukjinKwon commented on pull request #30382: [SPARK-33457][PYTHON] Adjust mypy configuration

HyukjinKwon commented on pull request #30382: URL: https://github.com/apache/spark/pull/30382#issuecomment-733358041 Merged to master. This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [spark] AmplabJenkins commented on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733353638 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

AmplabJenkins commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733350697 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

SparkQA commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-733350814 **[Test build #131708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131708/testReport)** for PR 30465 at commit [`985352e`](https://github.com

[GitHub] [spark] HyukjinKwon commented on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

HyukjinKwon commented on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733348463 @zero323, the only reason I have chosen `cols` over `*cols` is that I felt odds to just document this such as `*cols : tuple`, and thought `` cols: str, :class:`Column` ...

[GitHub] [spark] wangyum commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

wangyum commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-733348252 retest this please This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [spark] maropu commented on pull request #30485: [SPARK-33533][SQL] BasicConnectionProvider should consider case-sensitivity for properties.

maropu commented on pull request #30485: URL: https://github.com/apache/spark/pull/30485#issuecomment-733342960 cc: @gaborgsomogyi This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [spark] maropu commented on a change in pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

maropu commented on a change in pull request #30421: URL: https://github.com/apache/spark/pull/30421#discussion_r530024935 ## File path: docs/sql-ref-syntax-dml-insert-into.md ## @@ -198,6 +198,21 @@ SELECT * FROM students; +-+-+--+

[GitHub] [spark] SparkQA commented on pull request #30485: [SPARK-33533][SQL] BasicConnectionProvider should consider case-sensitivity for properties.

SparkQA commented on pull request #30485: URL: https://github.com/apache/spark/pull/30485#issuecomment-72418 **[Test build #131707 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131707/testReport)** for PR 30485 at commit [`247c7ba`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30471: [WIP][SPARK-33520][ML] make CrossValidator/TrainValidateSplit support Python backend estimator/model

AmplabJenkins removed a comment on pull request #30471: URL: https://github.com/apache/spark/pull/30471#issuecomment-733267314 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] sarutak commented on pull request #30485: [SPARK-33533][SQL] BasicConnectionProvider should consider case-sensitivity for properties.

sarutak commented on pull request #30485: URL: https://github.com/apache/spark/pull/30485#issuecomment-733329439 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] zero323 commented on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

zero323 commented on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733328865 __Side note__ @HyukjinKwon > Looking at [`numpy.ndarray.item`](https://numpy.org/devdocs/reference/generated/numpy.ndarray.item.html) we should make varargs expli

[GitHub] [spark] SparkQA commented on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

SparkQA commented on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733327260 **[Test build #131706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131706/testReport)** for PR 30413 at commit [`eca86aa`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

SparkQA commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733327084 **[Test build #131705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131705/testReport)** for PR 30486 at commit [`8e42ee8`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30467: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

AmplabJenkins removed a comment on pull request #30467: URL: https://github.com/apache/spark/pull/30467#issuecomment-733324379 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30212: [SPARK-33308][SQL] Refract current grouping analytics

AmplabJenkins removed a comment on pull request #30212: URL: https://github.com/apache/spark/pull/30212#issuecomment-733324377 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

AmplabJenkins removed a comment on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733324380 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

AmplabJenkins removed a comment on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733324374 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AmplabJenkins removed a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-733324368 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733324371 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

AmplabJenkins commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733324374 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733324371 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AmplabJenkins commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-733324368 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

AmplabJenkins commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733324380 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30212: [SPARK-33308][SQL] Refract current grouping analytics

AmplabJenkins commented on pull request #30212: URL: https://github.com/apache/spark/pull/30212#issuecomment-733324377 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30467: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

AmplabJenkins commented on pull request #30467: URL: https://github.com/apache/spark/pull/30467#issuecomment-733324379 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

<    1   2   3   4   5   6   7   8   9   10   >