Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193632947
--- Diff: python/pyspark/sql/streaming.py ---
@@ -843,6 +844,169 @@ def trigger(self, processingTime=None, once=None,
continuous=None):
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193632883
--- Diff: python/pyspark/sql/streaming.py ---
@@ -843,6 +844,169 @@ def trigger(self, processingTime=None, once=None,
continuous=None):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21483
**[Test build #91516 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91516/testReport)**
for PR 21483 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91516/
Test PASSed.
---
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193631566
--- Diff: python/pyspark/sql/streaming.py ---
@@ -843,6 +844,169 @@ def trigger(self, processingTime=None, once=None,
continuous=None):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21482
**[Test build #91518 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91518/testReport)**
for PR 21482 at commit
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21477#discussion_r193631209
--- Diff: python/pyspark/sql/streaming.py ---
@@ -843,6 +844,169 @@ def trigger(self, processingTime=None, once=None,
continuous=None):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3829/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21483
**[Test build #91515 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91515/testReport)**
for PR 21483 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91515/
Test PASSed.
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21482#discussion_r193630041
--- Diff: R/pkg/NAMESPACE ---
@@ -281,6 +281,8 @@ exportMethods("%<=>%",
"initcap",
"input_file_name",
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21483
**[Test build #91516 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91516/testReport)**
for PR 21483 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21482
**[Test build #91517 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91517/testReport)**
for PR 21482 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91514/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21483
**[Test build #91514 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91514/testReport)**
for PR 21483 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3828/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21483
**[Test build #91515 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91515/testReport)**
for PR 21483 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21483
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3827/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21483
**[Test build #91514 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91514/testReport)**
for PR 21483 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21504
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91510/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21504
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21504
**[Test build #91510 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91510/testReport)**
for PR 21504 at commit
Github user HeartSaVioR commented on the issue:
https://github.com/apache/spark/pull/21500
@TomaszGaweda @aalobaidi
Please correct me if I'm missing here.
From every start of batch, state store loads previous version of state so
that it can be read and written. If we
Github user HeartSaVioR commented on a diff in the pull request:
https://github.com/apache/spark/pull/21469#discussion_r193622940
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryListenerSuite.scala
---
@@ -231,7 +231,7 @@ class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18900
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91513/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18900
**[Test build #91513 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91513/testReport)**
for PR 18900 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18900
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18900
**[Test build #91513 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91513/testReport)**
for PR 18900 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18900
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18900
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91512/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18900
**[Test build #91512 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91512/testReport)**
for PR 18900 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18900
**[Test build #91512 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91512/testReport)**
for PR 18900 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21499#discussion_r193618762
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/types/DecimalType.scala ---
@@ -161,13 +161,17 @@ object DecimalType extends AbstractDataType
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21469
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91509/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21469
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21469
**[Test build #91509 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91509/testReport)**
for PR 21469 at commit
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/21498#discussion_r193618338
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -1099,6 +1099,17 @@ object SQLConf {
.intConf
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/21498
I set up a Spark cluster with 5 nodes on EC2.
```scala
def benchmark(func: () => Unit): Unit = {
val t0 = System.nanoTime()
func()
val t1 = System.nanoTime()
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18900
**[Test build #91511 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91511/testReport)**
for PR 18900 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18900
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91511/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18900
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18900
**[Test build #91511 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91511/testReport)**
for PR 18900 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18900
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18900
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18900
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user debugger87 reopened a pull request:
https://github.com/apache/spark/pull/18900
[SPARK-21687][SQL] Spark SQL should set createTime for Hive partition
## What changes were proposed in this pull request?
Set createTime for every hive partition created in Spark SQL,
Github user debugger87 commented on the issue:
https://github.com/apache/spark/pull/18900
@cxzl25 OK, reopen it
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21501#discussion_r193604620
--- Diff: python/pyspark/ml/feature.py ---
@@ -2582,25 +2582,27 @@ class StopWordsRemover(JavaTransformer,
HasInputCol, HasOutputCol, JavaMLReadabl
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21504#discussion_r193604356
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryListenersConfSuite.scala
---
@@ -0,0 +1,66 @@
+/*
+ * Licensed
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21504#discussion_r193603810
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryManager.scala
---
@@ -55,6 +56,12 @@ class StreamingQueryManager
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21504
Mind fixing the PR title to `[SPARK-24479][SS] Added config for registering
streamingQueryListeners`?
---
-
To unsubscribe,
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/21482
@henryr 1.0/0.0 also returns null in Spark SQL ...
```
scala> sql("select cast(1.0 as double)/cast(0 as double)").show()
+-+
|(CAST(1.0 AS
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21504
**[Test build #91510 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91510/testReport)**
for PR 21504 at commit
GitHub user arunmahadevan opened a pull request:
https://github.com/apache/spark/pull/21504
SPARK-24480: Added config for registering streamingQueryListeners
## What changes were proposed in this pull request?
Currently a "StreamingQueryListener" can only be registered
Github user arunmahadevan commented on the issue:
https://github.com/apache/spark/pull/21504
ping @tdas @jose-torres @HeartSaVioR
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21504
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21503
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91507/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21503
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21503
**[Test build #91507 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91507/testReport)**
for PR 21503 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21469
**[Test build #91509 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91509/testReport)**
for PR 21469 at commit
Github user henryr commented on the issue:
https://github.com/apache/spark/pull/21482
@rxin Other engines are all over the place:
* MySQL doesn't have support for infinity (based on my cursory look) - 1.0
/ 0.0 is written as `null`. Also seems to be true of SQLite.
*
Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
There is only
target/surefire-reports/TEST-org.apache.spark.sql.kafka010.KafkaMicroBatchV2SourceSuite.xml
under target/surefire-reports
That file doesn't contain test output.
---
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/20929
@maropu Thanks for updating this PR! It would be easier to maintain the
logic in one place. I think it should be feasible to do everything inside
`canonicalizeType` without modifying `JsonParser` or
Github user guozhangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21488#discussion_r193574097
--- Diff:
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaTestUtils.scala
---
@@ -203,7 +215,13 @@ class
Github user maasg commented on the issue:
https://github.com/apache/spark/pull/21194
@zsxwing Thanks for dropping by. This patch is about fixing the rate ramp
up when `rowsPerSecond <= rampUpTime`, which makes the Rate Source produce no
data until `rampUpTime` (See
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3826/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91508 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91508/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21488
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91508/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21488
**[Test build #91508 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91508/testReport)**
for PR 21488 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21503
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3825/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21503
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user eric-maynard commented on a diff in the pull request:
https://github.com/apache/spark/pull/21488#discussion_r193549547
--- Diff: external/kafka-0-10-sql/pom.xml ---
@@ -29,7 +29,7 @@
spark-sql-kafka-0-10_2.11
sql-kafka-0-10
-0.10.0.1
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21319
Here's the commit with my changes to support v2 stats in the visitor, sorry
it took so long for me to find the time!
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21503
**[Test build #91507 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91507/testReport)**
for PR 21503 at commit
GitHub user rdblue opened a pull request:
https://github.com/apache/spark/pull/21503
[SPARK-24478][SQL] Move projection and filter push down to physical
conversion
## What changes were proposed in this pull request?
This removes the v2 optimizer rule for push-down and
Github user superbobry commented on the issue:
https://github.com/apache/spark/pull/21180
Friendly ping @HyukjinKwon.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21502
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91505/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21502
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21502
**[Test build #91505 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91505/testReport)**
for PR 21502 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21483
Ah, maybe I rushed to read the JIRA. For 2. there are already single
attribute being loaded `ImageSchema` since all other attributes has an
underscore; however, sure, it should be the best to
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/21483
Created https://issues.apache.org/jira/browse/SPARK-24477 for 1).
---
-
To unsubscribe, e-mail:
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/21483
@HyukjinKwon Sorry I created the JIRA in a rush. I think there are two
issues:
1) Modules under pyspark.ml are not imported by default, e.g., clustering,
image, etc. So users cannot do
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21501
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91506/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21501
**[Test build #91506 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91506/testReport)**
for PR 21501 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21501
**[Test build #91506 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91506/testReport)**
for PR 21501 at commit
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/21501
jenkins test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/21501#discussion_r193494337
--- Diff:
mllib/src/test/scala/org/apache/spark/ml/feature/StopWordsRemoverSuite.scala ---
@@ -65,6 +67,56 @@ class StopWordsRemoverSuite extends MLTest
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/21501#discussion_r193493040
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/feature/StopWordsRemover.scala ---
@@ -84,7 +86,36 @@ class StopWordsRemover @Since("1.5.0")
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/21501#discussion_r193493174
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/feature/StopWordsRemover.scala ---
@@ -84,7 +86,36 @@ class StopWordsRemover @Since("1.5.0")
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/21494
@Ngone51 You can refer to the SPIP that xiangrui proposed in SPARK-24374
for a basic background and major goal of barrier scheduling, and you can also
refer to SPARK-24375 for a design sketch.
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/21501#discussion_r193492568
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/feature/StopWordsRemover.scala ---
@@ -84,7 +86,36 @@ class StopWordsRemover @Since("1.5.0")
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/21501#discussion_r193492802
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/feature/StopWordsRemover.scala ---
@@ -84,7 +86,36 @@ class StopWordsRemover @Since("1.5.0")
1 - 100 of 188 matches
Mail list logo
