[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-04-30 Thread MrBago
Github user MrBago commented on the issue:

https://github.com/apache/spark/pull/21195
  
Looking now.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Can one of the admins verify this patch?


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-01 Thread jkbradley
Github user jkbradley commented on the issue:

https://github.com/apache/spark/pull/21195
  
add to whitelist


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #89981 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89981/testReport)**
 for PR 21195 at commit 
[`45e6e96`](https://github.com/apache/spark/commit/45e6e96e974607ed0526401d0fdbb4f1c8161dd6).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #89981 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89981/testReport)**
 for PR 21195 at commit 
[`45e6e96`](https://github.com/apache/spark/commit/45e6e96e974607ed0526401d0fdbb4f1c8161dd6).
 * This patch **fails SparkR unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89981/
Test FAILed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Merged build finished. Test FAILed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #4166 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4166/testReport)**
 for PR 21195 at commit 
[`45e6e96`](https://github.com/apache/spark/commit/45e6e96e974607ed0526401d0fdbb4f1c8161dd6).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-01 Thread jkbradley
Github user jkbradley commented on the issue:

https://github.com/apache/spark/pull/21195
  
Rerunning tests in case the R CRAN failure was from flakiness


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #4166 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4166/testReport)**
 for PR 21195 at commit 
[`45e6e96`](https://github.com/apache/spark/commit/45e6e96e974607ed0526401d0fdbb4f1c8161dd6).
 * This patch **fails SparkR unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-02 Thread MrBago
Github user MrBago commented on the issue:

https://github.com/apache/spark/pull/21195
  
Thanks Lu!

I had a pass over this PR and it looks pretty straightforward. One thing I 
noticed is that there are two patterns that we keep repeating. I think we 
should add private APIs for these patterns and delegate to those.

The first pattern is the validate schema method defined in terms of 
typeCandidates. I suggest we add something like 
`validateVectorCompatibleColumn` to `DatasetUtils`. In addition to helping with 
code reuse, this api would make it easier if we ever decide, for example, to 
support Arrays of Ints.

The second pattern is going from a dataframe & column name to an 
rdd[OldVector]. Lets add a method that does this, maybe something like 
`(DataFrame, String) => RDD[OldVector]`.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-03 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #90160 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90160/testReport)**
 for PR 21195 at commit 
[`877c126`](https://github.com/apache/spark/commit/877c126ff493e43edb5a8bcf33e7dd1fe59503b0).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-03 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #90160 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90160/testReport)**
 for PR 21195 at commit 
[`877c126`](https://github.com/apache/spark/commit/877c126ff493e43edb5a8bcf33e7dd1fe59503b0).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90160/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #90233 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90233/testReport)**
 for PR 21195 at commit 
[`c7a14bb`](https://github.com/apache/spark/commit/c7a14bb14132ce8de084192b02fcdaa1922986a9).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-04 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #90233 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90233/testReport)**
 for PR 21195 at commit 
[`c7a14bb`](https://github.com/apache/spark/commit/c7a14bb14132ce8de084192b02fcdaa1922986a9).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90233/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-07 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #90335 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90335/testReport)**
 for PR 21195 at commit 
[`d065634`](https://github.com/apache/spark/commit/d065634ae70e5f0582eebcba84c90cc06e27e890).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-07 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #90335 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90335/testReport)**
 for PR 21195 at commit 
[`d065634`](https://github.com/apache/spark/commit/d065634ae70e5f0582eebcba84c90cc06e27e890).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90335/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-07 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #90344 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90344/testReport)**
 for PR 21195 at commit 
[`c9f478e`](https://github.com/apache/spark/commit/c9f478e990da34819828efc26c11149909e95ccc).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-07 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/21195
  
**[Test build #90344 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90344/testReport)**
 for PR 21195 at commit 
[`c9f478e`](https://github.com/apache/spark/commit/c9f478e990da34819828efc26c11149909e95ccc).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90344/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/21195
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #21195: [Spark-23975][ML] Add support of array input for all clu...

2018-05-07 Thread mengxr
Github user mengxr commented on the issue:

https://github.com/apache/spark/pull/21195
  
LGTM. Merged into master. Thanks!


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org