[GitHub] spark pull request: [SPARK-10053] Export lapply and lapplyPartitio...
Github user reactormonk commented on the pull request: https://github.com/apache/spark/pull/8240#issuecomment-132560703 I haven't found any documentation on how to write UDFs with R. https://issues.apache.org/jira/browse/SPARK-6817 tells me it's not going to happen anytime soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6919 [PYSPARK] Add asDict method to Stat...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5516#issuecomment-132571806 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10110] StringIndexer lacks of parameter...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8310#issuecomment-132592882 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10111][PySpark] StringIndexerModel lack...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8311#issuecomment-132601493 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10111][PySpark] StringIndexerModel lack...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8311#issuecomment-132601446 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132604042 [Test build #41243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41243/consoleFull) for PR 8264 at commit [`ea5904c`](https://github.com/apache/spark/commit/ea5904cb1a69f8e609623cc0a3976ce9738a6ddf). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10040][SQL] Use batch insert for JDBC w...
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/8273#issuecomment-132549915 /CC @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Fixed a typo in DAGScheduler.
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8308#issuecomment-132559067 I think the additional changes I mentioned are worth fixing here since they're very much of the same form. If you have time to scan for similar problems in nearby source, that's fine, but fixing all the related issues in this file seems like a good logical change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9772] [PySpark] [ML] Add Python API for...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8102#issuecomment-132560134 **[Test build #41230 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41230/console)** for PR 8102 at commit [`5d2f75b`](https://github.com/apache/spark/commit/5d2f75bdd4ab0592a630631299542771917c5f79) after a configured wait of `175m`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9772] [PySpark] [ML] Add Python API for...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8102#issuecomment-132560183 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9772] [PySpark] [ML] Add Python API for...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8102#issuecomment-132560185 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41230/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-8949 - Print warnings when using preferr...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7874#issuecomment-132563477 **[Test build #41231 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41231/console)** for PR 7874 at commit [`764a7ba`](https://github.com/apache/spark/commit/764a7ba319327b7f7e26140ad33213762acc99fc) after a configured wait of `175m`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-8949 - Print warnings when using preferr...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7874#issuecomment-132563638 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41231/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-8949 - Print warnings when using preferr...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7874 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10108] Add since tags to mllib.feature
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8309#issuecomment-132571063 [Test build #41236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41236/console) for PR 8309 at commit [`d74ced6`](https://github.com/apache/spark/commit/d74ced64b6255a953646f44b6767e167ab16b5e3). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10111][PySpark] StringIndexerModel lack...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8311#issuecomment-132602862 [Test build #41241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41241/consoleFull) for PR 8311 at commit [`c487c1f`](https://github.com/apache/spark/commit/c487c1f83cc341a7b1e649d18211957969ef1a80). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PARK-6489][SQL] add column pruning for Genera...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8268#issuecomment-132605286 [Test build #41242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41242/consoleFull) for PR 8268 at commit [`2ce282e`](https://github.com/apache/spark/commit/2ce282ea65141597cd1bf181c168b7525db24807). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Fixed a typo in DAGScheduler.
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8308#issuecomment-132607672 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-8918 Add @since tags to mllib.clustering
Github user yu-iskw commented on a diff in the pull request:
https://github.com/apache/spark/pull/8256#discussion_r37416961
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModel.scala
---
@@ -53,32 +54,48 @@ class GaussianMixtureModel(
override protected def formatVersion = 1.0
+ /**
+ * @since 1.4.0
+ */
override def save(sc: SparkContext, path: String): Unit = {
GaussianMixtureModel.SaveLoadV1_0.save(sc, path, weights, gaussians)
}
- /** Number of gaussians in mixture */
+ /**
+ * Number of gaussians in mixture
+ * @since 1.3.0
+ */
def k: Int = weights.length
- /** Maps given points to their cluster indices. */
+ /**
+ * Maps given points to their cluster indices.
+ * @since 1.3.0
+ */
def predict(points: RDD[Vector]): RDD[Int] = {
val responsibilityMatrix = predictSoft(points)
responsibilityMatrix.map(r = r.indexOf(r.max))
}
- /** Maps given point to its cluster index. */
+ /**
+ * Maps given point to its cluster index.
+ * @since 1.4.0
+ */
def predict(point: Vector): Int = {
--- End diff --
I think `1.5.0` is better. Actually, this method exists in the
`branch-1.4` branch. However, it isn't in the `v1.4.0` tag and the `v1.4.1`
tag. At least, the API documentation of each version don't have it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8889] [Core]: Fix for OOM for graph cre...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7602#issuecomment-132560076 [Test build #1666 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1666/console) for PR 7602 at commit [`eee1733`](https://github.com/apache/spark/commit/eee1733200028266ffe59f8c24e16bd528a8cfc5). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10017] [MLlib]: ML model broadcasts sho...
Github user sabhyankar commented on a diff in the pull request:
https://github.com/apache/spark/pull/8241#discussion_r37410650
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/classification/NaiveBayes.scala ---
@@ -83,9 +86,13 @@ class NaiveBayesModel private[spark] (
}
override def predict(testData: RDD[Vector]): RDD[Double] = {
-val bcModel = testData.context.broadcast(this)
+bcModel match {
--- End diff --
That makes sense. I initially started with just this Jira and once the PR
was ready, I realized the rest of them had similar fixes! Let me put something
together for this one and if it looks good, i will reproduce for the other PRs.
I will update this PR shortly. Thx!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6919 [PYSPARK] Add asDict method to Stat...
Github user eshilts commented on the pull request: https://github.com/apache/spark/pull/5516#issuecomment-132584944 AFAICT, the build fails on files I haven't touched. I get assorted failures unrelated to this patch when running all tests locally, too. I'm not sure why that is. From Jenkins: ``` FAIL: test_trainOn_predictOn (__main__.StreamingKMeansTest) Test that prediction happens on the updated model. ... Had test failures in pyspark.mllib.tests with python2.6; see logs. ``` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132590726 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41240/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132590724 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10111][PySpark] StringIndexerModel lack...
GitHub user Lewuathe opened a pull request: https://github.com/apache/spark/pull/8311 [SPARK-10111][PySpark] StringIndexerModel lacks of method labels PySpark `StringIndexerModel` implements `labels` property. You can merge this pull request into a Git repository by running: $ git pull https://github.com/Lewuathe/spark SPARK-10111 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8311.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8311 commit c487c1f83cc341a7b1e649d18211957969ef1a80 Author: lewuathe lewua...@me.com Date: 2015-08-19T13:32:42Z PySpark StringIndexerModel implements labels property --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132602958 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10073] [SQL] Python withColumn should r...
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/8300#discussion_r37415899
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1223,10 +1226,8 @@ def withColumnRenamed(self, existing, new):
df.withColumnRenamed('age', 'age2').collect()
[Row(age2=2, name=u'Alice'), Row(age2=5, name=u'Bob')]
-cols = [Column(_to_java_column(c)).alias(new)
-if c == existing else c
-for c in self.columns]
-return self.select(*cols)
+assert existing in self.columns, %s is not an existing column %
existing
--- End diff --
This is not consistent with scala version, see the
[doc](https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala#L1173),
we should not report error here.
Actually I'm wondering why we need to do checking at python side(not only
this one)? Can we just call the scala API and catch the java exception?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10084] [MLlib] [Doc] Add Python example...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8279#issuecomment-132554181 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41227/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10108] Add since tags to mllib.feature
GitHub user MechCoder opened a pull request: https://github.com/apache/spark/pull/8309 [SPARK-10108] Add since tags to mllib.feature You can merge this pull request into a Git repository by running: $ git pull https://github.com/MechCoder/spark tags_feature Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8309.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8309 commit d74ced64b6255a953646f44b6767e167ab16b5e3 Author: MechCoder manojkumarsivaraj...@gmail.com Date: 2015-08-19T11:28:49Z [SPARK-10108] Add since tags to mllib.feature --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10084] [MLlib] [Doc] Add Python example...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8279#issuecomment-132554178 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9893] user guide for VectorSlicer
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8267#issuecomment-132557394 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41237/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9893] user guide for VectorSlicer
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8267#issuecomment-132557389 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-8949 - Print warnings when using preferr...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7874#issuecomment-132561008 [Test build #1667 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1667/console) for PR 7874 at commit [`5a7b761`](https://github.com/apache/spark/commit/5a7b761ce2ffa5458d773cbe3cf77da778f6a6fa). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10048][SPARKR] Support arbitrary nested...
Github user sun-rui commented on the pull request:
https://github.com/apache/spark/pull/8276#issuecomment-132571243
@shivaram, I tried to support ArrayType. By adding code like:
// Convert Seq[Any] to Array[Any]
val value =
if (obj.isInstanceOf[Seq[Any]]) {
obj.asInstanceOf[Seq[Any]].toArray
} else {
obj
}
I can collect successfully ArrayType on R side.
However, this confilicts with listToSeq() R util functions, because
listToSeq() expects to get a jobj to the seq, while SerDe passes back the
content of seq instead of jobj. So I think we need some mechanism telling the
RBackend what we want a jobj or its content?
Adding support for ArrayType would make this PR big and hard to review. I
would be better you could look at this PR and merge it.
I know you have a concern as we don't have test cases for this PR. Maybe I
can add test cases for SerDe:
Add a function called Echo() in RBackend, it is for test-only purpose. It
can pass args back to R side. args could be array, nested array, etc...
What do you think?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6919 [PYSPARK] Add asDict method to Stat...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5516#issuecomment-132577837 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6919 [PYSPARK] Add asDict method to Stat...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5516#issuecomment-132577801 [Test build #41238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41238/console) for PR 5516 at commit [`9cd5858`](https://github.com/apache/spark/commit/9cd5858d042cd19716b6395e8ac2626b1db04c1e). * This patch **fails PySpark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6919 [PYSPARK] Add asDict method to Stat...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5516#issuecomment-132577839 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41238/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10110] StringIndexer lacks of parameter...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8310#issuecomment-132592884 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41239/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-8918 Add @since tags to mllib.clustering
Github user yu-iskw commented on a diff in the pull request:
https://github.com/apache/spark/pull/8256#discussion_r37418372
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala ---
@@ -430,11 +430,14 @@ class KMeans private (
/**
* Top-level methods for calling K-means clustering.
+ * @since 0.8.0
*/
object KMeans {
// Initialization mode names
+ /** @since 0.8.0 */
val RANDOM = random
+ /** @since 0.8.0 */
--- End diff --
ditto
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6919 [PYSPARK] Add asDict method to Stat...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5516#issuecomment-132571833 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10110] StringIndexer lacks of parameter...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8310#issuecomment-132584034 [Test build #41239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41239/consoleFull) for PR 8310 at commit [`1fd0d39`](https://github.com/apache/spark/commit/1fd0d390eb4cae1d80bae9bee3d6a042fa030446). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132586765 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132587189 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132587149 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Add optional getters to the Row
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8312#issuecomment-132614509 Please look at https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark before opening a PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9439] [yarn] External shuffle service r...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7943#issuecomment-132614380 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10084] [MLlib] [Doc] Add Python example...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8279#issuecomment-132554106 **[Test build #41227 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41227/console)** for PR 8279 at commit [`1630f93`](https://github.com/apache/spark/commit/1630f9344141388865f910f6d7af172fd88b247a) after a configured wait of `175m`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132554058 [Test build #41235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41235/consoleFull) for PR 8296 at commit [`40e28e3`](https://github.com/apache/spark/commit/40e28e3f0101a04884b61d77ebdc4911128ce4f9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9613] [CORE] Ban use of JavaConversions...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8033#issuecomment-132565831 [Test build #1668 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1668/consoleFull) for PR 8033 at commit [`45f3f2e`](https://github.com/apache/spark/commit/45f3f2e1bd19654ab2997a88e16cbb8abe237d14). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10110] StringIndexer lacks of parameter...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8310#issuecomment-132583429 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10110] StringIndexer lacks of parameter...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8310#issuecomment-132583366 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Add optional getters to the Row
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8312#issuecomment-132607361 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Fixed a typo in DAGScheduler.
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8308#issuecomment-132607676 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41234/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Fixed a typo in DAGScheduler.
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8308#issuecomment-132607463 [Test build #41234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41234/console) for PR 8308 at commit [`2a70faf`](https://github.com/apache/spark/commit/2a70fafa1acef35867e9545c5e95271550de68a2). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-8918 Add @since tags to mllib.clustering
Github user yu-iskw commented on a diff in the pull request:
https://github.com/apache/spark/pull/8256#discussion_r37418271
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala ---
@@ -430,11 +430,14 @@ class KMeans private (
/**
* Top-level methods for calling K-means clustering.
+ * @since 0.8.0
*/
object KMeans {
// Initialization mode names
+ /** @since 0.8.0 */
--- End diff --
I don't think we need to add it to variables.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9439] [yarn] External shuffle service r...
Github user squito commented on the pull request: https://github.com/apache/spark/pull/7943#issuecomment-132614143 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9439] [yarn] External shuffle service r...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7943#issuecomment-132614365 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10040][SQL] Use batch insert for JDBC w...
Github user sarutak commented on a diff in the pull request:
https://github.com/apache/spark/pull/8273#discussion_r37403257
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala
---
@@ -122,7 +123,15 @@ object JdbcUtils extends Logging {
}
i = i + 1
}
- stmt.executeUpdate()
+ stmt.addBatch()
+ rowCount += 1
+ if (rowCount % 1 == 0) {
--- End diff --
How about allowing users to configure this value rather than use fixed
value(1) to avoid OOM?.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132551589 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Fixed a typo in DAGScheduler.
Github user ehnalis commented on the pull request: https://github.com/apache/spark/pull/8308#issuecomment-13238 Would you like if I go through all of them? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9893] user guide for VectorSlicer
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8267#issuecomment-132555177 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10108] Add since tags to mllib.feature
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/8309#issuecomment-132555433 @mengxr --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8889] [Core]: Fix for OOM for graph cre...
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/7602#issuecomment-132564803 There we go, tests pass. What do you think @andrewor14 ? I'm OK with it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132603641 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132603669 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Add optional getters to the Row
GitHub user crakjie opened a pull request: https://github.com/apache/spark/pull/8312 Add optional getters to the Row Add a clean syntax to request nullable field You can merge this pull request into a Git repository by running: $ git pull https://github.com/crakjie/spark master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8312.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8312 commit 52279d6c0c274ffd8acbe21d26888471c7e99523 Author: etienne w...@hotmail.fr Date: 2015-08-19T13:39:58Z Add optional getters to the Row Add a clean syntax to request nullable field --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132552593 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132552618 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9893] user guide for VectorSlicer
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8267#issuecomment-132555089 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10108] Add since tags to mllib.feature
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8309#issuecomment-132555078 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10108] Add since tags to mllib.feature
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8309#issuecomment-132555178 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10108] Add since tags to mllib.feature
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8309#issuecomment-132571221 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10108] Add since tags to mllib.feature
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8309#issuecomment-132571222 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41236/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132586137 [Test build #41233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41233/console) for PR 8264 at commit [`ea5904c`](https://github.com/apache/spark/commit/ea5904cb1a69f8e609623cc0a3976ce9738a6ddf). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9856][SparkR] Add expression functions ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8264#issuecomment-132586295 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41233/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10110] StringIndexer lacks of parameter...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8310#issuecomment-132592417 [Test build #41239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41239/console) for PR 8310 at commit [`1fd0d39`](https://github.com/apache/spark/commit/1fd0d390eb4cae1d80bae9bee3d6a042fa030446). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10108] Add since tags to mllib.feature
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8309#issuecomment-132556766 [Test build #41236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41236/consoleFull) for PR 8309 at commit [`d74ced6`](https://github.com/apache/spark/commit/d74ced64b6255a953646f44b6767e167ab16b5e3). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-8949 - Print warnings when using preferr...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7874#issuecomment-132563634 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6919 [PYSPARK] Add asDict method to Stat...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5516#issuecomment-132572432 [Test build #41238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41238/consoleFull) for PR 5516 at commit [`9cd5858`](https://github.com/apache/spark/commit/9cd5858d042cd19716b6395e8ac2626b1db04c1e). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10110] StringIndexer lacks of parameter...
GitHub user Lewuathe opened a pull request: https://github.com/apache/spark/pull/8310 [SPARK-10110] StringIndexer lacks of parameter handleInvalid. Pyspark StringIndexer should implement handleInvalid API You can merge this pull request into a Git repository by running: $ git pull https://github.com/Lewuathe/spark SPARK-10110 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8310.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8310 commit 1fd0d390eb4cae1d80bae9bee3d6a042fa030446 Author: lewuathe lewua...@me.com Date: 2015-08-19T12:58:33Z Pyspark StringIndexer implements handleInvalid API --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PARK-6489][SQL] add column pruning for Genera...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8268#issuecomment-132603652 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PARK-6489][SQL] add column pruning for Genera...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8268#issuecomment-132603633 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10111][PySpark] StringIndexerModel lack...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8311#issuecomment-132606367 [Test build #41241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41241/console) for PR 8311 at commit [`c487c1f`](https://github.com/apache/spark/commit/c487c1f83cc341a7b1e649d18211957969ef1a80). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10111][PySpark] StringIndexerModel lack...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8311#issuecomment-132606569 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41241/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10111][PySpark] StringIndexerModel lack...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8311#issuecomment-132606566 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PARK-6489][SQL] add column pruning for Genera...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8268#issuecomment-132616734 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PARK-6489][SQL] add column pruning for Genera...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8268#issuecomment-132616663 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PARK-6489][SQL] add column pruning for Genera...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8268#issuecomment-132618969 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8918] [MLLIB] [DOC] Add @since tags to ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8288#issuecomment-132624923 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8918] [MLLIB] [DOC] Add @since tags to ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8288#issuecomment-132624956 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10084] [MLlib] [Doc] Add Python example...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8279#issuecomment-132635550 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PARK-6489][SQL] add column pruning for Genera...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8268#issuecomment-132635590 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6190][core] create LargeByteBuffer for ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5400#issuecomment-132644806 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10084] [MLlib] [Doc] Add Python example...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8279#issuecomment-132650927 [Test build #41252 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41252/console) for PR 8279 at commit [`55ca6f7`](https://github.com/apache/spark/commit/55ca6f77c2518d3077de4bc2b7fb1a22cf3f53b2). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PARK-6489][SQL] add column pruning for Genera...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8268#issuecomment-132665588 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41242/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10040][SQL] Use batch insert for JDBC w...
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/8273#discussion_r37434622
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala
---
@@ -122,7 +123,15 @@ object JdbcUtils extends Logging {
}
i = i + 1
}
- stmt.executeUpdate()
+ stmt.addBatch()
+ rowCount += 1
+ if (rowCount % 1 == 0) {
--- End diff --
I thought it might not worth adding a configuration for it before. But
seems it is hard to decide a proper batch size now. So I add a configuration as
you suggested. Thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132619920 [Test build #1669 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1669/consoleFull) for PR 8296 at commit [`40e28e3`](https://github.com/apache/spark/commit/40e28e3f0101a04884b61d77ebdc4911128ce4f9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8918] [MLLIB] [DOC] Add @since tags to ...
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/8288#issuecomment-132621530 @MechCoder Alright. Thank you for letting me know. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10108] Add since tags to mllib.feature
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8309#issuecomment-132625744 No, for existing PRs, we ask the authors to stay with `@since` tags because most of them are first-time contributors. For new PRs, we should use `@Since` annotation directly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10017] [MLlib]: ML model broadcasts sho...
Github user sabhyankar commented on the pull request: https://github.com/apache/spark/pull/8241#issuecomment-132631199 Hi @holdenk I have moved the common logic to a trait and am mixin it with the model. Let me know if you see something that needs to be corrected. I am still getting familiar with Spark and the coding standards so I may have missed something! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
