[GitHub] spark pull request: [SPARK-9493] [ML] add featureIndex to handle v...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7952#issuecomment-128271511 [Test build #243 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/243/console) for PR 7952 at commit [`05e2216`](https://github.com/apache/spark/commit/05e22165d109b71d5b10374b6f39a744fa70050c). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class IsotonicRegression(override val uid: String) extends Estimator[IsotonicRegressionModel]` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128271508 [Test build #40002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40002/consoleFull) for PR 7883 at commit [`d2f2c30`](https://github.com/apache/spark/commit/d2f2c30d9c5e0a507e7c878c3721f2301bb61354). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9493] [ML] add featureIndex to handle v...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7952#issuecomment-128271589 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9563][SQL] Remove repartition operators...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7959#issuecomment-128271595 [Test build #4 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/4/consoleFull) for PR 7959 at commit [`4ba7a38`](https://github.com/apache/spark/commit/4ba7a388f880c3864aec2fbb2ebd1a093e941194). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9493] [ML] add featureIndex to handle v...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7952#issuecomment-128271845 [Test build #39995 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39995/console) for PR 7952 at commit [`05e2216`](https://github.com/apache/spark/commit/05e22165d109b71d5b10374b6f39a744fa70050c). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class IsotonicRegression(override val uid: String) extends Estimator[IsotonicRegressionModel]` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6212][SQL] Fix bug of explain CTAS
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7980#issuecomment-128271843 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6212][SQL] Fix bug of explain CTAS
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7980#issuecomment-128271857 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9493] [ML] add featureIndex to handle v...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7952#issuecomment-128271948 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6212][SQL] Fix bug of explain CTAS
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7980#issuecomment-128271947 [Test build #40003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40003/consoleFull) for PR 7980 at commit [`8dc37e9`](https://github.com/apache/spark/commit/8dc37e9ecdaef4f0816e3169e02b98feb097314c). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9630] [SQL] Clean up new aggregate oper...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7954#issuecomment-128272094 [Test build #39991 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39991/console) for PR 7954 at commit [`34fa17b`](https://github.com/apache/spark/commit/34fa17bc9f1b85a0f3ae3bf1c2465c03990aa470). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9630] [SQL] Clean up new aggregate oper...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7954#issuecomment-128272194 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9659][SQL] Rename inSet to isin to matc...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7977#issuecomment-128272297 [Test build #40001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40001/consoleFull) for PR 7977 at commit [`9b1d3d6`](https://github.com/apache/spark/commit/9b1d3d676a1a029c2d669b9bc5e95ae546a59646). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9482] [SQL] Fix thread-safey issue of u...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7940#issuecomment-128272555 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9482] [SQL] Fix thread-safey issue of u...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7940#issuecomment-128272563 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8266][SQL]add function translate
Github user davies commented on the pull request: https://github.com/apache/spark/pull/7709#issuecomment-128272904 LGTM, waiting for tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128273343 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128273367 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9482] [SQL] Fix thread-safey issue of u...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7940#issuecomment-128273431 [Test build #40004 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40004/consoleFull) for PR 7940 at commit [`93baac7`](https://github.com/apache/spark/commit/93baac7d48eafbc791d1a5e9e390e767068e1dd6). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9630] [SQL] Clean up new aggregate oper...
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/7954#discussion_r36386807
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala
---
@@ -0,0 +1,663 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.aggregate
+
+import org.apache.spark.unsafe.KVIterator
+import org.apache.spark.{Logging, SparkEnv, TaskContext}
+import org.apache.spark.sql.catalyst.expressions._
+import org.apache.spark.sql.catalyst.expressions.aggregate._
+import
org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner
+import org.apache.spark.sql.execution.{UnsafeKVExternalSorter,
UnsafeFixedWidthAggregationMap}
+import org.apache.spark.sql.types.StructType
+
+/**
+ * An iterator used to evaluate aggregate functions. It operates on
[[UnsafeRow]]s.
+ *
+ * This iterator first uses hash-based aggregation to process input rows.
It uses
+ * a hash map to store groups and their corresponding aggregation buffers.
If we
+ * this map cannot allocate memory from
[[org.apache.spark.shuffle.ShuffleMemoryManager]],
+ * it switches to sort-based aggregation. The process of the switch has
the following step:
+ * - Step 1: Sort all entries of the hash map based on values of grouping
expressions and
+ *spill them to disk.
+ * - Step 2: Create a external sorter based on the spilled sorted map
entries.
+ * - Step 3: Redirect all input rows to the external sorter.
+ * - Step 4: Get a sorted [[KVIterator]] from the external sorter.
+ * - Step 5: Initialize sort-based aggregation.
+ * Then, this iterator works in the way of sort-based aggregation.
+ *
+ * The code of this class is organized as follows:
+ * - Part 1: Initializing aggregate functions.
+ * - Part 2: Methods and fields used by setting aggregation buffer values,
+ *processing input rows from inputIter, and generating output
+ *rows.
+ * - Part 3: Methods and fields used by hash-based aggregation.
+ * - Part 4: The function used to switch this iterator from hash-based
+ *aggregation to sort-based aggregation.
+ * - Part 5: Methods and fields used by sort-based aggregation.
+ * - Part 6: Loads input and process input rows.
+ * - Part 7: Public methods of this iterator.
+ * - Part 8: A utility function used to generate a result when there is no
+ *input and there is no grouping expression.
+ *
+ * @param groupingExpressions
+ * expressions for grouping keys
+ * @param nonCompleteAggregateExpressions
+ * [[AggregateExpression2]] containing [[AggregateFunction2]]s with mode
[[Partial]],
+ * [[PartialMerge]], or [[Final]].
+ * @param completeAggregateExpressions
+ * [[AggregateExpression2]] containing [[AggregateFunction2]]s with mode
[[Complete]].
+ * @param initialInputBufferOffset
+ * If this iterator is used to handle functions with mode
[[PartialMerge]] or [[Final]].
+ * The input rows have the format of `grouping keys + aggregation
buffer`.
+ * This offset indicates the starting position of aggregation buffer in
a input row.
+ * @param resultExpressions
+ * expressions for generating output rows.
+ * @param newMutableProjection
+ * the function used to create mutable projections.
+ * @param originalInputAttributes
+ * attributes of representing input rows from `inputIter`.
+ * @param inputIter
+ * the iterator containing input [[UnsafeRow]]s.
+ */
+class TungstenAggregationIterator(
+groupingExpressions: Seq[NamedExpression],
+nonCompleteAggregateExpressions: Seq[AggregateExpression2],
+completeAggregateExpressions: Seq[AggregateExpression2],
+initialInputBufferOffset: Int,
+resultExpressions: Seq[NamedExpression],
+newMutableProjection: (Seq[Expression], Seq[Attribute]) => (() =>
MutableProjection),
+or
[GitHub] spark pull request: [SPARK-8920] [MLlib] Add @since tags to mllib....
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/7729#discussion_r36386866 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -254,6 +255,7 @@ class DenseMatrix( * @param numRows number of rows * @param numCols number of columns * @param values matrix entries in column major + * @since 1.3.0 */ def this(numRows: Int, numCols: Int, values: Array[Double]) = --- End diff -- Here? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8920] [MLlib] Add @since tags to mllib....
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/7729#discussion_r36386883 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -513,6 +539,7 @@ class SparseMatrix( * @param rowIndices the row index of the entry. They must be in strictly increasing * order for each column * @param values non-zero matrix entries in column major + * @since 1.3.0 */ def this( --- End diff -- Here as well. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128274085 [Test build #40005 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40005/console) for PR 7883 at commit [`fad3c95`](https://github.com/apache/spark/commit/fad3c95a8d7cbd2de37f29e8d95a4b9271c64cbb). * This patch **fails some tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128274088 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128273980 [Test build #40005 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40005/consoleFull) for PR 7883 at commit [`fad3c95`](https://github.com/apache/spark/commit/fad3c95a8d7cbd2de37f29e8d95a4b9271c64cbb). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8920] [MLlib] Add @since tags to mllib....
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/7729#issuecomment-128274008 That's it apart from those couple of comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
GitHub user ericl opened a pull request:
https://github.com/apache/spark/pull/7987
[SPARK-9681] [ML] Support R feature interactions in RFormula
This adds support for the interaction (":") operator to the RFormula
feature transformer.
Design doc from umbrella task:
https://docs.google.com/document/d/10NZNSEurN2EdWM31uFYsgayIPfCFHiuIu3pCWrUmP_c/edit
@mengxr
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ericl/spark interaction
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7987.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7987
commit 429cb520682dcd446f01e204f178b5c0c932e6cf
Author: Eric Liang
Date: 2015-08-04T01:32:54Z
first pass
commit 0ece16cd2e30403f4fa8c5473e6cb6e7930ae52f
Author: Eric Liang
Date: 2015-08-04T03:29:16Z
compiles now
commit ab2a3477512aba52f69f3ccd0bfe620b2da0cb39
Author: Eric Liang
Date: 2015-08-05T01:14:31Z
combiner
commit a3623aa6cbb2e248b45b489cfb216c9d87bc7c86
Author: Eric Liang
Date: 2015-08-05T03:32:39Z
attribute generation
commit a12e58e58e7a9c44611124d21c6172cb0a4c6b53
Author: Eric Liang
Date: 2015-08-05T22:58:14Z
Wed Aug 5 15:58:14 PDT 2015
commit dc8801a31cd7806ccd1e4ef902568e1d9bc85e94
Author: Eric Liang
Date: 2015-08-06T02:59:50Z
Wed Aug 5 19:59:50 PDT 2015
commit 2957cb686264303344c02b96e5ce166a7a66a959
Author: Eric Liang
Date: 2015-08-06T05:19:28Z
fix parser
commit 11bb70fcdd32f390a513fa39a8d8096a60e3d22e
Author: Eric Liang
Date: 2015-08-06T05:20:26Z
Merge branch 'master' into interaction
commit 478ee8f2e1133901746e68cc202ecfc89de8eaa9
Author: Eric Liang
Date: 2015-08-06T05:57:10Z
add rformula test
commit 3ad5464566076570438001714582082b11981479
Author: Eric Liang
Date: 2015-08-06T06:08:34Z
docs
commit 5f7cb9b505e043039898df9860b999d5382c4ae0
Author: Eric Liang
Date: 2015-08-06T06:15:14Z
Wed Aug 5 23:15:14 PDT 2015
commit e44dd8397440f0e997a5384dc79220ac4ff2ba34
Author: Eric Liang
Date: 2015-08-06T06:45:35Z
small nits
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6212][SQL]The EXPLAIN output of CTAS on...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7986#issuecomment-128274370 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6212][SQL]The EXPLAIN output of CTAS on...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7986#issuecomment-128274441 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9112] [ML] Implement Stats for Logistic...
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/7538#discussion_r36386994 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -286,6 +294,41 @@ class LogisticRegressionModel private[ml] ( override val numClasses: Int = 2 + private var trainingSummary: Option[BinaryLogisticRegressionTrainingSummary] = None --- End diff -- Now it makes sense. Sorry about this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9548][SQL] Add a destructive iterator f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7924#issuecomment-128274581 [Test build #39988 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39988/console) for PR 7924 at commit [`7652083`](https://github.com/apache/spark/commit/76520839f0702a78363631e35502a293802be6ab). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9548][SQL] Add a destructive iterator f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7924#issuecomment-128274700 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] [WIP] Demonstration of issue in Exchange...
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/7988 [SQL] [WIP] Demonstration of issue in Exchange planning This pull request serves to demonstrate a bug / issue in Exchange: Consider SortMergeJoin, which requires a sorted, clustered distribution of its input rows. Say that both of SMJ's children produce unsorted output but are both single partition. In this case, we will need to inject sort operators but should not need to inject exchanges. Unfortunately, it looks like the Exchange unnecessarily repartitions using a hash partitioning. I thought that this might be caused by the fact that `Repartition` does not declare a proper `outputPartitioning`, but fixing that did not prevent the unnecessary shuffle from taking place. #7959 would end up addressing this issue by dropping the `Repartition`, but I'm actually slightly concerned that `Exchange` even gets planned in the first place in this scenario. I think that the problem here may be the fact that `Exchange` reacts to either an unsatisfied ordering requirement _or_ a unsatisfied distribution requirement by choosing a target partitioning then checking whether it's "guaranteed" by the existing partitioning. I think that it may make more sense to only look at picking a new partitioning when distributions are unsatisfied, not when only the ordering is unsatisfied. You can merge this pull request into a Git repository by running: $ git pull https://github.com/JoshRosen/spark exchange-fixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/7988.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #7988 commit 2dfc64811abcfb9a36ae5a2cf5060a5a28ef726b Author: Josh Rosen Date: 2015-08-06T07:05:35Z Add failing test illustrating bad exchange planning. commit cc5669cd1cfd81df30d00901c65c79bc50c8d448 Author: Josh Rosen Date: 2015-08-06T07:05:55Z Adding outputPartitioning to Repartition does not fix the test. commit 067595637b3fea6eba43b43a87e274bb60e846e2 Author: Josh Rosen Date: 2015-08-06T07:06:23Z Preserving ordering and partitioning in row format converters also does not help. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9630] [SQL] Clean up new aggregate oper...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7954#issuecomment-128275552 I tested this on some local dataset. It is not a very scientific one, but I think it is actually slower than the existing aggregate on master ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-128275891 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9630] [SQL] Clean up new aggregate oper...
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/7954#discussion_r36387320
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala
---
@@ -0,0 +1,663 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.aggregate
+
+import org.apache.spark.unsafe.KVIterator
+import org.apache.spark.{Logging, SparkEnv, TaskContext}
+import org.apache.spark.sql.catalyst.expressions._
+import org.apache.spark.sql.catalyst.expressions.aggregate._
+import
org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner
+import org.apache.spark.sql.execution.{UnsafeKVExternalSorter,
UnsafeFixedWidthAggregationMap}
+import org.apache.spark.sql.types.StructType
+
+/**
+ * An iterator used to evaluate aggregate functions. It operates on
[[UnsafeRow]]s.
+ *
+ * This iterator first uses hash-based aggregation to process input rows.
It uses
+ * a hash map to store groups and their corresponding aggregation buffers.
If we
+ * this map cannot allocate memory from
[[org.apache.spark.shuffle.ShuffleMemoryManager]],
+ * it switches to sort-based aggregation. The process of the switch has
the following step:
+ * - Step 1: Sort all entries of the hash map based on values of grouping
expressions and
+ *spill them to disk.
+ * - Step 2: Create a external sorter based on the spilled sorted map
entries.
+ * - Step 3: Redirect all input rows to the external sorter.
+ * - Step 4: Get a sorted [[KVIterator]] from the external sorter.
+ * - Step 5: Initialize sort-based aggregation.
+ * Then, this iterator works in the way of sort-based aggregation.
+ *
+ * The code of this class is organized as follows:
+ * - Part 1: Initializing aggregate functions.
+ * - Part 2: Methods and fields used by setting aggregation buffer values,
+ *processing input rows from inputIter, and generating output
+ *rows.
+ * - Part 3: Methods and fields used by hash-based aggregation.
+ * - Part 4: The function used to switch this iterator from hash-based
+ *aggregation to sort-based aggregation.
+ * - Part 5: Methods and fields used by sort-based aggregation.
+ * - Part 6: Loads input and process input rows.
+ * - Part 7: Public methods of this iterator.
+ * - Part 8: A utility function used to generate a result when there is no
+ *input and there is no grouping expression.
+ *
+ * @param groupingExpressions
+ * expressions for grouping keys
+ * @param nonCompleteAggregateExpressions
+ * [[AggregateExpression2]] containing [[AggregateFunction2]]s with mode
[[Partial]],
+ * [[PartialMerge]], or [[Final]].
+ * @param completeAggregateExpressions
+ * [[AggregateExpression2]] containing [[AggregateFunction2]]s with mode
[[Complete]].
+ * @param initialInputBufferOffset
+ * If this iterator is used to handle functions with mode
[[PartialMerge]] or [[Final]].
+ * The input rows have the format of `grouping keys + aggregation
buffer`.
+ * This offset indicates the starting position of aggregation buffer in
a input row.
+ * @param resultExpressions
+ * expressions for generating output rows.
+ * @param newMutableProjection
+ * the function used to create mutable projections.
+ * @param originalInputAttributes
+ * attributes of representing input rows from `inputIter`.
+ * @param inputIter
+ * the iterator containing input [[UnsafeRow]]s.
+ */
+class TungstenAggregationIterator(
+groupingExpressions: Seq[NamedExpression],
+nonCompleteAggregateExpressions: Seq[AggregateExpression2],
+completeAggregateExpressions: Seq[AggregateExpression2],
+initialInputBufferOffset: Int,
+resultExpressions: Seq[NamedExpression],
+newMutableProjection: (Seq[Expression], Seq[Attribute]) => (() =>
MutableProjection),
+or
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128275890 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] [WIP] Demonstration of issue in Exchange...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7988#issuecomment-128275861 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-128275868 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128275873 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] [WIP] Demonstration of issue in Exchange...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7988#issuecomment-128275880 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] [WIP] Demonstration of issue in Exchange...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7988#issuecomment-128276054 [Test build #40007 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40007/consoleFull) for PR 7988 at commit [`0675956`](https://github.com/apache/spark/commit/067595637b3fea6eba43b43a87e274bb60e846e2). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6212][SQL]The EXPLAIN output of CTAS on...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7986#issuecomment-128275925 [Test build #40006 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40006/consoleFull) for PR 7986 at commit [`b2cf8ab`](https://github.com/apache/spark/commit/b2cf8ab5c88dcb6637b4653e2299fdc7a88f42e9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-128276283 [Test build #40009 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40009/consoleFull) for PR 7987 at commit [`386881b`](https://github.com/apache/spark/commit/386881ba7c517b4affc90a4e91e84f860c603e11). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128276876 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128276873 [Test build #40008 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40008/console) for PR 7883 at commit [`4c8da4d`](https://github.com/apache/spark/commit/4c8da4df3437f49e2f30b8b30198b5f0b43b06b9). * This patch **fails some tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128276833 [Test build #40008 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40008/consoleFull) for PR 7883 at commit [`4c8da4d`](https://github.com/apache/spark/commit/4c8da4df3437f49e2f30b8b30198b5f0b43b06b9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8266][SQL]add function translate
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7709#issuecomment-128277048 [Test build #39992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39992/console) for PR 7709 at commit [`f2ab77a`](https://github.com/apache/spark/commit/f2ab77aceec9e0ec96b2e13e2a0c4ec1488c8f4f). * This patch **fails PySpark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class StringTranslate(srcExpr: Expression, matchingExpr: Expression, replaceExpr: Expression)` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8266][SQL]add function translate
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7709#issuecomment-128277110 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/7833#issuecomment-128277378 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-128277742 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7833#issuecomment-128277755 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-128277768 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9533] [PySpark] [ML] Add missing method...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7930#issuecomment-128277794 [Test build #3 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/3/console) for PR 7930 at commit [`1bea394`](https://github.com/apache/spark/commit/1bea394efe953098b832e083d87f1765b40d25f9). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7833#issuecomment-128277767 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9533] [PySpark] [ML] Add missing method...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7930#issuecomment-128277904 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-128277888 [Test build #40011 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40011/consoleFull) for PR 7987 at commit [`4c11a77`](https://github.com/apache/spark/commit/4c11a773e74e677f237f23949eeb9dffa8bc43f2). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9548][SQL] Add a destructive iterator f...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/7924#issuecomment-128278017 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7833#issuecomment-128278423 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9548][SQL] Add a destructive iterator f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7924#issuecomment-128278439 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9548][SQL] Add a destructive iterator f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7924#issuecomment-128278413 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7833#issuecomment-128278454 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9548][SQL] Add a destructive iterator f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7924#issuecomment-128278592 [Test build #245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/245/consoleFull) for PR 7924 at commit [`7652083`](https://github.com/apache/spark/commit/76520839f0702a78363631e35502a293802be6ab). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7833#issuecomment-128278549 [Test build #246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/246/consoleFull) for PR 7833 at commit [`9570bec`](https://github.com/apache/spark/commit/9570bec0d54537e51623b2b5777895c209dd706a). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9548][SQL] Add a destructive iterator f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7924#issuecomment-128278677 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7833#issuecomment-128278699 [Test build #40010 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40010/consoleFull) for PR 7833 at commit [`9570bec`](https://github.com/apache/spark/commit/9570bec0d54537e51623b2b5777895c209dd706a). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9548][SQL] Add a destructive iterator f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7924#issuecomment-128278697 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9548][SQL] Add a destructive iterator f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7924#issuecomment-128279279 [Test build #40012 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40012/consoleFull) for PR 7924 at commit [`7652083`](https://github.com/apache/spark/commit/76520839f0702a78363631e35502a293802be6ab). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] [WIP] Demonstration of issue in Exchange...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7988#issuecomment-128279616 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] [WIP] Demonstration of issue in Exchange...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7988#issuecomment-128279587 [Test build #40007 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40007/console) for PR 7988 at commit [`0675956`](https://github.com/apache/spark/commit/067595637b3fea6eba43b43a87e274bb60e846e2). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9682][BUILD]fix build warnings because ...
GitHub user caofangkun opened a pull request: https://github.com/apache/spark/pull/7989 [SPARK-9682][BUILD]fix build warnings because of deprecated classes You can merge this pull request into a Git repository by running: $ git pull https://github.com/caofangkun/apache-spark spark-9682 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/7989.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #7989 commit ea161ff4054ab7150abfac5385277651c9facb41 Author: caofangkun Date: 2015-08-06T07:46:11Z [SPARK-9682][BUILD]fix build warnings because of deprecated classes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] [WIP] Join test coverage improvements
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7985#issuecomment-128281218 [Test build #39993 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39993/console) for PR 7985 at commit [`2048cad`](https://github.com/apache/spark/commit/2048cad3e30a1cbb5317bbc6c6a9c2891de3abb7). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `final class VectorSlicer(override val uid: String)` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8266][SQL]add function translate
Github user zhichao-li commented on the pull request: https://github.com/apache/spark/pull/7709#issuecomment-128281099 retest this please. It fail in not related test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] [WIP] Join test coverage improvements
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7985#issuecomment-128281474 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9682][BUILD]fix build warnings because ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7989#issuecomment-128281715 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8266][SQL]add function translate
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7709#issuecomment-128281792 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8266][SQL]add function translate
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7709#issuecomment-128281738 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9682][BUILD]fix build warnings because ...
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/7989#issuecomment-128282091 No, this will break Hadoop 1 compatibility. Please close the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8266][SQL]add function translate
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7709#issuecomment-128282012 [Test build #247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/247/consoleFull) for PR 7709 at commit [`9418088`](https://github.com/apache/spark/commit/9418088447d899e7b5ea00c167ddd85a4eb16b15). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8266][SQL]add function translate
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7709#issuecomment-128282180 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8266][SQL]add function translate
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7709#issuecomment-128282300 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7685][ML][WIP] Apply weights to differe...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7884#issuecomment-128282147 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9682][BUILD]fix build warnings because ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7989#issuecomment-128282145 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9682][BUILD]fix build warnings because ...
Github user caofangkun closed the pull request at: https://github.com/apache/spark/pull/7989 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8266][SQL]add function translate
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7709#issuecomment-128282158 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7685][ML][WIP] Apply weights to differe...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7884#issuecomment-128282179 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7685][ML][WIP] Apply weights to differe...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7884#issuecomment-128282405 [Test build #40013 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40013/consoleFull) for PR 7884 at commit [`a0b15e6`](https://github.com/apache/spark/commit/a0b15e691e8f52dd925bf2e76ac72b7b5730d065). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7685][ML][WIP] Apply weights to differe...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7884#issuecomment-128282878 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7685][ML][WIP] Apply weights to differe...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7884#issuecomment-128282875 [Test build #40013 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40013/console) for PR 7884 at commit [`a0b15e6`](https://github.com/apache/spark/commit/a0b15e691e8f52dd925bf2e76ac72b7b5730d065). * This patch **fails Scala style tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * ` final val probabilityCol: Param[String] = new Param[String](this, "probabilityCol", "Column name for predicted class conditional probabilities. Note: Not all models output well-calibrated probability estimates! These probabilities should be treated as confidences, not precise probabilities")` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9682][BUILD]fix build warnings because ...
Github user caofangkun commented on the pull request: https://github.com/apache/spark/pull/7989#issuecomment-128282782 @srowen I closed this PR , sorry for my fault. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128283221 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128283238 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-128283369 [Test build #40009 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40009/console) for PR 7987 at commit [`386881b`](https://github.com/apache/spark/commit/386881ba7c517b4affc90a4e91e84f860c603e11). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class RInteraction(override val uid: String) extends Estimator[PipelineModel]` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-128283405 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7685][ML][WIP] Apply weights to differe...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7884#issuecomment-128284310 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7685][ML][WIP] Apply weights to differe...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7884#issuecomment-128284398 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8505][SparkR] Add settings to kick `lin...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7883#issuecomment-128284427 [Test build #40015 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40015/consoleFull) for PR 7883 at commit [`54365fc`](https://github.com/apache/spark/commit/54365fca94fc9857f035a0773ffd6ace650105ec). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7685][ML][WIP] Apply weights to differe...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7884#issuecomment-128284326 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-128284672 [Test build #40011 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40011/console) for PR 7987 at commit [`4c11a77`](https://github.com/apache/spark/commit/4c11a773e74e677f237f23949eeb9dffa8bc43f2). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-9681] [ML] Support R feature interactio...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7987#issuecomment-128284709 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7685][ML][WIP] Apply weights to differe...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7884#issuecomment-128285305 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
