date:20150905

[GitHub] spark pull request: [HotFix][SQL] Fix SQLConfSuite

2015-09-05 Thread viirya

GitHub user viirya opened a pull request:

https://github.com/apache/spark/pull/8612

[HotFix][SQL] Fix SQLConfSuite

It seems a typo that causes the test failed.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/viirya/spark-1 fix-sqlconfsuite

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/8612.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #8612


commit 8ca8a9022747da0cb3030da97995bd7b4da0ba75
Author: Liang-Chi Hsieh 
Date:   2015-09-05T08:03:10Z

Fix SQLConfSuite.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137926381
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137926380
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HotFix][SQL] Fix SQLConfSuite

2015-09-05 Thread cloud-fan

Github user cloud-fan commented on the pull request:

https://github.com/apache/spark/pull/8612#issuecomment-137928655
  
LGTM, cc @liancheng 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137928688
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [WIP] [SPARK-8518] [ML] Log-linear models for ...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8611#issuecomment-137929010
  
  [Test build #42039 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42039/console)
 for   PR 8611 at commit 
[`7f2a31d`](https://github.com/apache/spark/commit/7f2a31db621cbbef9c2221e4466e1d79b2cbac42).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:
  * `class AFTRegression(override val uid: String)`



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [WIP] [SPARK-8518] [ML] Log-linear models for ...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8611#issuecomment-137929032
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HotFix][SQL] Fix SQLConfSuite

2015-09-05 Thread rxin

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8612#issuecomment-137933076
  
Ah thanks - I merged https://github.com/apache/spark/pull/8614 just now 
without seeing this one earlier.

Mind closing it now?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HOTFIX] [SQL] Fixes compilation error

2015-09-05 Thread rxin

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8614#issuecomment-137932892
  
I've merged this.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HOTFIX] [SQL] Fixes compilation error

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8614#issuecomment-137932798
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HOTFIX] [SQL] Fixes compilation error

2015-09-05 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/8614


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HotFix][SQL] Fix SQLConfSuite

2015-09-05 Thread viirya

Github user viirya closed the pull request at:

https://github.com/apache/spark/pull/8612


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HotFix][SQL] Fix SQLConfSuite

2015-09-05 Thread viirya

Github user viirya commented on the pull request:

https://github.com/apache/spark/pull/8612#issuecomment-137935295
  
Ok.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10013][ML][JAVA][TEST] remove java asse...

2015-09-05 Thread rxin

Github user rxin commented on a diff in the pull request:

https://github.com/apache/spark/pull/8607#discussion_r38809132
  
--- Diff: sql/hive/pom.xml ---
@@ -36,6 +36,12 @@
   
 
   
+
--- End diff --

what is this?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10397] [PySpark] Made python SparkConte...

2015-09-05 Thread rxin

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8608#issuecomment-137935274
  
Is it too verbose to contain so much information in the normal repl string?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10013][ML][JAVA][TEST] remove java asse...

2015-09-05 Thread rxin

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8607#issuecomment-137935311
  
LGTM - except the build file.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10461][SQL] make sure `input.primitive`...

2015-09-05 Thread rxin

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8613#issuecomment-137935252
  
Is it too verbose to contain so much information in the normal repl string?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread viirya

Github user viirya commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137935331
  
retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-6931] [PYSPARK] Cast Python time float ...

2015-09-05 Thread rxin

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8594#issuecomment-137935818
  
Jenkins, retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10013][ML][JAVA][TEST] remove java asse...

2015-09-05 Thread rxin

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8607#issuecomment-137938526
  
I've merged this.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10013][ML][JAVA][TEST] remove java asse...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8607#issuecomment-137938455
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42048/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137922125
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137922120
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-8518] [ML] Log-linear models for surviv...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8611#issuecomment-137925191
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-8518] [ML] Log-linear models for surviv...

2015-09-05 Thread yanboliang

GitHub user yanboliang opened a pull request:

https://github.com/apache/spark/pull/8611

[SPARK-8518] [ML] Log-linear models for survival analysis 

Log-linear models for survival analysis

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/yanboliang/spark spark-8518

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/8611.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #8611


commit 0edabbb2b986ed1da2bd3ce309d95efa2f6bc37e
Author: Yanbo Liang 
Date:   2015-09-05T07:33:38Z

initial implementation of log-linear survival analysis

commit 7f2a31db621cbbef9c2221e4466e1d79b2cbac42
Author: Yanbo Liang 
Date:   2015-09-05T07:42:48Z

fix test case issue




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137926864
  
  [Test build #42040 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42040/consoleFull)
 for   PR 8599 at commit 
[`6023c8b`](https://github.com/apache/spark/commit/6023c8b39aaa26bc8e1a7724f3bd461b35b17ff5).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HotFix][SQL] Fix SQLConfSuite

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8612#issuecomment-137928445
  
  [Test build #42041 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42041/consoleFull)
 for   PR 8612 at commit 
[`8ca8a90`](https://github.com/apache/spark/commit/8ca8a9022747da0cb3030da97995bd7b4da0ba75).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [WIP][SQL][SPARK-10451]: Prevent unnecessary s...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137930329
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [WIP][SQL][SPARK-10451]: Prevent unnecessary s...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137930272
  
  [Test build #42042 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42042/console)
 for   PR 8604 at commit 
[`1587a8b`](https://github.com/apache/spark/commit/1587a8bd0e1f4fbdd5f388a9a2e46fcc377f7f93).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [WIP][SQL][SPARK-10451]: Prevent unnecessary s...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137930331
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42042/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10461][SQL] make sure `input.primitive`...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8613#issuecomment-137930846
  
  [Test build #42043 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42043/consoleFull)
 for   PR 8613 at commit 
[`39b6d02`](https://github.com/apache/spark/commit/39b6d029caf35476020216160e137327ae7a21df).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-9767] Remove ConnectionManager.

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8161#issuecomment-137935465
  
  [Test build #42045 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42045/consoleFull)
 for   PR 8161 at commit 
[`2e09114`](https://github.com/apache/spark/commit/2e091149e5a3c897f89eef8585af78bcb40c820a).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-05 Thread rxin

Github user rxin commented on a diff in the pull request:

https://github.com/apache/spark/pull/8600#discussion_r38809139
  
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala ---
@@ -480,10 +480,11 @@ class DataFrame private[sql](
*
* @param right Right side of the join operation.
* @param usingColumns Names of the columns to join on. This columns 
must exist on both sides.
+   * @param joinType One of: (default)`inner`, `outer`, `left_outer`, 
`right_outer`, `leftsemi`.
* @group dfops
* @since 1.4.0
*/
-  def join(right: DataFrame, usingColumns: Seq[String]): DataFrame = {
+  def join(right: DataFrame, usingColumns: Seq[String], joinType: String = 
"inner"): DataFrame = {
--- End diff --

We cannot use default parameter values in order to maintain compatibility 
with Java. You can add an extra method.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-05 Thread rxin

Github user rxin commented on a diff in the pull request:

https://github.com/apache/spark/pull/8537#discussion_r38809260
  
--- Diff: 
mllib/src/main/scala/org/apache/spark/ml/source/libsvm/package.scala ---
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.ml.source
+
+import org.apache.spark.sql.{DataFrame, DataFrameReader}
+
+package object libsvm {
+
+  /**
+   * Implicit declaration in order to be used from SQLContext.
+   * It is necessary to import org.apache.spark.ml.source.libsvm._
+   * @param read Given original DataFrameReader
+   */
+  implicit class LibSVMReader(read: DataFrameReader) {
--- End diff --

I think we should just remove all the implicits. It was a mistake in the 
beginning to encourage them.

Now the preferred format is just

sqlContext.read.format("libsvm").load(...)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-6931] [PYSPARK] Cast Python time float ...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8594#issuecomment-137943983
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42049/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10459][SQL] Do not need to have Convert...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8616#issuecomment-137944003
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8610#issuecomment-137913133
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8610#issuecomment-137913548
  
  [Test build #42037 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42037/consoleFull)
 for   PR 8610 at commit 
[`d3289fc`](https://github.com/apache/spark/commit/d3289fc331bd2e6bb19453f3489ff3ca4d865c90).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-9925] [SQL] [TESTS] Set SQLConf.SHUFFLE...

2015-09-05 Thread cloud-fan

Github user cloud-fan commented on a diff in the pull request:

https://github.com/apache/spark/pull/8602#discussion_r38808881
  
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLConfSuite.scala 
---
@@ -73,8 +77,13 @@ class SQLConfSuite extends QueryTest with 
SharedSQLContext {
 
   test("deprecated property") {
 sqlContext.conf.clear()
-sql(s"set ${SQLConf.Deprecated.MAPRED_REDUCE_TASKS}=10")
-assert(sqlContext.conf.numShufflePartitions === 10)
+val original = sqlContext.conf.numShufflePartitions
+try{
+  sql(s"set ${SQLConf.Deprecated.MAPRED_REDUCE_TASKS}=10")
+  assert(ctx.conf.numShufflePartitions === 10)
--- End diff --

There is a merge conflict with https://github.com/apache/spark/pull/8584 
here, we should change `ctx` to `sparkContext`. 
https://github.com/apache/spark/pull/8612 fixed it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [WIP] [SPARK-8518] [ML] Log-linear models for ...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8611#issuecomment-137929033
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42039/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SQL][SPARK-10451]: Prevent unnecessary serial...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137935934
  
  [Test build #42047 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42047/consoleFull)
 for   PR 8604 at commit 
[`1587a8b`](https://github.com/apache/spark/commit/1587a8bd0e1f4fbdd5f388a9a2e46fcc377f7f93).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10447][WIP][PYSPARK] upgrade pyspark to...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8615#issuecomment-137935988
  
  [Test build #42050 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42050/consoleFull)
 for   PR 8615 at commit 
[`f344815`](https://github.com/apache/spark/commit/f34481569ca9e492f18f6ef07689150133710062).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10434] [SQL] Fixes Parquet schema of ar...

2015-09-05 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/8586


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [WIP][SQL][SPARK-10451]: Prevent unnecessary s...

2015-09-05 Thread saucam

Github user saucam commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137932280
  
I get this failure : 

[error] 
/home/jenkins/workspace/SparkPullRequestBuilder/sql/core/src/test/scala/org/apache/spark/sql/SQLConfSuite.scala:83:
 not found: value ctx
[error]   assert(ctx.conf.numShufflePartitions === 10)
[error]  ^
[error] one error found
[error] (sql/test:compile) Compilation failed
[error] Total time: 108 s, completed Sep 5, 2015 1:47:01 AM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HOTFIX] [SQL] Fixes compilation error

2015-09-05 Thread liancheng

GitHub user liancheng opened a pull request:

https://github.com/apache/spark/pull/8614

[HOTFIX] [SQL] Fixes compilation error

Jenkins master builders are currently broken by a merge conflict between PR 
#8584 and PR #8155.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/liancheng/spark 
hotfix/fix-pr-8155-8584-conflict

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/8614.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #8614


commit d763051c8edefa902f95b6f6e6fea33799fe8710
Author: Cheng Lian 
Date:   2015-09-05T08:51:49Z

Fixes compilation error




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10447][WIP][PYSPARK] upgrade pyspark to...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8615#issuecomment-137935883
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10447][WIP][PYSPARK] upgrade pyspark to...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8615#issuecomment-137935873
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-6931] [PYSPARK] Cast Python time float ...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8594#issuecomment-137935876
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-6931] [PYSPARK] Cast Python time float ...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8594#issuecomment-137935882
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HotFix][SQL] Fix SQLConfSuite

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8612#issuecomment-137939578
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42041/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HotFix][SQL] Fix SQLConfSuite

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8612#issuecomment-137939535
  
  [Test build #42041 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42041/console)
 for   PR 8612 at commit 
[`8ca8a90`](https://github.com/apache/spark/commit/8ca8a9022747da0cb3030da97995bd7b4da0ba75).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HotFix][SQL] Fix SQLConfSuite

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8612#issuecomment-137939577
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10461][SQL] make sure `input.primitive`...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8613#issuecomment-137939403
  
  [Test build #42051 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42051/consoleFull)
 for   PR 8613 at commit 
[`96ed788`](https://github.com/apache/spark/commit/96ed788600cfa51018a51d6a451b5590858b52b5).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10459][SQL] Do not need to have Convert...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8616#issuecomment-137944763
  
  [Test build #42053 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42053/consoleFull)
 for   PR 8616 at commit 
[`d6e1ee0`](https://github.com/apache/spark/commit/d6e1ee0850830948906e47011b82ac72a13672a9).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137922299
  
  [Test build #42038 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42038/consoleFull)
 for   PR 8599 at commit 
[`8f73c40`](https://github.com/apache/spark/commit/8f73c40dedf1cbf711d3cf05e4f50c376932c8f6).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137922942
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8610#issuecomment-137924683
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42037/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8610#issuecomment-137924668
  
  [Test build #42037 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42037/console)
 for   PR 8610 at commit 
[`d3289fc`](https://github.com/apache/spark/commit/d3289fc331bd2e6bb19453f3489ff3ca4d865c90).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8610#issuecomment-137924682
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [WIP][SQL][SPARK-10451]: Prevent unnecessary s...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137928824
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [WIP][SQL][SPARK-10451]: Prevent unnecessary s...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137928820
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10461][SQL] make sure `input.primitive`...

2015-09-05 Thread cloud-fan

GitHub user cloud-fan opened a pull request:

https://github.com/apache/spark/pull/8613

[SPARK-10461][SQL] make sure `input.primitive` is always variable name not 
code at `GenerateUnsafeProjection`

When we generate unsafe code inside `createCodeForXXX`, we always assign 
the `input.primitive` to a temp variable in case `input.primitive` is 
expression code.

This PR did some refactor to make sure `input.primitive` is always variable 
name, and some other typo and style fixes.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/cloud-fan/spark minor

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/8613.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #8613


commit 39b6d029caf35476020216160e137327ae7a21df
Author: Wenchen Fan 
Date:   2015-08-28T05:44:52Z

make sure input.primitive is always variable name not code




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10440] [STREAMING] [DOCS] Update python...

2015-09-05 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/8595


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SQL][SPARK-10451]: Prevent unnecessary serial...

2015-09-05 Thread rxin

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137935590
  
Jenkins, retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10301] [SQL] Fixes schema merging for n...

2015-09-05 Thread liancheng

Github user liancheng commented on the pull request:

https://github.com/apache/spark/pull/8509#issuecomment-137935596
  
Since this PR has already been merged, I'm addressing all the comments in 
#8583, which backports this PR to branch-1.5. Will send out a separate PR later 
to address these issues for master.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SQL][SPARK-10451]: Prevent unnecessary serial...

2015-09-05 Thread rxin

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137935587
  
We fixed this. Lemme trigger the test  again.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137935560
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-6931] [PYSPARK] Cast Python time float ...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8594#issuecomment-137936032
  
  [Test build #42049 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42049/consoleFull)
 for   PR 8594 at commit 
[`feed499`](https://github.com/apache/spark/commit/feed49946f91a13a5a0a710c8cae43c86cc94e32).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10065][SQL] avoid the extra copy when g...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8496#issuecomment-137941828
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10065][SQL] avoid the extra copy when g...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8496#issuecomment-137941825
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10459][SQL] Do not need to have Convert...

2015-09-05 Thread viirya

GitHub user viirya opened a pull request:

https://github.com/apache/spark/pull/8616

[SPARK-10459][SQL] Do not need to have ConvertToSafe for PythonUDF

JIRA: https://issues.apache.org/jira/browse/SPARK-10459

As mentioned in the JIRA, `PythonUDF` actually could process `UnsafeRow`.

Specially, the rows in `childResults` in `BatchPythonEvaluation` will be 
projected to a `MutableRow`. So I think we can enable `canProcessUnsafeRows` 
for `BatchPythonEvaluation` and get rid of redundant `ConvertToSafe`.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/viirya/spark-1 pyudf-unsafe

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/8616.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #8616


commit d6e1ee0850830948906e47011b82ac72a13672a9
Author: Liang-Chi Hsieh 
Date:   2015-09-05T11:05:12Z

Do not need to have ConvertToSafe for PythonUDF.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SQL][SPARK-10451]: Prevent unnecessary serial...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137946384
  
  [Test build #42047 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42047/console)
 for   PR 8604 at commit 
[`1587a8b`](https://github.com/apache/spark/commit/1587a8bd0e1f4fbdd5f388a9a2e46fcc377f7f93).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10013][ML][JAVA][TEST] remove java asse...

2015-09-05 Thread srowen

Github user srowen commented on the pull request:

https://github.com/apache/spark/pull/8607#issuecomment-137947307
  
Post-hoc +1 -- this was another thing I wanted to fix about the Java suite 
tests.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8610#issuecomment-137913138
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-8542][MLlib]PMML export for Decision Tr...

2015-09-05 Thread selvinsource

Github user selvinsource commented on the pull request:

https://github.com/apache/spark/pull/7842#issuecomment-137925061
  
Also, did you verify the evaluation is correct by running
java -jar 
target/spark-pmml-exporter-validator-1.1.0-SNAPSHOT-jar-with-dependencies.jar 
DecisionTreeClassificationModel?
In my opinion, **this is the most important test to ensure the exported 
model is correct**.
You should get Class 0 for the first item and Class 1 for the second as the 
scala code 
(https://github.com/selvinsource/spark-pmml-exporter-validator/blob/decision_trees_validator/src/main/resources/spark_shell_exporter/decisiontree_breastcancerwisconsin.scala).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10461][SQL] make sure `input.primitive`...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8613#issuecomment-137929228
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10461][SQL] make sure `input.primitive`...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8613#issuecomment-137929223
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HOTFIX] [SQL] Fixes compilation error

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8614#issuecomment-137932839
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10013][ML][JAVA][TEST] remove java asse...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8607#issuecomment-137935745
  
  [Test build #42048 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42048/consoleFull)
 for   PR 8607 at commit 
[`869b20d`](https://github.com/apache/spark/commit/869b20d52962cad4f0dc410576ce4b6501ac752f).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10447][WIP][PYSPARK] upgrade pyspark to...

2015-09-05 Thread holdenk

GitHub user holdenk opened a pull request:

https://github.com/apache/spark/pull/8615

[SPARK-10447][WIP][PYSPARK] upgrade pyspark to py4j0.9

Upgrade to Py4j0.9


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/holdenk/spark 
SPARK-10447-upgrade-pyspark-to-py4j0.9

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/8615.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #8615


commit 8d7376daebcc2a605d5dc21365bb2a3c52220b6a
Author: Holden Karau 
Date:   2015-09-05T06:38:26Z

Naive upgrade to py4j 0.9

commit f34481569ca9e492f18f6ef07689150133710062
Author: Holden Karau 
Date:   2015-09-05T09:22:12Z

upgrade to 0.9 maven dep too




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10013][ML][JAVA][TEST] remove java asse...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8607#issuecomment-137935722
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SQL][SPARK-10451]: Prevent unnecessary serial...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137935716
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10013][ML][JAVA][TEST] remove java asse...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8607#issuecomment-137935714
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SQL][SPARK-10451]: Prevent unnecessary serial...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137935721
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-09-05 Thread rxin

Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8587#issuecomment-137935670
  
Is it possible to do this with AlgebraicAggregate so it can be codegened?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10013][ML][JAVA][TEST] remove java asse...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8607#issuecomment-137938454
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10013][ML][JAVA][TEST] remove java asse...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8607#issuecomment-137938430
  
  [Test build #42048 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42048/console)
 for   PR 8607 at commit 
[`869b20d`](https://github.com/apache/spark/commit/869b20d52962cad4f0dc410576ce4b6501ac752f).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10065][SQL] avoid the extra copy when g...

2015-09-05 Thread cloud-fan

Github user cloud-fan commented on the pull request:

https://github.com/apache/spark/pull/8496#issuecomment-137942053
  
Hi @davies , I have moved the refactor part to 
https://github.com/apache/spark/pull/8613.

I'd like to open another PR to remove the one more additional copy for each 
level of Array or Struct, as this JIRA is only for array.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10461][SQL] make sure `input.primitive`...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8613#issuecomment-137943171
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42043/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10461][SQL] make sure `input.primitive`...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8613#issuecomment-137943147
  
  [Test build #42043 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42043/console)
 for   PR 8613 at commit 
[`39b6d02`](https://github.com/apache/spark/commit/39b6d029caf35476020216160e137327ae7a21df).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SQL][SPARK-10451]: Prevent unnecessary serial...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137946404
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42047/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SQL][SPARK-10451]: Prevent unnecessary serial...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8604#issuecomment-137946403
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [HOTFIX] [SQL] Fixes compilation error

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8614#issuecomment-137946584
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-9767] Remove ConnectionManager.

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8161#issuecomment-137947962
  
  [Test build #42045 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42045/console)
 for   PR 8161 at commit 
[`2e09114`](https://github.com/apache/spark/commit/2e091149e5a3c897f89eef8585af78bcb40c820a).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-9767] Remove ConnectionManager.

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8161#issuecomment-137947985
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-9767] Remove ConnectionManager.

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8161#issuecomment-137947986
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42045/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-5337][Mesos][Standalone] respect spark....

2015-09-05 Thread CodingCat

GitHub user CodingCat opened a pull request:

https://github.com/apache/spark/pull/8610

[SPARK-5337][Mesos][Standalone] respect spark.task.cpus when scheduling 
Applications

https://issues.apache.org/jira/browse/SPARK-5337

Currently, we didn't consider spark.task.cpus when scheduling the 
applications in Master, so that we may fall into one of the following cases

the executor gets N cores but we need M cores to run a single task, where N 
< M

the executor gets N cores, we need M cores to run a single task, where N % 
M != 0 && N > M; so that we waste some cores in the executor

Patch for YARN is in submitted by @WangTaoTheTonic : #4123

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/CodingCat/spark SPARK-5337-1

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/8610.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #8610


commit d3289fc331bd2e6bb19453f3489ff3ca4d865c90
Author: CodingCat 
Date:   2015-09-05T06:01:05Z

respect spark.task.cpus when scheduling Applications




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread SparkQA

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137922937
  
  [Test build #42038 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42038/console)
 for   PR 8599 at commit 
[`8f73c40`](https://github.com/apache/spark/commit/8f73c40dedf1cbf711d3cf05e4f50c376932c8f6).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-05 Thread AmplabJenkins

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8599#issuecomment-137922943
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42038/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-8542][MLlib]PMML export for Decision Tr...

2015-09-05 Thread selvinsource

Github user selvinsource commented on the pull request:

https://github.com/apache/spark/pull/7842#issuecomment-137924965
  
As explained in details above, the order should be the same as the input 
vector (used for training the model).

If you look at 
https://github.com/selvinsource/spark-pmml-exporter-validator/blob/decision_trees_validator/src/main/resources/spark_shell_exporter/decisiontree_breastcancerwisconsin.scala
we take the first 9 values from the file as input vector:
```val data = 
sc.textFile("../datasets/breastcancerwisconsin_binaryclassification.csv")
val parsedData = data.map { line =>
  val parts = line.split(',')
  LabeledPoint(parts.last.toDouble, 
Vectors.dense(parts.take(9).map(_.toDouble)))
}```

after building the moded, the prediction uses the same number of fields and 
order of the input vector (5,1,1,1,2,1,3,1,1):
```val model = DecisionTree.trainClassifier(parsedData, numClasses, 
categoricalFeaturesInfo,
  impurity, maxDepth, maxBins)
var predictedValue = model.predict(Vectors.dense(5,1,1,1,2,1,3,1,1))```

So it would be nice if the exported tree listed the fields in the same 
order of the input vector.

As I said it is not a big deal, but it would be nice to have.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

1 2 3 >

1 - 100 of 253 matches

Mail list logo