[GitHub] spark pull request: [SPARK-9828] [PySpark] Mutable values should n...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8110#issuecomment-130069248
  
  [Test build #40510 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40510/consoleFull)
 for   PR 8110 at commit 
[`c0f2308`](https://github.com/apache/spark/commit/c0f2308dc236b9eb5287a5c536ea72205a5d9a8b).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: SPARK-7726: Add import so Scaladoc doesn't fai...

2015-08-11 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/8095


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9814][SQL] EqualNotNull not passing to ...

2015-08-11 Thread rxin
Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8096#issuecomment-130076101
  
Thanks - I've merged this.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9824][Core]Fix the issue that InternalA...

2015-08-11 Thread rxin
Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8108#issuecomment-130077305
  
I'm going to merge this since Jenkins actually ran all the tests.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9814][SQL] EqualNotNull not passing to ...

2015-08-11 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/8096


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9824][Core]Fix the issue that InternalA...

2015-08-11 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/8108


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130078089
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130078148
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-1503][MLLIB] Initial AcceleratedGradien...

2015-08-11 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/4934


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130078914
  
  [Test build #40512 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40512/consoleFull)
 for   PR 8111 at commit 
[`997715e`](https://github.com/apache/spark/commit/997715eb38219ba4ec49bc0f5b20098a417b8882).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [MLLIB] [spark-2352] Implementation of an Arti...

2015-08-11 Thread mengxr
Github user mengxr commented on the pull request:

https://github.com/apache/spark/pull/1290#issuecomment-130078928
  
I closed this PR. We can use Apache JIRA to continue discussion on 
individual issues.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130079899
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8922] [Documentation, MLlib] Add @since...

2015-08-11 Thread mengxr
Github user mengxr commented on a diff in the pull request:

https://github.com/apache/spark/pull/7429#discussion_r36800958
  
--- Diff: 
mllib/src/main/scala/org/apache/spark/mllib/evaluation/BinaryClassificationMetrics.scala
 ---
@@ -51,6 +51,7 @@ class BinaryClassificationMetrics(
 
   /**
* Defaults `numBins` to 0.
+   * @since 1.3.0
--- End diff --

This should be since `1.0.0`. We moved it from default constructor to 
auxiliary constructor. However, the signature did change.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9828] [PySpark] Mutable values should n...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8110#issuecomment-130081049
  
  [Test build #40510 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40510/console)
 for   PR 8110 at commit 
[`c0f2308`](https://github.com/apache/spark/commit/c0f2308dc236b9eb5287a5c536ea72205a5d9a8b).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9828] [PySpark] Mutable values should n...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8110#issuecomment-130081369
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130082123
  
  [Test build #40513 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40513/consoleFull)
 for   PR 8111 at commit 
[`1400770`](https://github.com/apache/spark/commit/1400770941263d586f94ef59f40199a789579b4a).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9426][WebUI]Job page DAG visualization ...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8104#issuecomment-130081987
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: SPARK-9790: [YARN] Expose in WebUI if NodeMana...

2015-08-11 Thread andrewor14
Github user andrewor14 commented on the pull request:

https://github.com/apache/spark/pull/8093#issuecomment-130082220
  
@markgrover can you post a screenshot?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9788][MLlib] Fix LDA Binary Compatibili...

2015-08-11 Thread jkbradley
Github user jkbradley commented on the pull request:

https://github.com/apache/spark/pull/8077#issuecomment-130081656
  
Merging with master and branch-1.5


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9747] [SQL] Avoid starving an unsafe op...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8038#issuecomment-130082015
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130080388
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9789] [ML] Added logreg threshold param...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8079#issuecomment-130083164
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8922] [Documentation, MLlib] Add @since...

2015-08-11 Thread mengxr
Github user mengxr commented on the pull request:

https://github.com/apache/spark/pull/7429#issuecomment-130082646
  
@mosessky I made one pass, and found only one issue commented inline. 
Besides it, could you also add `since` tags to constructors? Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130080431
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9788][MLlib] Fix LDA Binary Compatibili...

2015-08-11 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/8077


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: SPARK-8918 Add @since tags to mllib.clustering

2015-08-11 Thread mengxr
Github user mengxr commented on the pull request:

https://github.com/apache/spark/pull/7662#issuecomment-130083760
  
@XiaoqingWang Could you send the PR to the master branch as @yu-iskw 
suggested?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9747] [SQL] Avoid starving an unsafe op...

2015-08-11 Thread andrewor14
Github user andrewor14 commented on the pull request:

https://github.com/apache/spark/pull/8038#issuecomment-130083914
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9649] Fix flaky test MasterSuite again ...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8084#issuecomment-130084411
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9649] Fix flaky test MasterSuite again ...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8084#issuecomment-130084392
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8925] [MLlib] Add @since tags to mllib....

2015-08-11 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/7436


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9747] [SQL] Avoid starving an unsafe op...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8038#issuecomment-130084399
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9747] [SQL] Avoid starving an unsafe op...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8038#issuecomment-130084424
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8115] [SQL] Remove TestData

2015-08-11 Thread rxin
Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/7406#issuecomment-130084387
  
Thanks @BenFradet. Looks like @andrewor14 is working on this at the same 
time to also get rid of the singleton TestSQLContext in order for his own tests 
to pass.

https://github.com/apache/spark/pull/8111

He will incorporate your changes into that.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9806] [WEB UI] Don't share ReplayListen...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8088#issuecomment-130084907
  
  [Test build #40498 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40498/console)
 for   PR 8088 at commit 
[`972af81`](https://github.com/apache/spark/commit/972af816e34cbb9819c4a423d87a8085a27a5135).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9806] [WEB UI] Don't share ReplayListen...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8088#issuecomment-130084983
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9384] [core] Easier setting of executor...

2015-08-11 Thread harishreedharan
Github user harishreedharan commented on a diff in the pull request:

https://github.com/apache/spark/pull/7739#discussion_r36802511
  
--- Diff: core/src/main/scala/org/apache/spark/deploy/Client.scala ---
@@ -68,7 +68,12 @@ private class ClientEndpoint(
 val mainClass = org.apache.spark.deploy.worker.DriverWrapper
 
 val classPathConf = spark.driver.extraClassPath
--- End diff --

Rename this to `driverClasspathConf` ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9747] [SQL] Avoid starving an unsafe op...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8038#issuecomment-130085526
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-4131][SQL] support writing data into th...

2015-08-11 Thread rxin
Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/4380#issuecomment-130085889
  
@scwf looks like there is a real failure?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8971][MLLIB][ML] Support balanced class...

2015-08-11 Thread sethah
GitHub user sethah opened a pull request:

https://github.com/apache/spark/pull/8112

[SPARK-8971][MLLIB][ML] Support balanced class labels when splitting 
train/cross validation sets

I'm leaving a few comments about some of the design choices made in this PR.

- both train/validation split and k fold require a full dataset be 
partitioned into random samples. For this reason, there has to be some way to 
group random keys into ranges. `sampleByKeyExact` does not currently allow this 
and also has no way to return the complement of a subsample.
- the RDD package has a `randomSplit` method that returns approximate 
splits of an RDD. I chose to implement a `randomSplitByKey` method in the 
_PairRDDFunctions_. This uses a new sampling function in 
_StratifiedSamplingUtils_ which allows sampling by filtering random keys into a 
range and can provide a complement.
- The `randomSplitByKey` function uses the 
[ScaSRS](http://jmlr.org/proceedings/papers/v28/meng13a.html) method of 
computing the exact thresholds for each stratum k-1 times to provide exact 
partitioning of each stratum. These exact thresholds are passed into the 
sampling function which then samples the data into partitions. For simplicity, 
this method returns each split AND each split's complement.
- The current proposed solution avoids changing any existing RDD level 
functions or methods. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sethah/spark Working_on_SPARK-8971

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/8112.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #8112


commit 24c0182a3a87d95042b0d6259b2200a0e6b89950
Author: sethah seth.hendrickso...@gmail.com
Date:   2015-08-08T00:04:13Z

Adding stratified sampling to cross validation and train validation split 
in ml/tuning

commit cb232670a44b9dd9839aa6a829f97038cb15131b
Author: sethah seth.hendrickso...@gmail.com
Date:   2015-08-10T22:26:38Z

Adding tests for stratified splits

commit 16644120642ae8e828a6c169c8d92c3a96a1fdc7
Author: sethah seth.hendrickso...@gmail.com
Date:   2015-08-11T21:09:48Z

some scalastyle corrections




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9649] Fix flaky test MasterSuite again ...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8084#issuecomment-130087300
  
  [Test build #1456 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1456/consoleFull)
 for   PR 8084 at commit 
[`026f628`](https://github.com/apache/spark/commit/026f6287086be12c70633f38e333d26d831f).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130087226
  
  [Test build #1458 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1458/consoleFull)
 for   PR 8111 at commit 
[`1400770`](https://github.com/apache/spark/commit/1400770941263d586f94ef59f40199a789579b4a).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9809]Task crashes because the internal ...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8090#issuecomment-130087503
  
  [Test build #1462 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1462/consoleFull)
 for   PR 8090 at commit 
[`52c95fc`](https://github.com/apache/spark/commit/52c95fca4bb79c8bc023330915531d96e6160f48).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9747] [SQL] Avoid starving an unsafe op...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8038#issuecomment-130086882
  
  [Test build #1454 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1454/consoleFull)
 for   PR 8038 at commit 
[`94ca5de`](https://github.com/apache/spark/commit/94ca5ded14d01f2c1df5d9cbafc462a259081f61).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9795] Dynamic allocation: avoid double ...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8078#issuecomment-130087290
  
  [Test build #1460 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1460/consoleFull)
 for   PR 8078 at commit 
[`fb149da`](https://github.com/apache/spark/commit/fb149da2bb67143fc534d3049faf57959f8a0d49).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8366] maxNumExecutorsNeeded should prop...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/6817#issuecomment-130087929
  
  [Test build #1461 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1461/consoleFull)
 for   PR 6817 at commit 
[`9f12fa6`](https://github.com/apache/spark/commit/9f12fa6e43bfc460d4154e7d18b4576fa1df91d5).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130087842
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8971][MLLIB][ML] Support balanced class...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8112#issuecomment-130088223
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9613] [CORE] [WIP] Ban use of JavaConve...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8033#issuecomment-130088956
  
  [Test build #40518 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40518/consoleFull)
 for   PR 8033 at commit 
[`5815596`](https://github.com/apache/spark/commit/5815596cc1b9026e30c71e028f4faeb31d53516b).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-1517] Refactor release scripts to facil...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/7411#issuecomment-130088895
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9806] [WEB UI] Don't share ReplayListen...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8088#issuecomment-130088661
  
  [Test build #1455 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1455/consoleFull)
 for   PR 8088 at commit 
[`972af81`](https://github.com/apache/spark/commit/972af816e34cbb9819c4a423d87a8085a27a5135).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9426][WebUI]Job page DAG visualization ...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8104#issuecomment-130088636
  
  [Test build #1457 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1457/consoleFull)
 for   PR 8104 at commit 
[`f3119a4`](https://github.com/apache/spark/commit/f3119a4a57d44849bfebddfeeef8570c0f51d1ca).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130079895
  
  [Test build #40512 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40512/console)
 for   PR 8111 at commit 
[`997715e`](https://github.com/apache/spark/commit/997715eb38219ba4ec49bc0f5b20098a417b8882).
 * This patch **fails Scala style tests**.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:
  * `  implicit class StringToColumn(val sc: StringContext) `
  * `case class EqualNullSafe(attribute: String, value: Any) extends Filter`



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-1517] Refactor release scripts to facil...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/7411#issuecomment-130088733
  
  [Test build #40500 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40500/console)
 for   PR 7411 at commit 
[`74f9beb`](https://github.com/apache/spark/commit/74f9bebbaf6da0ea9ebd0216cabeaaeb303b6bd1).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9789] [ML] Added logreg threshold param...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8079#issuecomment-130069485
  
  [Test build #40511 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40511/consoleFull)
 for   PR 8079 at commit 
[`1a4b922`](https://github.com/apache/spark/commit/1a4b92203b083c1e9fc2178e8182f497519d9402).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9092] Fixed incompatibility when both n...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/7657#issuecomment-130072036
  
  [Test build #40489 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40489/console)
 for   PR 7657 at commit 
[`6da06c4`](https://github.com/apache/spark/commit/6da06c4865220b39a1d9522280478483d887f2a3).
 * This patch **fails PySpark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9092] Fixed incompatibility when both n...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/7657#issuecomment-130072414
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: SPARK-7726: Add import so Scaladoc doesn't fai...

2015-08-11 Thread rxin
Github user rxin commented on the pull request:

https://github.com/apache/spark/pull/8095#issuecomment-130074997
  
I'm going to merge this.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9789] [ML] Added logreg threshold param...

2015-08-11 Thread jkbradley
Github user jkbradley commented on the pull request:

https://github.com/apache/spark/pull/8079#issuecomment-130081435
  
Uh oh, my proposal won't work currently, but I think it can be fixed.  
Explanation here: [https://issues.apache.org/jira/browse/SPARK-9847]


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9789] [ML] Added logreg threshold param...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8079#issuecomment-130083116
  
  [Test build #40511 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40511/console)
 for   PR 8079 at commit 
[`1a4b922`](https://github.com/apache/spark/commit/1a4b92203b083c1e9fc2178e8182f497519d9402).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:
  * `   * Set thresholds in multiclass (or binary) classification to adjust 
the probability of`



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9747] [SQL] Avoid starving an unsafe op...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8038#issuecomment-130081992
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9806] [WEB UI] Don't share ReplayListen...

2015-08-11 Thread andrewor14
Github user andrewor14 commented on the pull request:

https://github.com/apache/spark/pull/8088#issuecomment-130082406
  
LGTM2


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: SPARK-8949 - Print warnings when using preferr...

2015-08-11 Thread darkjh
Github user darkjh commented on the pull request:

https://github.com/apache/spark/pull/7874#issuecomment-130083455
  
Should I rebase this to the master to solve the build fail?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9426][WebUI]Job page DAG visualization ...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8104#issuecomment-130082221
  
  [Test build #40515 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40515/consoleFull)
 for   PR 8104 at commit 
[`f3119a4`](https://github.com/apache/spark/commit/f3119a4a57d44849bfebddfeeef8570c0f51d1ca).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [WIP] [SPARK-9805] [MLLIB] [PYTHON] [STREAMING...

2015-08-11 Thread jkbradley
Github user jkbradley commented on the pull request:

https://github.com/apache/spark/pull/8087#issuecomment-130082076
  
Yay it passed!  If this looks reasonable, I'll make similar changes for the 
other streaming ML pyspark tests.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9426][WebUI]Job page DAG visualization ...

2015-08-11 Thread andrewor14
Github user andrewor14 commented on the pull request:

https://github.com/apache/spark/pull/8104#issuecomment-130081441
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8889] [Core]: Fix for OOM for graph cre...

2015-08-11 Thread andrewor14
Github user andrewor14 commented on the pull request:

https://github.com/apache/spark/pull/7602#issuecomment-130082084
  
Hm, looks like this is failing the selenium suite. I would recommend not 
making it a selenium suite but test it on a finer-grained level at the 
`RDDOperationGraph`. I'm concerned that it might become a flaky test we have to 
fix in the future.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8924] [MLLIB, DOCUMENTATION] Added @sin...

2015-08-11 Thread mengxr
Github user mengxr commented on the pull request:

https://github.com/apache/spark/pull/7380#issuecomment-130083493
  
@manishamde Could you make a pass?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9426][WebUI]Job page DAG visualization ...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8104#issuecomment-130082016
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8920] [MLlib] Add @since tags to mllib....

2015-08-11 Thread mengxr
Github user mengxr commented on the pull request:

https://github.com/apache/spark/pull/7729#issuecomment-130083393
  
We don't need to add `since` tags for methods inherited from Java `Object` 
like `toString`, `hashCode`, and `equals`. @sabhyankar Could you address 
@MechCoder 's comments? We should merge this before the 1.5 RC release.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9789] [ML] Added logreg threshold param...

2015-08-11 Thread dbtsai
Github user dbtsai commented on the pull request:

https://github.com/apache/spark/pull/8079#issuecomment-130084832
  
Then the most easy way is probably just overwriting the other when one is 
set. :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-8925] [MLlib] Add @since tags to mllib....

2015-08-11 Thread mengxr
Github user mengxr commented on the pull request:

https://github.com/apache/spark/pull/7436#issuecomment-130084489
  
LGTM. Merged into master and branch-1.5. Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: SPARK-9790: [YARN] Expose in WebUI if NodeMana...

2015-08-11 Thread markgrover
Github user markgrover commented on the pull request:

https://github.com/apache/spark/pull/8093#issuecomment-130084493
  
@andrewor14 
[here](https://issues.apache.org/jira/secure/attachment/12749771/error_showing_in_UI.png)'s
 the link from the JIRA.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9384] [core] Easier setting of executor...

2015-08-11 Thread harishreedharan
Github user harishreedharan commented on a diff in the pull request:

https://github.com/apache/spark/pull/7739#discussion_r36802639
  
--- Diff: 
core/src/main/scala/org/apache/spark/deploy/rest/SubmitRestProtocolRequest.scala
 ---
@@ -17,6 +17,8 @@
 
 package org.apache.spark.deploy.rest
 
+import java.io.File
--- End diff --

Why?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9789] [ML] Added logreg threshold param...

2015-08-11 Thread jkbradley
Github user jkbradley commented on the pull request:

https://github.com/apache/spark/pull/8079#issuecomment-130085747
  
That's true for the setter methods, but it doesn't work for fit() or 
transform() given ParamMaps.  fit and transform don't use the setter methods, 
so we don't have a chance to unset the other parameter.  I'll wait on this PR 
until the other patch gets merged.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9384] [core] Easier setting of executor...

2015-08-11 Thread harishreedharan
Github user harishreedharan commented on a diff in the pull request:

https://github.com/apache/spark/pull/7739#discussion_r36802676
  
--- Diff: 
core/src/main/scala/org/apache/spark/deploy/rest/StandaloneRestServer.scala ---
@@ -135,7 +135,10 @@ private[rest] class StandaloneSubmitRequestServlet(
 val driverMemory = sparkProperties.get(spark.driver.memory)
 val driverCores = sparkProperties.get(spark.driver.cores)
 val driverExtraJavaOptions = 
sparkProperties.get(spark.driver.extraJavaOptions)
-val driverExtraClassPath = 
sparkProperties.get(spark.driver.extraClassPath)
+val commonExtraClassPath = 
sparkProperties.get(spark.common.extraClassPath)
+val driverSpecificExtraClassPath = 
sparkProperties.get(spark.driver.extraClassPath)
+val driverExtraClassPath = Option(( commonExtraClassPath ++ 
driverSpecificExtraClassPath)
--- End diff --

Nit: unnecessary space after `((`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130087782
  
  [Test build #40513 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40513/console)
 for   PR 8111 at commit 
[`1400770`](https://github.com/apache/spark/commit/1400770941263d586f94ef59f40199a789579b4a).
 * This patch **fails MiMa tests**.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:
  * `class SQLTransformer (override val uid: String) extends Transformer `
  * `  implicit class StringToColumn(val sc: StringContext) `
  * `case class EqualNullSafe(attribute: String, value: Any) extends Filter`



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9747] [SQL] Avoid starving an unsafe op...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8038#issuecomment-130087846
  
  [Test build #1454 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1454/console)
 for   PR 8038 at commit 
[`94ca5de`](https://github.com/apache/spark/commit/94ca5ded14d01f2c1df5d9cbafc462a259081f61).
 * This patch **fails Scala style tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130087421
  
  [Test build #1459 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1459/consoleFull)
 for   PR 8111 at commit 
[`1400770`](https://github.com/apache/spark/commit/1400770941263d586f94ef59f40199a789579b4a).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9649] Fix flaky test MasterSuite again ...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8084#issuecomment-130088381
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130088302
  
  [Test build #1459 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1459/console)
 for   PR 8111 at commit 
[`1400770`](https://github.com/apache/spark/commit/1400770941263d586f94ef59f40199a789579b4a).
 * This patch **fails Scala style tests**.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:
  * `class SQLTransformer (override val uid: String) extends Transformer `
  * `  implicit class StringToColumn(val sc: StringContext) `
  * `case class EqualNullSafe(attribute: String, value: Any) extends Filter`



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130088218
  
  [Test build #1458 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1458/console)
 for   PR 8111 at commit 
[`1400770`](https://github.com/apache/spark/commit/1400770941263d586f94ef59f40199a789579b4a).
 * This patch **fails Scala style tests**.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:
  * `class SQLTransformer (override val uid: String) extends Transformer `
  * `  implicit class StringToColumn(val sc: StringContext) `
  * `case class EqualNullSafe(attribute: String, value: Any) extends Filter`



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9613] [CORE] [WIP] Ban use of JavaConve...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8033#issuecomment-130088311
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9747] [SQL] Avoid starving an unsafe op...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8038#issuecomment-130088415
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9613] [CORE] [WIP] Ban use of JavaConve...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8033#issuecomment-130088255
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9809]Task crashes because the internal ...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8090#issuecomment-130088400
  
  [Test build #1462 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1462/console)
 for   PR 8090 at commit 
[`52c95fc`](https://github.com/apache/spark/commit/52c95fca4bb79c8bc023330915531d96e6160f48).
 * This patch **fails Scala style tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9806] [WEB UI] Don't share ReplayListen...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8088#issuecomment-130089159
  
  [Test build #1455 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1455/console)
 for   PR 8088 at commit 
[`972af81`](https://github.com/apache/spark/commit/972af816e34cbb9819c4a423d87a8085a27a5135).
 * This patch **fails Scala style tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9795] Dynamic allocation: avoid double ...

2015-08-11 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8078#issuecomment-130107721
  
  [Test build #40508 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40508/console)
 for   PR 8078 at commit 
[`fb149da`](https://github.com/apache/spark/commit/fb149da2bb67143fc534d3049faf57959f8a0d49).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9847] [ML] Modified copyValues to disti...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8115#issuecomment-130110321
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9847] [ML] Modified copyValues to disti...

2015-08-11 Thread jkbradley
Github user jkbradley commented on the pull request:

https://github.com/apache/spark/pull/8115#issuecomment-130110260
  
Jenkins test this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9847] [ML] Modified copyValues to disti...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8115#issuecomment-130110297
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9580] [SQL] [WIP] Replace singletons in...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8111#issuecomment-130113781
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9826][Core] Fix cannot use custom class...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8109#issuecomment-130121610
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [WIP] [SPARK-9805] [MLLIB] [PYTHON] [STREAMING...

2015-08-11 Thread jkbradley
Github user jkbradley commented on the pull request:

https://github.com/apache/spark/pull/8087#issuecomment-130125941
  
@tdas  Sure, I can do that.  I don't think the race condition matters for 
ML tests (or if it does, then the test was written incorrectly), but that does 
clarify semantics.  I guess I'll have to duplicate the check code no matter 
what to get nice error messages.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9449][SQL] Include MetastoreRelation's ...

2015-08-11 Thread rxin
Github user rxin commented on a diff in the pull request:

https://github.com/apache/spark/pull/8119#discussion_r36817563
  
--- Diff: 
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala ---
@@ -888,6 +888,18 @@ private[hive] case class MetastoreRelation
   /** An attribute map for determining the ordinal for non-partition 
columns. */
   val columnOrdinals = AttributeMap(attributes.zipWithIndex)
 
+  def inputFiles: Array[String] = {
--- End diff --

override


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9740] [SQL] Change the default behavior...

2015-08-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request:

https://github.com/apache/spark/pull/8113#discussion_r36818586
  
--- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/functions.scala
 ---
@@ -130,23 +138,36 @@ case class First(child: Expression) extends 
AlgebraicAggregate {
 
   private val first = AttributeReference(first, child.dataType)()
 
-  override val bufferAttributes = first :: Nil
+  private val valueSet = AttributeReference(valueSet, BooleanType)()
+
+  override val bufferAttributes = first :: valueSet :: Nil
 
   override val initialValues = Seq(
-/* first = */ Literal.create(null, child.dataType)
+/* first = */ Literal.create(null, child.dataType),
+/* valueSet = */ Literal.create(false, BooleanType)
   )
 
   override val updateExpressions = Seq(
-/* first = */ If(IsNull(first), child, first)
+/* first = */ If(valueSet, first, child),
+/* valueSet = */ If(valueSet, valueSet, Literal.create(true, 
BooleanType))
   )
 
   override val mergeExpressions = Seq(
-/* first = */ If(IsNull(first.left), first.right, first.left)
+/* first = */ If(valueSet, first.left, first.right),
+/* valueSet = */ If(valueSet, valueSet, Literal.create(true, 
BooleanType))
--- End diff --

We could for now simplify this to ```Literal.create(true, BooleanType)```.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9449][SQL] Include MetastoreRelation's ...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8119#issuecomment-130129986
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9654][ML][PYSPARK] Add string indexer i...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/7976#issuecomment-130130020
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9449][SQL] Include MetastoreRelation's ...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8119#issuecomment-130130007
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-9654][ML][PYSPARK] Add string indexer i...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/7976#issuecomment-130129995
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-7542][SQL] Support off-heap buffer in U...

2015-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8068#issuecomment-130134533
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



  1   2   3   4   5   6   7   8   9   10   >