[GitHub] spark pull request: Closes SPARK-4229 Create hadoop configuration ...

2014-12-02 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/3543#issuecomment-65288815
  
  [Test build #24053 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24053/consoleFull)
 for   PR 3543 at commit 
[`413f916`](https://github.com/apache/spark/commit/413f916bafc5b218ab334cb9d66b67f3dbc117f7).
 * This patch merges cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: Closes SPARK-4229 Create hadoop configuration ...

2014-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/3543#issuecomment-65304557
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24053/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: Closes SPARK-4229 Create hadoop configuration ...

2014-12-02 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/3543#issuecomment-65304552
  
  [Test build #24053 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24053/consoleFull)
 for   PR 3543 at commit 
[`413f916`](https://github.com/apache/spark/commit/413f916bafc5b218ab334cb9d66b67f3dbc117f7).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: Closes SPARK-4229 Create hadoop configuration ...

2014-12-02 Thread vanzin
Github user vanzin commented on a diff in the pull request:

https://github.com/apache/spark/pull/3543#discussion_r21192103
  
--- Diff: docs/configuration.md ---
@@ -664,6 +665,24 @@ Apart from these, the following properties are also 
available, and may be useful
   /td
 /tr
 tr
+tdcodespark.executor.heartbeatInterval/code/td
--- End diff --

Unrelated to this PR?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: Closes SPARK-4229 Create hadoop configuration ...

2014-12-02 Thread vanzin
Github user vanzin commented on the pull request:

https://github.com/apache/spark/pull/3543#issuecomment-65306213
  
LGTM. Could you rephrase the title to just say [SPARK-4229] instead of 
Closes blah, to follow the convention used for PR titles?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: Closes SPARK-4229 Create hadoop configuration ...

2014-12-01 Thread koeninger
GitHub user koeninger opened a pull request:

https://github.com/apache/spark/pull/3543

Closes SPARK-4229 Create hadoop configuration in a consistent way



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/koeninger/spark-1 SPARK-4229-master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/3543.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3543


commit c41a4b4d0752b1a5b057611c796e367c5a806be6
Author: cody koeninger c...@koeninger.org
Date:   2014-11-04T22:40:17Z

SPARK-4229 use SparkHadoopUtil.get.conf so that hadoop properties are 
copied from spark config
Resolved conflicts in favor of master.

Conflicts:

streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala

streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala

commit b48ad63fb9c31de90c8b5b0541129e2c71bd3478
Author: cody koeninger c...@koeninger.org
Date:   2014-11-04T22:41:07Z

SPARK-4229 document handling of spark.hadoop.* properties

commit 413f916bafc5b218ab334cb9d66b67f3dbc117f7
Author: cody koeninger c...@koeninger.org
Date:   2014-11-05T03:26:26Z

SPARK-4229 fix broken table in documentation, make hadoop doc formatting 
match that of runtime env




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: Closes SPARK-4229 Create hadoop configuration ...

2014-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/3543#issuecomment-65176806
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org