[GitHub] spark pull request: [SPARK-2172] PySpark cannot import mllib modul...

2014-06-26 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/1223


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] spark pull request: [SPARK-2172] PySpark cannot import mllib modul...

2014-06-25 Thread piotrszul
GitHub user piotrszul opened a pull request:

https://github.com/apache/spark/pull/1223

[SPARK-2172] PySpark cannot import mllib modules in YARN-client mode

Include pyspark/mllib python sources as resources in the mllib.jar.
This way they will be included in the final assembly

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/csirobigdata/spark branch-1.0

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/1223.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1223


commit f8c52a0977d84ae784fa4d52af7e06c655a9fea3
Author: Szul, Piotr piotr.s...@csiro.au
Date:   2014-06-26T01:04:56Z

[SPARK-2172] PySpark cannot import mllib modules in YARN-client mode
Include pyspark/mllib python sources as resources in the jar




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] spark pull request: [SPARK-2172] PySpark cannot import mllib modul...

2014-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/1223#issuecomment-47178146
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] spark pull request: [SPARK-2172] PySpark cannot import mllib modul...

2014-06-25 Thread mengxr
Github user mengxr commented on a diff in the pull request:

https://github.com/apache/spark/pull/1223#discussion_r14223221
  
--- Diff: mllib/pom.xml ---
@@ -76,5 +76,16 @@
 artifactIdscalatest-maven-plugin/artifactId
   /plugin
 /plugins
+resources
+  resource
+directorysrc/main/resources/directory
--- End diff --

We don't really have `src/main/resources` under `mllib/`. Do you mind 
removing this block or is it necessary for the build?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] spark pull request: [SPARK-2172] PySpark cannot import mllib modul...

2014-06-25 Thread mengxr
Github user mengxr commented on the pull request:

https://github.com/apache/spark/pull/1223#issuecomment-47187655
  
LGTM and tested with `mvn install`. Thanks for fixing it!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---