[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11278 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-218230752 Merging to master / 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user markgrover commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-218229224 Would love to help, but I am not a committer:-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-218228742 If no one objects maybe @markgrover could just go ahead and merge this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-217755544 ping @JoshRosen ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-216657271 ping @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-216304232 Since we've branched for 2.0 would this maybe be a good time to merge this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user markgrover commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-212146915 LGTM. +1 (non-binding) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-212135544 Rad, wanted to make sure people were still up for adding a note about the hive requirement even though we got rid of the assembly requirement. I've changed it to just say built with hive and dropped the extra bits from the build argument (were there to match the rest of the build reference in the doc but for Python tests probably not relevant). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-212134688 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/56268/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-212134685 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-212134560 **[Test build #56268 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/56268/consoleFull)** for PR 11278 at commit [`47045c2`](https://github.com/apache/spark/commit/47045c2353206f590d68d131df4dd2f14d1e6125). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-212132208 **[Test build #56268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/56268/consoleFull)** for PR 11278 at commit [`47045c2`](https://github.com/apache/spark/commit/47045c2353206f590d68d131df4dd2f14d1e6125). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user markgrover commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-212069360 Left some comments, overall, it's a change in the right direction. Thanks for working on this, @holdenk! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user markgrover commented on a diff in the pull request:
https://github.com/apache/spark/pull/11278#discussion_r60290371
--- Diff: docs/building-spark.md ---
@@ -123,6 +123,21 @@ To produce a Spark package compiled with Scala 2.10,
use the `-Dscala-2.10` prop
./dev/change-scala-version.sh 2.10
mvn -Pyarn -Phadoop-2.4 -Dscala-2.10 -DskipTests clean package
+# PySpark Tests with Maven
+
+If you are building PySpark and wish to run the PySpark tests you will
need to build an assembly JAR and also ensure you have built with hive support.
+
+{% highlight bash %}
+build/mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean
package -Phive -Phive-thriftserver
+./python/run-tests
+{% endhighlight %}
+
+The run-tests script also can be limited to a specific Python version or a
specific module
+
+./python/run-tests --python-executables=python --modules=pyspark-sql
+
+**Note:** You can also run Python tests with an sbt build, provided your
assembly JAR includes hive support.
--- End diff --
Again, we should remove the reference to assembly jar from here, something
like 'provided you build spark with hive support' should suffice.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user markgrover commented on a diff in the pull request: https://github.com/apache/spark/pull/11278#discussion_r60290250 --- Diff: docs/building-spark.md --- @@ -123,6 +123,21 @@ To produce a Spark package compiled with Scala 2.10, use the `-Dscala-2.10` prop ./dev/change-scala-version.sh 2.10 mvn -Pyarn -Phadoop-2.4 -Dscala-2.10 -DskipTests clean package +# PySpark Tests with Maven + +If you are building PySpark and wish to run the PySpark tests you will need to build an assembly JAR and also ensure you have built with hive support. --- End diff -- Yeah, I agree with @JoshRosen since assembly jars are now gone. I think the hive support part still applies but we should take out the part to build an assembly jar. The ```hadoop-2.4``` profile sets the ```hadoop.version``` so I don't think we need to specify the latter explicitly. I am also not sure, at the top of my head, if we need the ```hive-thriftserver``` profile for running python tests so it may make sense to see if just specifying the hive profile would suffice. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-211697500 cc @markgrover who updated the building docs most recently, what are your thoughts? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-211162111 re-ping @JoshRosen thoughts? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-209661869 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/55746/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-209661750 **[Test build #55746 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55746/consoleFull)** for PR 11278 at commit [`0853b07`](https://github.com/apache/spark/commit/0853b079ddd7e86830a0504abf0eb2dc4ef214b2). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-209661865 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-209657822 **[Test build #55746 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55746/consoleFull)** for PR 11278 at commit [`0853b07`](https://github.com/apache/spark/commit/0853b079ddd7e86830a0504abf0eb2dc4ef214b2). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-206493054 So looking at the PR which went in - it seems we don't need the assembly jar but we do need to explicitly build with package & hive support for the PySpark tests which isn't necessarily clear in the current docs so I think this remains a reasonable change - what are your thoughts @JoshRosen ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-202976430 Ok - I can close this if we think thats going to be fixed soon (e.g. before the next release). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-201545515 This is going to be outdated soon, since there's ongoing effort to remove the need to build assemblies before running tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-200984687 Maybe @jkbradley could merge this? Super simple update. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-193431235 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-193431241 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/52586/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-193431046 **[Test build #52586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52586/consoleFull)** for PR 11278 at commit [`36d1397`](https://github.com/apache/spark/commit/36d13972625f3c73b58996feea7e2d33881d4398). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-193425529 **[Test build #52586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52586/consoleFull)** for PR 11278 at commit [`36d1397`](https://github.com/apache/spark/commit/36d13972625f3c73b58996feea7e2d33881d4398). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-186432567 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51577/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-186432566 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-186432422 **[Test build #51577 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51577/consoleFull)** for PR 11278 at commit [`59afdb6`](https://github.com/apache/spark/commit/59afdb65b573893097fbbbf0e16a601a530bd20a). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11278#issuecomment-186429602 **[Test build #51577 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51577/consoleFull)** for PR 11278 at commit [`59afdb6`](https://github.com/apache/spark/commit/59afdb65b573893097fbbbf0e16a601a530bd20a). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13382][DOCS][PYSPARK] Update pyspark te...
GitHub user holdenk opened a pull request: https://github.com/apache/spark/pull/11278 [SPARK-13382][DOCS][PYSPARK] Update pyspark testing notes in build docs ## What changes were proposed in this pull request? The current build documents don't specify that for PySpark tests we need to include Hive in the assembly otherwise the ORC tests fail. ## How was the this patch tested? Manually built the docs locally. Ran the provided build command follow by the PySpark SQL tests.  You can merge this pull request into a Git repository by running: $ git pull https://github.com/holdenk/spark SPARK-13382-update-pyspark-testing-notes-r2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/11278.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #11278 commit a2e79da1ca592d60cb7c9306ae722d0a9293668a Author: Holden Karau Date: 2016-02-19T16:04:13Z Add a quick note about needing to build with hive support for PySpark's full tests commit 3b5f0b0a565b707d86223d07157ea9ea29b62609 Author: Holden Karau Date: 2016-02-19T21:21:35Z Make it a sub section instead commit 59afdb65b573893097fbbbf0e16a601a530bd20a Author: Holden Karau Date: 2016-02-19T21:41:26Z Commas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
