GitHub user bersprockets opened a pull request:
https://github.com/apache/spark/pull/20638
[SPARK-23417][python] Fix the build instructions supplied by exception
messages in python streaming tests
## What changes were proposed in this pull request?
Fix the build instructions supplied by exception messages in python
streaming tests.
I also added -DskipTests to the maven instructions to avoid the 170 minutes
of scala tests that occurs each time one wants to add a jar to the assembly
directory.
## How was this patch tested?
- clone branch
- run build/sbt package
- run python/run-tests --modules "pyspark-streaming" , expect error message
- follow instructions in error message. i.e., run build/sbt
assembly/package streaming-kafka-0-8-assembly/assembly
- rerun python tests, expect error message
- follow instructions in error message. i.e run build/sbt -Pflume
assembly/package streaming-flume-assembly/assembly
- rerun python tests, see success.
- repeated all of the above for mvn version of the process.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/bersprockets/spark SPARK-23417_propa
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20638.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20638
----
commit a80a4c5df8064934784091e8650b8d13d09ef66f
Author: Bruce Robbins <bersprockets@...>
Date: 2018-02-17T17:30:06Z
Fix build instructions embedded in error message
commit 824131355cfdd531101308cc6f803820aa5c941e
Author: Bruce Robbins <bersprockets@...>
Date: 2018-02-17T18:55:17Z
Fix mvn instructions also
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
