[
https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555823#comment-14555823
]
Sean Owen commented on SPARK-7820:
----------------------------------
Yeah, the Maven build is correct and works. Is this an issue of SBT not reading
the test dependencies?
Or, don't we have to make the assembly first for reasons like this before
running tests?
It sounds like it's an SBT issue or at least a limitation of the SBT build as
we use it here.
> Java8-tests suite compile error under SBT
> -----------------------------------------
>
> Key: SPARK-7820
> URL: https://issues.apache.org/jira/browse/SPARK-7820
> Project: Spark
> Issue Type: Bug
> Components: Build, Streaming
> Affects Versions: 1.4.0
> Reporter: Saisai Shao
> Priority: Minor
>
> Lots of compilation error is shown when java 8 test suite is enabled in SBT:
> {{JAVA_HOME=/usr/java/jdk1.8.0_45 ./sbt/sbt -Pyarn -Phadoop-2.4
> -Dhadoop.version=2.6.0 -Pjava8-tests}}
> {code}
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:43:
> error: cannot find symbol
> [error] public class Java8APISuite extends LocalJavaStreamingContext
> implements Serializable {
> [error] ^
> [error] symbol: class LocalJavaStreamingContext
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:55:
> error: cannot find symbol
> [error] JavaDStream<String> stream =
> JavaTestUtils.attachTestInputStream(ssc, inputData, 1);
> [error] ^
> [error] symbol: variable ssc
> [error] location: class Java8APISuite
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:55:
> error: cannot find symbol
> [error] JavaDStream<String> stream =
> JavaTestUtils.attachTestInputStream(ssc, inputData, 1);
> [error] ^
> [error] symbol: variable JavaTestUtils
> [error] location: class Java8APISuite
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:57:
> error: cannot find symbol
> [error] JavaTestUtils.attachTestOutputStream(letterCount);
> [error] ^
> [error] symbol: variable JavaTestUtils
> [error] location: class Java8APISuite
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:58:
> error: cannot find symbol
> [error] List<List<Integer>> result = JavaTestUtils.runStreams(ssc, 2, 2);
> [error] ^
> [error] symbol: variable ssc
> [error] location: class Java8APISuite
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:58:
> error: cannot find symbol
> [error] List<List<Integer>> result = JavaTestUtils.runStreams(ssc, 2, 2);
> [error] ^
> [error] symbol: variable JavaTestUtils
> [error] location: class Java8APISuite
> [error]
> /mnt/data/project/apache-spark/extras/java8-tests/src/test/java/org/apache/spark/streaming/Java8APISuite.java:73:
> error: cannot find symbol
> [error] JavaDStream<String> stream =
> JavaTestUtils.attachTestInputStream(ssc, inputData, 1);
> [error] ^
> [error] symbol: variable ssc
> [error] location: class Java8APISuite
> {code}
> The class {{JavaAPISuite}} relies on {{LocalJavaStreamingContext}} which
> exists in streaming test jar. It is OK for maven compile, since it will
> generate test jar, but will be failed in sbt test compile, sbt do not
> generate test jar by default.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
