Running JavaAPISuite (master branch) on Linux, I got:
testGuavaOptional(org.apache.spark.JavaAPISuite) Time elapsed: 32.945 sec
ERROR!
org.apache.spark.SparkException: Job aborted due to stage failure: Master
removed our application: FAILED
at org.apache.spark.scheduler.DAGScheduler.org
hey guys,
i was able to run the test just fine with:
$ sbt
project core
testOnly org.apache.spark.JavaAPISuite
however i found it strange that it didnt run when i do mvn test -pl core,
or at least didnt seem like it ran to me. this would mean that when someone
tests/publishes with maven the
Looking at the pom.xml, I think I found the reason - scalatest is used.
With the following diff:
diff --git a/pom.xml b/pom.xml
index b7df53d..b0da893 100644
--- a/pom.xml
+++ b/pom.xml
@@ -947,7 +947,7 @@
version2.17/version
configuration
!-- Uses scalatest
so as part of the official build the java api does not get tested then?
i am sure there is a good reason for it, but thats surprising to me.
On Sun, Dec 7, 2014 at 12:19 PM, Ted Yu yuzhih...@gmail.com wrote:
Looking at the pom.xml, I think I found the reason - scalatest is used.
With the
I think it's a known issue:
https://issues.apache.org/jira/browse/SPARK-4159
https://issues.apache.org/jira/browse/SPARK-661
I got bit by this too recently and meant to look into it.
On Sun, Dec 7, 2014 at 4:50 PM, Koert Kuipers ko...@tresata.com wrote:
so as part of the official build the
thanks. that makes sense. i searched the mailing list but couldnt find any
mention of it. i should have searched jira instead...
On Sun, Dec 7, 2014 at 6:25 PM, Sean Owen so...@cloudera.com wrote:
I think it's a known issue:
https://issues.apache.org/jira/browse/SPARK-4159
when i run mvn test -pl core, i dont see JavaAPISuite being run. or if it
is, its being very very quiet about it. is this by design?
In master branch, I only found JavaAPISuite in comment:
spark tyu$ find . -name '*.scala' -exec grep JavaAPISuite {} \; -print
* For usage example, see test case JavaAPISuite.testJavaJdbcRDD.
* converted into a `Object` array. For usage example, see test case
JavaAPISuite.testJavaJdbcRDD.
Pardon me, the test is here:
sql/core/src/test/java/org/apache/spark/sql/api/java/JavaAPISuite.java
You can run 'mvn test' under sql/core
Cheers
On Sat, Dec 6, 2014 at 5:55 PM, Ted Yu yuzhih...@gmail.com wrote:
In master branch, I only found JavaAPISuite in comment:
spark tyu$ find . -name
Ted,
i mean
core/src/test/java/org/apache/spark/JavaAPISuite.java
On Sat, Dec 6, 2014 at 9:27 PM, Ted Yu yuzhih...@gmail.com wrote:
Pardon me, the test is here:
sql/core/src/test/java/org/apache/spark/sql/api/java/JavaAPISuite.java
You can run 'mvn test' under sql/core
Cheers
On Sat,
I tried to run tests for core but there were failures. e.g. :
^[[32mExternalAppendOnlyMapSuite:^[[0m
^[[32m- simple insert^[[0m
^[[32m- insert with collision^[[0m
^[[32m- ordering^[[0m
^[[32m- null keys and values^[[0m
^[[32m- simple aggregator^[[0m
^[[32m- simple cogroup^[[0m
Spark assembly has
Not sure about maven, but you can run that test with sbt:
sbt/sbt sql/test-only org.apache.spark.sql.api.java.JavaAPISuite
On Sat, Dec 6, 2014 at 9:59 PM, Ted Yu yuzhih...@gmail.com wrote:
I tried to run tests for core but there were failures. e.g. :
^[[32mExternalAppendOnlyMapSuite:^[[0m
12 matches
Mail list logo
