Re: run JavaAPISuite with mavem

Running JavaAPISuite (master branch) on Linux, I got: testGuavaOptional(org.apache.spark.JavaAPISuite) Time elapsed: 32.945 sec <<< ERROR! org.apache.spark.SparkException: Job aborted due to stage failure: Master removed our application: FAILED at org.apache.spark.scheduler.DAGScheduler.org $apa

Re: run JavaAPISuite with mavem

thanks. that makes sense. i searched the mailing list but couldnt find any mention of it. i should have searched jira instead... On Sun, Dec 7, 2014 at 6:25 PM, Sean Owen wrote: > I think it's a known issue: > > https://issues.apache.org/jira/browse/SPARK-4159 > https://issues.apache.org/jira/br

Re: run JavaAPISuite with mavem

I think it's a known issue: https://issues.apache.org/jira/browse/SPARK-4159 https://issues.apache.org/jira/browse/SPARK-661 I got bit by this too recently and meant to look into it. On Sun, Dec 7, 2014 at 4:50 PM, Koert Kuipers wrote: > so as part of the official build the java api does not ge

Re: run JavaAPISuite with mavem

so as part of the official build the java api does not get tested then? i am sure there is a good reason for it, but thats surprising to me. On Sun, Dec 7, 2014 at 12:19 PM, Ted Yu wrote: > Looking at the pom.xml, I think I found the reason - scalatest is used. > With the following diff: > > dif

Re: run JavaAPISuite with mavem

Looking at the pom.xml, I think I found the reason - scalatest is used. With the following diff: diff --git a/pom.xml b/pom.xml index b7df53d..b0da893 100644 --- a/pom.xml +++ b/pom.xml @@ -947,7 +947,7 @@ 2.17 -true +false

Re: run JavaAPISuite with mavem

hey guys, i was able to run the test just fine with: $ sbt > project core > testOnly org.apache.spark.JavaAPISuite however i found it strange that it didnt run when i do "mvn test -pl core", or at least didnt seem like it ran to me. this would mean that when someone tests/publishes with maven the

Re: run JavaAPISuite with mavem

Not sure about maven, but you can run that test with sbt: sbt/sbt "sql/test-only org.apache.spark.sql.api.java.JavaAPISuite" On Sat, Dec 6, 2014 at 9:59 PM, Ted Yu wrote: > I tried to run tests for core but there were failures. e.g. : > > ^[[32mExternalAppendOnlyMapSuite:^[[0m > ^[[32m- simple

Re: run JavaAPISuite with mavem

I tried to run tests for core but there were failures. e.g. : ^[[32mExternalAppendOnlyMapSuite:^[[0m ^[[32m- simple insert^[[0m ^[[32m- insert with collision^[[0m ^[[32m- ordering^[[0m ^[[32m- null keys and values^[[0m ^[[32m- simple aggregator^[[0m ^[[32m- simple cogroup^[[0m Spark assembly has b

Re: run JavaAPISuite with mavem

Ted, i mean core/src/test/java/org/apache/spark/JavaAPISuite.java On Sat, Dec 6, 2014 at 9:27 PM, Ted Yu wrote: > Pardon me, the test is here: > > sql/core/src/test/java/org/apache/spark/sql/api/java/JavaAPISuite.java > > You can run 'mvn test' under sql/core > > Cheers > > On Sat, Dec 6, 2014 a

Re: run JavaAPISuite with mavem

Pardon me, the test is here: sql/core/src/test/java/org/apache/spark/sql/api/java/JavaAPISuite.java You can run 'mvn test' under sql/core Cheers On Sat, Dec 6, 2014 at 5:55 PM, Ted Yu wrote: > In master branch, I only found JavaAPISuite in comment: > > spark tyu$ find . -name '*.scala' -exec

Re: run JavaAPISuite with mavem

In master branch, I only found JavaAPISuite in comment: spark tyu$ find . -name '*.scala' -exec grep JavaAPISuite {} \; -print * For usage example, see test case JavaAPISuite.testJavaJdbcRDD. * converted into a `Object` array. For usage example, see test case JavaAPISuite.testJavaJdbcRDD. ./

run JavaAPISuite with mavem

when i run "mvn test -pl core", i dont see JavaAPISuite being run. or if it is, its being very very quiet about it. is this by design?