Re: No such file or directory errors running tests

2014-07-28 Thread Sean Owen
On Mon, Jul 28, 2014 at 3:35 AM, Stephen Boesch wrote: > mvn -Pyarn -Phadoop-2.3 -DskipTests -Phive clean package > mvn -Pyarn -Phadoop-2.3 -Phive test Yes, it's unintuitive for Maven, since package always happens after test, which kind of makes sense in general. I suppose we could bind the gene

Re: No such file or directory errors running tests

2014-07-27 Thread Stephen Boesch
Hi Steve, I am running on the cdh5.0.0 VM (which is CentOS 6.5) Given the difference in O/S and Hadoop distro between us my results are not likely to be of direct help to you. But in any case i will let you know (likely offline). 2014-07-27 20:02 GMT-07:00 Steve Nunez : > Whilst we¹re on thi

Re: No such file or directory errors running tests

2014-07-27 Thread Steve Nunez
Whilst we¹re on this topic, I¹d be interested to see if you get hive failures. I¹m trying to build on a Mac using HDP and seem to be getting failures related to Parquet. I¹ll know for sure once I get in tomorrow and confirm with engineering, but this is likely because the version of Hive is 0.12.0,

Re: No such file or directory errors running tests

2014-07-27 Thread Stephen Boesch
OK i'll do it after confirming all the tests run 2014-07-27 19:36 GMT-07:00 Reynold Xin : > Would you like to submit a pull request? All doc source code are in the > docs folder. Cheers. > > > > On Sun, Jul 27, 2014 at 7:35 PM, Stephen Boesch wrote: > > > i Reynold, > > thanks for responding

Re: No such file or directory errors running tests

2014-07-27 Thread Reynold Xin
Would you like to submit a pull request? All doc source code are in the docs folder. Cheers. On Sun, Jul 27, 2014 at 7:35 PM, Stephen Boesch wrote: > i Reynold, > thanks for responding here. Yes I had looked at the building with maven > page in the past. I have not noticed that the "packag

Re: No such file or directory errors running tests

2014-07-27 Thread Stephen Boesch
i Reynold, thanks for responding here. Yes I had looked at the building with maven page in the past. I have not noticed that the "package" step must happen *before *the test. I had assumed it were a corequisite -as seen in my command line. So the following sequence appears to work fine (so fa

Re: No such file or directory errors running tests

2014-07-27 Thread Reynold Xin
To run through all the tests you'd need to create the assembly jar first. I've seen this asked a few times. Maybe we should make it more obvious. http://spark.apache.org/docs/latest/building-with-maven.html Spark Tests in Maven Tests are run by default via the ScalaTest Maven plugin

No such file or directory errors running tests

2014-07-27 Thread Stephen Boesch
I have pulled latest from github this afternoon. There are many many errors: /assembly/target/scala-2.10: No such file or directory This causes many tests to fail. Here is the command line I am running mvn -Pyarn -Phadoop-2.3 -Phive package test