How best to ensure partitioners behave?

2014-02-27 Thread Bryn Keller
Hi Folks, I just filed https://spark-project.atlassian.net/browse/SPARK-1149 - I'm happy to fix it, but I'd like input about how best to go about it. The problem is, if a partitioner misbehaves by, say, returning a negative partition number, Spark hangs. This is easier to do than it sounds. I'd l

Re: How to run a single test suite?

2014-02-26 Thread Bryn Keller
Thanks, that was it! On Wed, Feb 26, 2014 at 10:05 PM, Reynold Xin wrote: > You put your quotes in the wrong place. See > https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools > > > > On Wed, Feb 26, 2014 at 10:04 PM, Bryn Keller wrote: > > > H

How to run a single test suite?

2014-02-26 Thread Bryn Keller
Hi Folks, I've tried using "sbt test-only '*PairRDDFunctionsSuite'" to run only that test suite, which is what I think is supposed to work with ScalaTest. I have also tried the variant with the fully qualified name spelled out as well. No matter what I try, it always runs *all* the test suites, wh