I'm not opposed to switching them. IIRC the the "using" clause is ignored in local mode, so tests for joins, cogroup, etc. that have "using" should not be switched. I want to discuss further how to fix this at the developer meeting next week. The current setup is a total mess.

Alan.

On Apr 15, 2011, at 2:59 PM, Dmitriy Ryaboy wrote:

There are quite a few tests in the suite that use ExecType.MAPREDUCE. It seems to me that we can now get away with ExecType.LOCAL for many of these, since local is now using Hadoop. The difference in test speed is fairly dramatic -- when I switched HBaseStorage tests, they went from roughly 50 seconds each to roughly 12 seconds each. The only tests for which (I think) we need the full MAPREDUCE exec mode is when we are messing with classpaths,
need to ensure new jvms pick up the right classes, etc. Objections to
switching these tests over? Suggestions on what to watch out for?

D

Reply via email to