Some how missed that ;) Anything about Datasets slowness ? On Wed, May 11, 2016, 21:02 Ted Yu <yuzhih...@gmail.com> wrote:
> Which release are you using ? > > You can use the following to disable UI: > --conf spark.ui.enabled=false > > On Wed, May 11, 2016 at 10:59 AM, Amit Sela <amitsel...@gmail.com> wrote: > >> I've ran a simple WordCount example with a very small List<String> as >> input lines and ran it in standalone (local[*]), and Datasets is very slow.. >> We're talking ~700 msec for RDDs while Datasets takes ~3.5 sec. >> Is this just start-up overhead ? please note that I'm not timing the >> context creation... >> >> And in general, is there a way to run with local[*] "lightweight" mode >> for testing ? something like without the WebUI server for example (and >> anything else that's not needed for testing purposes) >> >> Thanks, >> Amit >> > >
