One extra reminder, if you use the DirectRunner you can set the DirectOptions to make the validations of the runner loose (and gain some speed improvements).
setEnforceImmutability(false) setEnforceEncodability(false) On Mon, Jan 23, 2017 at 8:22 PM, Gareth Western <[email protected]> wrote: > Thanks Thomas. I'll be sure to convey that in the demo. The Flink local > runner performs nicely. I'm now setting up the Flink cluster for the next > test. > > > > On 23. jan. 2017 20:20, Thomas Groh wrote: > >> You should also generally expect the DirectRunner to be slower than >> production runners - the goals of the DirectRunner are primarily ensuring >> that Pipelines are portable to other production runners and enforcing the >> Beam Programming Model while enabling local iteration and development, and >> exposing bugs early. As a result, there is a relatively large amount of >> additional work done per-element that will slow the Pipeline, and consume >> additional local resources as the Pipeline executes. >> >> >
