Getting null pointer exception in a basic setup, don't know why

2021-05-06 Thread Teodor Spæren
ntext.java:28) at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1136) Any help with this would be greatly appriciated. Best regards, Teodor Spæren

Re: Help measuring upcoming performance increase in flink runner on production systems

2020-12-21 Thread Teodor Spæren
u can add your variant as a new benchmark and compare the difference across many runs in a controlled benchmarking environment. Would that help? Ahmet [1] http://metrics.beam.apache.org/d/1/getting-started?orgId=1 On Tue, Dec 15, 2020 at 5:48 AM Teodor Spæren wrote: Hey! Yeah, that paper was

Re: Help measuring upcoming performance increase in flink runner on production systems

2020-12-15 Thread Teodor Spæren
methodologies to consider as you explore this a bit more: https://arxiv.org/pdf/1907.08302.pdf I’m looking forward to reading about your finding, especially using a more recent iteration of Beam! Rion On Dec 14, 2020, at 6:37 AM, Teodor Spæren wrote: Just bumping this so people see it now that 2.26.0

Re: Help measuring upcoming performance increase in flink runner on production systems

2020-12-14 Thread Teodor Spæren
Just bumping this so people see it now that 2.26.0 is out :) On Wed, Nov 25, 2020 at 11:09:52AM +0100, Teodor Spæren wrote: Hey! My name is Teodor Spæren and I'm writing a master thesis investigating the performance overhead of using Beam instead of using the underlying systems directl

Help measuring upcoming performance increase in flink runner on production systems

2020-11-25 Thread Teodor Spæren
Hey! My name is Teodor Spæren and I'm writing a master thesis investigating the performance overhead of using Beam instead of using the underlying systems directly. My focus has been on Flink and I've made a discovery about some unnecessary copying between operators in the Flink r

Design rational behind copying via serializing in flink runner

2020-08-28 Thread Teodor Spæren
I would love to hear about it. Best regards, Teodor Spæren [1]: https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/util/CoderUtils.java#L140 [2]: https://github.com/apache/beam/blob/6fdde4f4eab72b49b10a8bb1cb3be263c5c416b5/runners/flink/1.8/src/mai