Interesting On Wed, Oct 10, 2018, 3:49 PM Kenneth Knowles <k...@apache.org> wrote:
> Welcome, Hai! > > On Wed, Oct 10, 2018 at 3:46 PM Hai Lu <lhai...@gmail.com> wrote: > >> Hi, all >> >> This is Hai from LinkedIn. As Xinyu mentioned, I have been working on >> portable API for Samza runner and made some solid progress. It's been a >> very smooth process (although not effortless for sure) and I'm really >> grateful for the great platform that you all have built. I'm very >> impressed. Bravo! >> >> Excited to work with everyone on Beam. Do expect more questions from me >> down the road. >> >> Thanks, >> Hai >> >> On Wed, Oct 10, 2018 at 12:36 PM Kenneth Knowles <k...@apache.org> wrote: >> >>> Clarification: Thomas Groh wrote the fuser, not me! >>> >>> Thanks for the sharing all this. Really cool. >>> >>> Kenn >>> >>> On Wed, Oct 10, 2018 at 11:17 AM Rui Wang <ruw...@google.com> wrote: >>> >>>> Thanks for sharing! it's so exciting to hear that Beam is being used on >>>> Samza in production @LinkedIn! Your feedback will be helpful to Beam >>>> community! >>>> >>>> Besides, Beam supports SQL right now and hopefully Beam community could >>>> also receive feedback on BeamSQL >>>> <https://beam.apache.org/documentation/dsls/sql/overview/> in the >>>> future. >>>> >>>> -Rui >>>> >>>> On Wed, Oct 10, 2018 at 11:10 AM Jean-Baptiste Onofré <j...@nanthrax.net> >>>> wrote: >>>> >>>>> Thanks for sharing and congrats for this great work ! >>>>> >>>>> Regards >>>>> JB >>>>> Le 10 oct. 2018, à 20:23, Xinyu Liu <xinyuliu.us <%3Ca>@gmail.com >>>>> target=_blank>xinyuliu...@gmail.com> a écrit: >>>>>> >>>>>> Hi, All, >>>>>> >>>>>> It's been over four months since we added the Samza Runner to Beam, >>>>>> and we've been making a lot of progress after that. Here I would like to >>>>>> update your guys and share some really good news happening here at >>>>>> LinkedIn: >>>>>> >>>>>> 1) First Beam job in production @LInkedIn! >>>>>> After a few rounds of testing and benchmarking, we finally rolled out >>>>>> our first Beam job here! The job uses quite a few features, such as event >>>>>> time, fixed/session windowing, early triggering, and stateful processing. >>>>>> Our first customer is very happy and they highly appraise the easy-to-use >>>>>> Beam API as well as powerful processing model. Due to the limited >>>>>> resources >>>>>> here, we put our full trust in the work you guys are doing, and we didn't >>>>>> run into any surprises. We see extremely attention to details as well as >>>>>> non-compromise in any user experience everywhere in the code base. We >>>>>> would >>>>>> like to thank everyone in the Beam community to contribute to such an >>>>>> amazing framework! >>>>>> >>>>>> 2) A portable Samza Runner prototype >>>>>> We are also starting the work in making Samza Runner portable. So far >>>>>> we just got the python word count example working using portable Samza >>>>>> Runner. Please look out for the PR for this very soon :). Again, this >>>>>> work >>>>>> is not possible without the great Beam portability framework, and the >>>>>> developers like Luke and Ahmet, just to name a few, behind it. The >>>>>> ReferenceRunner has been extremely useful to us to figure out what's >>>>>> needed >>>>>> and how it works. Kudos to Thomas Groh, Ben Sidhom and all the others who >>>>>> makes this available to us. And to Kenn, your fuse work rocks. >>>>>> >>>>>> 3) More contributors in Samza Runner >>>>>> The runner has been Chris and my personal project for a while and now >>>>>> it's not the case. We got Hai Lu and Boris Shkolnik from Samza team to >>>>>> contribute. Hai has been focusing on the portability work as mentioned in >>>>>> #2, and Boris will work mostly on supporting our use cases. We will send >>>>>> more emails discussing our use cases, like the "Update state after >>>>>> firing" >>>>>> email I sent out earlier. >>>>>> >>>>>> Finally, a shout-out to our very own Chris Pettitt. Without you, none >>>>>> of the above won't happen! >>>>>> >>>>>> Thanks, >>>>>> Xinyu >>>>>> >>>>>