Apache Beam London meetup 9: recordings

Hi all The recordings from last year's Apache Beam meetup London are now available on the YouTube channel (apologies for the delay): - Apache Beam meetup 9: BBC's journey with Apache Beam - Apache Beam meetup 9: Apache Beam + Apache Druid

Apache Beam meetup London 21st of September

Hi everyone! Join us for the next Apache Beam meetup in London, happening in a bit over 2 weeks on the 21st of September. It will be in-person (but to keep things COVID-safe, with a limited attendance). More details: https://www.meetup.com/London-Apache-Beam-Meetup/events/280442419 Looking forwar

Re: October 2020, Beam Community Update

This is really awesome indeed, Brittany :) If I could only read Alexey's mind, but my hunch is that this could come in blogpost format on the website (as well) and sharing it on the Twitter handle? On Tue, 3 Nov 2020 at 20:54, Pablo Estrada wrote: > Hi Alexey, > Do you have any other place in m

New Dates For Beam Summit Digital 2020

, Austin Bennett, Matthias Baetens, Alex Van Boxel

Register now for the Beam Summit 2020!

Hi all, We are happy to share some more information on the *Beam Summit 2020* that will take place on the *world wide web* this time around :) 🎫 You can now *register on Crowdcast *, where the conference will take place. 💸 Want to help to make the Beam Summit ev

Re: Beam Katas YouTube

me to review and publish the tweet? > > > > On Thu, Apr 2, 2020 at 12:32 AM Matthias Baetens < > baetensmatth...@gmail.com> wrote: > >> I see :-) That's a good idea, iirc the best way to do that is through >> this >> <https://docs.google.com/spreadsh

Re: Beam Katas YouTube

not owned by me and managed by the Level Up > YouTube channel team. > Maybe we can do a tweet from @ApacheBeam? > > > > > On Wed, Apr 1, 2020 at 2:27 PM Matthias Baetens > wrote: > >> This is brilliant, Henry! Let me know if you want this posted on the Beam >>

Re: Beam Katas YouTube

This is brilliant, Henry! Let me know if you want this posted on the Beam YouTube channel as well in case you have access to the raw file. Cheers, Matthias On Fri, 27 Mar 2020 at 20:02, Pablo Estrada wrote: > Nice : D > > On Fri, Mar 27, 2020 at 12:44 AM Alex Van Boxel wrote: > >> That's nicel

Beam Summit North America 2019 - recordings

Hi everyone, It's our pleasure to share the recordings from the Beam Summit North America 2019. Please find them in the YouTube playlist on the Apache Beam channel .

Re: Feedback on how we use Apache Beam in my company

This is great, Pierre! Thank you for sharing, very interesting. Would you and your team be interested to talk about your use case at a meetup (or Summit) in the future? :) All the best, Matthias On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot wrote: > Very nice ! > > Thanks > > ccing dev list >

Re: Beam meetups: Paris (01/07/2019) and Stockholm (25/07/2019)

t; On Mon, Jul 8, 2019 at 8:30 AM Alexey Romanenko > wrote: > >> Matthias, thank you for organizing the first Beam meetup in Paris! >> It was very cool even if it was quite hot outside that day in the city, >> thanks to the weather =) >> >> On 26 Jun 2019, a

Beam meetups: Paris (01/07/2019) and Stockholm (25/07/2019)

Hi everyone! Happy to announce 2 upcoming Beam Summits: One in *Paris *on *01/07/2019 *with JB talking about Beam IOs, Konstantin Knauf talking about Beam on Flink and Pablo Estrada talking about SQL in Beam! More info and RSVP: https://www.meetup.com/Paris-Apache-Beam-Meetup/events/261775884/ On

Beam Summit volunteering team

Hi everyone, As you might know, the Beam Summit is currently organised by a small team of people committing their free time to make this happen. We are looking to make this group larger in the future and particularly could use some help on website maintenance, develo

Beam Summit Europe: speakers and schedule online!

Hi everyone, Happy to share that the speakers and schedule are now online on the website. Make sure you register on Eventbrite if you want to attend and follow out Twitter channel

Meetups in London, Stockholm + recordings

Hi everyone, Happy to announce 2 meetups for the next week(s): - *London *is having its second meetup of the year on *01/05/2019 in Level39, Canary Wharf

Beam meetup London at Revolut 03/04/2019

Hi everyone, On Wednesday 03/04, we will have the next Beam meetup in London at the Revolut offices. Robert Bradshaw will do a deep dive on portability, while Revolut will present its use-case on using Beam for fraud detection. More info and RSVP on the meetup page https://www.meetup.com/London-

Re: [Announcement] New Website for Beam Summits

Awesome Aizhamal! Great work and thanks for your continued efforts on this :) Looking forward to the summit. On Mon, 18 Mar 2019 at 23:17, Aizhamal Nurmamat kyzy wrote: > Hello everybody! > > We are thrilled to announce the launch of beamsummit.org dedicated to > Beam Summits! > > The current ve

Beam Summit Europe 2019: CfP

Hi everyone, As you might already know, the *Beam Summit Europe 2019* will take place in *Berlin* this year on *19-20 June*! Of course, we would love to have you there. That is why we are opening the *Call for Speakers .* We are looking for people

Re: Beam Python streaming pipeline on Flink Runner

reads including pubsub are not yet supported for > portable runners. > > Thanks, > Ankur > > On Thu, Jan 31, 2019 at 2:44 PM Matthias Baetens < > baetensmatth...@gmail.com> wrote: > >> Hi everyone, >> >> Last few days I have been trying to run a streaming

Beam Python streaming pipeline on Flink Runner

Hi everyone, Last few days I have been trying to run a streaming pipeline (code on Github ) on a Flink Runner. I am running a Flink cluster locally (v1.5.6 ) I have built the SDK Harness Container: *./gradlew :beam-

Re: Beam Summits!

@Reza Rokni : I was planning to reach out to you for the Asian edition of the Summit - do you think Singapore would make sense? On Mon, 7 Jan 2019 at 07:25, Matthias Baetens wrote: > Hey Austin, > > Yes, it would be good to get going soon. We started approx. 3 months > before th

Re: Beam Summits!

> >> Also, you mentioned planning London wound up with a tight time window. >> If shooting for April in SF, seems the clock might be starting to tick. >> Any advice for how much time needed? And guidance on getting whatever >> formal needed through Apache - and doe

Re: Beam Summits!

Great stuff, thanks for the overview, Austin. For EU, there are things to say for both Stockholm and Berlin, but I think it makes sense to do it on the back of another conference (larger chance of people being in town with the same interest). I like Thomas comment - we will attract more people fro

Re: 2019 Beam Events

Great stuff, Gris! Looking forward to what 2019 will bring! The Beam meetup in London will have a new get together early next year as well :-) https://www.meetup.com/London-Apache-Beam-Meetup/ On Tue, 4 Dec 2018 at 23:50 Austin Bennett wrote: > Already got that process kicked off with the NY a

Re: Slides from OSCON

found this video: >>> https://www.safaribooksonline.com/videos/oscon-2018/9781492026075/9781492026075-video321550 >>> Though it requires a suscription to Safari books. >>> Best >>> -P. >>> >>> On Tue, Sep 4, 2018 at 8:21 AM Matthias B

Re: Bay Area Apache Beam Kickoff!

Awesome effort awesome - good luck on the first meetup! :) On Tue, 20 Nov 2018 at 01:37 Austin Bennett wrote: > We have our first meetup scheduled for December 12th in San Francisco. > > Andrew Pilloud, a software engineer at Google and Beam committer, will > demo the latest feature in Beam SQL:

Re: [Call for items] November Beam Newsletter

Looks great, thanks for the effort and for including the Summit blogpost, Rose! On Thu, 8 Nov 2018 at 22:55 Rose Nguyen wrote: > Hi Beamers: > > Time to sync with the community on all the awesome stuff we've been doing! > > *Add the highlights from October to now (or planned events and talks) th

Recordings and presentations from Beam Summit London 2018

Hi everyone, Very happy to be sharing the great materials from the speakers and contributors at the Beam Summit we had in London last month in the *new blogpost* on the website: https://beam.apache.org/blog/2018/10/31/beam-summit-aftermath.html You can find the full list of presentations and reco

Re: Slides from OSCON

Hey Holden, just checking if you were able to find something? :) -M On Sat, Aug 25, 2018, 12:07 Holden Karau wrote: > Good question, I’ll take a look tonight :) > > On Sat, Aug 25, 2018 at 6:32 AM Matthias Baetens < > baetensmatth...@gmail.com> wrote: > >> Hey Ho

Re: Beam Summit London 2018

under the impression that python beam is not yet available to run >> on spark/hadoop. >> Am I missing something? >> Let me know. >> Thanks. >> >> *--* >> *Mahesh Vangala* >> *(Ph) 443-326-1957 <(443)%20326-1957>* >> *(web) mvangala.com <http:/

Re: Slides from OSCON

Hey Holden, Have you found the video in the meanwhile? Happy to upload it to the Beam channel :) Cheers, M On Wed, 25 Jul 2018 at 02:52 Holden Karau wrote: > Hi Friends, > > If you missed my talk @ OSCON on TFT/TFMA + Beam on Flink (and other > related adventures), I've uploaded my slides to > h

Re: Beam Summit London 2018

n I send my proposal. > > Cheers! > > On Wed, Aug 22, 2018 at 10:58 AM Matthias Baetens < > baetensmatth...@gmail.com> wrote: > >> Hi Pascal, Javier, >> >> Thanks for your interest in submitting a talk! >> @Pascal: I am happy to check for you if what

Re: Beam Summit London 2018

submitting on similar topic! >> Cheers, >> Pascal >> >> On Tue, Aug 21, 2018 at 1:59 PM, Matthias Baetens < >> baetensmatth...@gmail.com> wrote: >> >>> Hi everyone, >>> >>> We are happy to invite you to the first Beam Summit in Lond

Beam Summit London 2018

Hi everyone, We are happy to invite you to the first Beam Summit in London. The summit will be held in London at Level39 on *October 1 and 2.* You can register to attend for free on the Eventbrite page

Re: Apache Beam Summit in Europe

minute, it would be great if you could fill this out (retweets are, of course, greatly appreciated as well). For the dates, we are thinking of: - 28-29/09 - 1-2/10 or 3-4/10 - 15-16/10 Happy to hear your preferences and comments. Best, Matthias On Thu, 31 May 2018 at 07:15 Matthias Baetens wrote

Re: [Events] Big Data in Production Boston Meetup, Today!

sn’t work and I will download it > > Thanks, > > ——— > Eila > www.orielresearch.org > www.meetup.com/deep-learning-in-production > > On Jun 28, 2018, at 12:22 PM, Matthias Baetens > wrote: > > Hey Eila, > > Do you have the original file and could you share tha

Re: London Apache Beam meetup 5

Also sharing the (audio) recording now: http://bit.ly/FifthApacheBeamMeetupLondonrecording Enjoy! On Mon, 11 Jun 2018 at 16:41 Alexey Romanenko wrote: > Thank you for sharing, Matthias! > > WBR, > Alexey > > > On 10 Jun 2018, at 14:45, Matthias Baetens > wrote: >

Re: [Events] Big Data in Production Boston Meetup, Today!

u, Jun 28, 2018 at 5:52 AM, Matthias Baetens < > baetensmatth...@gmail.com> wrote: > >> Looks awesome! Shall I add the talk to the Beam YouTube channel as well? >> >> On Tue, 26 Jun 2018 at 23:40 Griselda Cuevas wrote: >> >>> In case you'd like to

Re: [Events] Big Data in Production Boston Meetup, Today!

Looks awesome! Shall I add the talk to the Beam YouTube channel as well? On Tue, 26 Jun 2018 at 23:40 Griselda Cuevas wrote: > In case you'd like to follow the talk live, here is the livestream link: > > https://www.youtube.com/watch?v=aSU9y0E-WMA > > > > On Tue, 26 Jun 2018 at 16:11, Griselda C

Re: [FYI] New Apache Beam Swag Store!

1 week. Each company or user will need to pay for their own swag. >>>>- If you are hosting an event or representing Beam at one, reach >>>>out to me or the beam-events-meetups slack channel, I'll be happy to >>>> review >>>

Re: London Apache Beam meetup 5

Hi all, Sharing the slides from the meetup this week here <http://bit.ly/ApacheBeamLondonMeetupSlides5>. Enjoy! Best, Matthias On Sun, 3 Jun 2018 at 19:38 Matthias Baetens wrote: > Hi all, > > Happy to announce our 5th Beam meetup in London > > This Thursday, 7th of Ju

London Apache Beam meetup 5

Hi all, Happy to announce our 5th Beam meetup in London This Thursday, 7th of June, we’ll have Reuven Lax, senior software engineer at Google and Jean-Baptiste, software architect at Talend at the Qubit office to give you an update on the Beam project. JB will

Apache Beam Summit in Europe

Hi Beam Community, We are planning to have an Apache Beam Summit in Europe, pretty similar to what we hosted earlier in California on March 15th this year. If you'd be interested in attending, helping with organization or speaking, please answer this Google form

Beam YouTube channel

Hi all! Just reminding you all that we'd be happy to receive contributions of recordings (talks, meetups, conferences, demo's) to put on the YouTube channel. Read more about the process and guidelines here . Do not h

Re: I'm back and ready to help grow our community!

Same here - shame on me. Congratulations on the graduation Gris, very happy to have you back! On Tue, 22 May 2018 at 09:19 Ismaël Mejía wrote: > I missed somehow this email thread. > Congratulations Gris and welcome back! > > On Fri, May 18, 2018 at 5:34 AM Jesse Anderson > wrote: > > > Congrat

Third Apache Beam meet up in London

Hi all, We are very excited to announce the third Apache Beam meetup in London *the 5th of March*. Tyler Akidau (Google) will be talking about Streaming SQL, while Victor Kotai (Qubit) will talk about putting a Beam pipeline in production and how to monitor it, while I (Datatonic) will do a talk

Re: London Apache Beam meetup 2: 11/01

As promised (but with some delay): the recording <http://bit.ly/SecondApacheBeamMeetupLondonRecording> of our second Beam meetup in London! Enjoy :-) On Tue, Jan 9, 2018 at 12:30 PM, Carlos Alonso wrote: > Cool, thanks!! > > > On Mon, Jan 8, 2018 at 1:38 PM Matthias Baetens

Re: Strata Conference this March 6-8

attending the conference, but totally down for a BoF. >>> >>> On Tue, Jan 16, 2018 at 4:58 PM, Holden Karau >>> wrote: >>> >>> Do interested folks have any timing constraints around a BoF? >>> >>> On Tue, Jan 16, 2018 at 4:30 PM, Jesse Ande

Re: London Apache Beam meetup 2: 11/01

Yes, we put everything in place to record this time and hope to share the recordings soon after the meetup. Stay tuned! On 8 Jan 2018 10:32, "Carlos Alonso" wrote: Will it be recorded? On Fri, Jan 5, 2018 at 5:11 PM Matthias Baetens wrote: > Hi all, > > Excited to annou

London Apache Beam meetup 2: 11/01

Hi all, Excited to announce the second Beam meet up located in the *Qubit offices *next *Thursday 11/01.* We are very excited to have JB flying in to talk about IO and Splittable DoFns and Vadim Sobolevski to share on how FutureFlow uses Beam in a finance use ca

Re: London Apache Beam meetup 2: call for speakers

community visiting London who could be a speaker? >>>> >>>> It'd be great to have one London Meetup on 12/5 because we're hosting >>>> one in SF and one in NY so it'd be awesome to have three on the same day! >>>> >>>> >&g

Re: London Apache Beam meetup 2: call for speakers

ine the invite as I will be at Strata > Singapore in > the same time :( > > I'm very sorry about that. You can count on me for the 3rd edition ! > > Regards > JB > > On 11/07/2017 01:41 AM, Matthias Baetens wrote: > > Hi all! > > > > Hope you are well

London Apache Beam meetup 2: call for speakers

Hi all! Hope you are well. We are back for a second edition of the London Apache Beam meetup, aiming for the 5th of December. We are pretty excited to announce that our first speaker will be Jean-Baptiste Onofré himself! If you have an interesting *use-case* to shar

Re: PipelineTest with TestStreams: unable to serialize

re anonymous classes. >> It means that your test is trying to serialise testpipeline. >> >> Best regards >> Aleksandr Gortujev >> >> >> >> 3. nov 2017 3:33 PM kirjutas kuupäeval "Matthias Baetens" < >> matthias.baet...@datatonic.com

PipelineTest with TestStreams: unable to serialize

Hi all, I'm currently trying to write a TestStream to validate the windowing logic in a Beam pipeline. I'm creating a teststream of Strings and applying the different PTransforms to the stream, ending with a PAssert on some of the events I created TestStream events = TestStream.create(AvroCoder.

Re: October Apache Beam Newsletter

- FileIO.write() >> >> >> New Members (Welcome!) >> - Daniel Harper, BBC, London (UK) >> >> >> Talks & Meetups >> - Talks @ YOW Data Sydney and Strata NY >> - Meetups @ London & dinner in NY >> - Speakers & Meetup Founders group

Re: Apache Beam meetup London 1: debrief

e you talk! Thanks :) Best, Matthias Op di 10 okt. 2017 om 14:23 schreef Jean-Baptiste Onofré : > Thanks for the update ! > > That's a great stuff ! > > Looking forward next Beam meetup and hope to be able to participate ! > > Regards > JB > > On 10/10/2017

Apache Beam meetup London 1: debrief

Hi all! We had our first Apache Beam meetup last week, and we just released a small blogpost about it! Stay tuned for more of these or reach out if you have something interesting to share :) Also: if you are thinking to s

Re: London Apache Beam meet up

> > On 09/08/2017 12:01 AM, Matthias Baetens wrote: > >> Hi all, >> >> After a bit of delay I managed to schedule our first Apache Beam meet up < >> https://www.meetup.com/London-Apache-Beam-Meetup/events/243123359/>, on >> *October 3rd* here in *Lon

London Apache Beam meet up

Hi all, After a bit of delay I managed to schedule our first Apache Beam meet up , on *October 3rd* here in *London*! I will try to build a community to discuss both use cases (and value to the business) as well as do more techni

Re: ReadFromDatastore in the cloud

ng_location gs:// --runner > DataflowPipelineRunner --job_name " > > Did you get a chance to look at the job worker logs, for any errors that > the pipeline is throwing? (that should give us a better idea). > > Regards, > Vikas > > On Thu, Jan 12, 2017 at 7:39 AM, Matt

ReadFromDatastore in the cloud

Hi all, Using the Python SDK (the one installed using pip install google-cloud-dataflow) I have implemented a very simple pipeline trying to read from Datastore and print the result on a dataset with just 3 entities: entities = p \ | 'read from datastore' >> ReadFromDatastore(project='p

Re: CombineWithContext

g. > > We'll get these APIs consistent. > > Kenn > > On Tue, Jan 3, 2017 at 11:29 AM, Matthias Baetens < > matthias.baet...@datatonic.com> wrote: > >> Hi everyone, >> >> I have been trying to write a CombineFnWithContext; in the Context I want &g

CombineWithContext

Hi everyone, I have been trying to write a CombineFnWithContext; in the Context I want to have a map containing values to filter the input values. If I'm correct, I can access the sideinput in the addInput(Accum accum, Log input, Context c) operation using c.sideInput(). When constructing the mai