Re: 2019 Beam Events

2018-12-04 Thread Matthias Baetens
Great stuff, Gris! Looking forward to what 2019 will bring! The Beam meetup in London will have a new get together early next year as well :-) https://www.meetup.com/London-Apache-Beam-Meetup/ On Tue, 4 Dec 2018 at 23:50 Austin Bennett wrote: > Already got that process kicked off with the NY

Re: org.apache.beam.runners.flink.PortableTimersExecutionTest is very flakey

2018-12-04 Thread Alex Amato
Well, here is my hacky solution. You can see the changes I make to PortableTimersExecutionTest https://github.com/apache/beam/pull/6786/files I don't really understand why the pipeline never starts running when I make the results object transient in PortableTiemrsExecutionTest. So I instead

Re: org.apache.beam.runners.flink.PortableTimersExecutionTest is very flakey

2018-12-04 Thread Alex Amato
Thanks for letting me know Maximillian, Btw, I've been looking a this test the last few days as well. I have found a few other concurrency issues. That I hope to send a PR out for. - The PortableTimersExecutionTest result variable is using a static ArrayList, but can be writen to

Re: GSOC - Summer of Code, on Beam?

2018-12-04 Thread Pablo Estrada
Hi Austin! Thanks a lot for surfacing this. I participated in GSOC as a student a couple times, and loved it. This being my first time around as a committer, I'm excited to try and help. I think, for starters, it may be good to find issues in JIRA to label with "gsoc", so please everyone who

Re: 2019 Beam Events

2018-12-04 Thread Austin Bennett
Already got that process kicked off with the NY and LA meet ups, now that SF is about to be inagurated goal will be to get these moving as well. For anyone that is in (or goes to) those areas: https://www.meetup.com/New-York-Apache-Beam/ https://www.meetup.com/Los-Angeles-Apache-Beam/ Please

GSOC - Summer of Code, on Beam?

2018-12-04 Thread Austin Bennett
Would it make sense to have any GSOC students for next summer work on Beam? Do we have some candidate things that would be suitable and sufficiently discrete projects? Initial applications for organizations not even open for about a month, though thought worth getting a sense from the group. A

Re: 2019 Beam Events

2018-12-04 Thread Griselda Cuevas
+1 to Pablo's suggestion, if there's interest in "Founding a Meetup group in a particular city, let's create the Meetup page and start getting sign ups. Joana will be reaching out with a comprenhexive list of how to get started and we're hoping to compile a high level calendar of

Re: [DISCUSS] Structuring Java based DSLs

2018-12-04 Thread Rui Wang
For pure SQL users, there shouldn't be a SDK concepts. SQL shell and JDBC driver should be the way to interact Beam by SQL. For embedded SQL use case in all SDKs (Python, Go, etc.), even assume there are relational algebra operators defined in SDKs, SDKs still have to implement its own way to

Re: 2019 Beam Events

2018-12-04 Thread Daniel Salerno
=) What good news! Okay, I'll set up the group and try to get interested. Thank you Em ter, 4 de dez de 2018 às 17:19, Pablo Estrada escreveu: > FWIW, for some of these places that have interest (e.g. Brazil, Israel), > it's possible to create a group in meetup.com, and start gauging >

Re: 2019 Beam Events

2018-12-04 Thread Pablo Estrada
FWIW, for some of these places that have interest (e.g. Brazil, Israel), it's possible to create a group in meetup.com, and start gauging interest, and looking for organizers. Once a group of people with interest exists, it's easier to get interest / sponsorship to bring speakers. So if you are

Re: 2019 Beam Events

2018-12-04 Thread Daniel Salerno
It's a shame that there are no events in Brazil ... =( Em ter, 4 de dez de 2018 às 13:12, OrielResearch Eila Arich-Landkof < e...@orielresearch.org> escreveu: > agree  > > On Tue, Dec 4, 2018 at 5:41 AM Chaim Turkel wrote: > >> Israel would be nice to have one >> chaim >> On Tue, Dec 4, 2018

Re: 2019 Beam Events

2018-12-04 Thread OrielResearch Eila Arich-Landkof
agree  On Tue, Dec 4, 2018 at 5:41 AM Chaim Turkel wrote: > Israel would be nice to have one > chaim > On Tue, Dec 4, 2018 at 12:33 AM Griselda Cuevas wrote: > > > > Hi Beam Community, > > > > I started curating industry conferences, meetups and events that are > relevant for Beam, this

Re: 2019 Beam Events

2018-12-04 Thread Maximilian Michels
Thanks for sharing, Gris! This list will likely never be complete, as there are endless conferences :) Nevertheless, it's a great idea to coordinate the attendance for the major ones. Cheers, Max On 03.12.18 23:33, Griselda Cuevas wrote: Hi Beam Community, I started curating industry

Re: Graceful shutdown of long-running Beam pipeline on Flink

2018-12-04 Thread Maximilian Michels
Thank you for sharing these, Lukasz! Great question, Wayne! As for pipeline shutdown, Flink users typically take a snapshot and then cancel the pipeline with Flink tools. The Beam tooling needs to be improved to support cancelling as well. If snapshotting is enabled, the Beam job could also

Re: 2019 Beam Events

2018-12-04 Thread Chaim Turkel
Israel would be nice to have one chaim On Tue, Dec 4, 2018 at 12:33 AM Griselda Cuevas wrote: > > Hi Beam Community, > > I started curating industry conferences, meetups and events that are relevant > for Beam, this initial list I came up with. I'd love your help adding others > that I might

Re: [DISCUSS] Structuring Java based DSLs

2018-12-04 Thread Jan Lukavský
Hi Kenn, my intent really was not to propose any changes right now. I'm trying to create a clear understanding about what the relation between Euphoria and SQL should be in long run. In my point of view, Euphoria should be always superset of SQL, because it should support complete relational

Re: contributor in the Beam

2018-12-04 Thread Chaim Turkel
done, thanks On Mon, Dec 3, 2018 at 11:36 AM Jean-Baptiste Onofré wrote: > > Can you please fix the conflict in the PR ? > > Thanks > Regards > JB > > On 03/12/2018 08:52, Chaim Turkel wrote: > > it looks like there was a failure that is not due to the code, how can > > i continue the process? >