Re: messageId from PubSubIO

2018-01-17 Thread Csaba Kassai
ok, thanks for the feature request. On Wed, 17 Jan 2018 at 19:52 Lukasz Cwik wrote: > It is currently not exposed. I filed > https://issues.apache.org/jira/browse/BEAM-3489 as a feature request. > It shouldn't be difficult to add if you would like to try to tackle this > feature. > > Here is a p

Re: Strata Conference this March 6-8

2018-01-17 Thread Holden Karau
So doing a streaming BoF join in would probably require meeting somewhere other than a coffee shop so as not to be jerks in the coffee shop. On Wed, Jan 17, 2018 at 2:53 PM, Matthias Baetens < matthias.baet...@datatonic.com> wrote: > Sure, I'd be very happy to organise something. This is about St

Re: Strata Conference this March 6-8

2018-01-17 Thread Matthias Baetens
Sure, I'd be very happy to organise something. This is about Strata San Jose though right? Maybe we can organise a remote session in which we can join (depending on when you would organise the BoF) or have a channel set-up if the talks would be broadcasted? Also: will there be any Beam talks on St

Scio 0.5.0-alpha1 is out

2018-01-17 Thread Neville Li
Hi all, We just released Scio 0.5.0-alpha1. This release includes a typed BigQuery performance improvement by bypassing intermediate TableRow JSONs. It has shown a 2x speed up in some of our benchmarks. Cheers, Neville https://github.com/spotify/scio/releases/tag/v0.5.0-alpha1 *"Ia Io"* Breakin

Re: messageId from PubSubIO

2018-01-17 Thread Lukasz Cwik
It is currently not exposed. I filed https://issues.apache.org/jira/browse/BEAM-3489 as a feature request. It shouldn't be difficult to add if you would like to try to tackle this feature. Here is a pointer to the contribution guide for more details: https://beam.apache.org/contribute/contribution

Re: Some interesting use case

2018-01-17 Thread zlgonzalez
Thanks Boris.Yeah we can talk about it at the BoF... Thanks,Ron Sent via the Samsung Galaxy S7 active, an AT&T 4G LTE smartphone Original message From: Boris Lublinsky Date: 1/17/18 6:10 AM (GMT-08:00) To: user@beam.apache.org Cc: d...@beam.apache.org, Charles Chen Subject

Re: Some interesting use case

2018-01-17 Thread Boris Lublinsky
Ron, If you are talking about Tensorflow Saved model format, I personally think that it is overkill for model serving. My preferred option is to used traditional TF export, which can be optimized for serving. As for processing I am using TF Java APIs, which basically is a population of the tenso

messageId from PubSubIO

2018-01-17 Thread Csaba Kassai
Hi, is it possible the get somehow the messageId field of a Pub/Sub message in a DoFn after using the PubSubIO Beam source to read the messages? I need the default id which was assigned by the Pub/Sub service. I want to log it for debugging purposes. Using a custom attribute for the unique id an

Re: Strata Conference this March 6-8

2018-01-17 Thread Jean-Baptiste Onofré
That's a great idea ! I'm sure that Matthias (organizer of the Beam London Meetup) can help us to plan something. Regards JB On 01/17/2018 08:57 AM, Ismaël Mejía wrote: Maybe a good idea to try to organize a Beam meetup in london in the same dates in case some of the people around can jump in