Unable to decode tag list after update

[Carlos Alonso]

I've added a couple of methods to a case class and updated the job on
Dataflow and started getting

java.lang.IllegalStateException: Unable to decode tag list using
org.apache.beam.sdk.coders.SerializableCoder@4ad81832

Caused by java.io.InvalidClassException: my.package.MessageWithAttributes;
local class incompatible: stream classdesc serialVersionUID =
-5160195612720162441, local class serialVersionUID = -9104690746829156208

It seems that, although the data contained in the class has not changed,
the class has changed it cannot deserialise it anymore. How should I
proceed to avoid this situations?

Thanks!

Re: Unable to decode tag list after update

[Carlos Alonso]

Another thing I've realised is that the stacktrace suggests it is using
SerializerCoder instead of the MessageWithAttributesCoder custom one I have
implemented. See it here: https://pastebin.com/86gWddi9

Is it possible that, upon updates, custom coders are not chosen? To give a
little more context. The MessageWithAttribtues object is contained within a
KV and a kept in a stateful/timely processing step. The coder is set before
that stateful step via .setCoder(KVCoder.of(StringUtf8Coder.of(),
MessageWithAttribtuesCoder.of())) and the exception is thrown when the
buffered items are flushed out.

Thanks!

On Wed, Feb 14, 2018 at 11:33 AM Carlos Alonso  wrote:

> I've added a couple of methods to a case class and updated the job on
> Dataflow and started getting
>
> java.lang.IllegalStateException: Unable to decode tag list using
> org.apache.beam.sdk.coders.SerializableCoder@4ad81832
>
> Caused by java.io.InvalidClassException: my.package.MessageWithAttributes;
> local class incompatible: stream classdesc serialVersionUID =
> -5160195612720162441, local class serialVersionUID = -9104690746829156208
>
> It seems that, although the data contained in the class has not changed,
> the class has changed it cannot deserialise it anymore. How should I
> proceed to avoid this situations?
>
> Thanks!
>

Re: Unable to decode tag list after update

[Carlos Alonso]

Also I think this situation leads to a blocked status in which elements
with two different version UIDs are mixed and therefore unable to progress.

When I realised this was happening, I tried to rollback to the previous
version of the pipeline to drain it and then re-create the job with the new
version, but during that time, as new elements were streamed in, the old
version wasn't able to decode de new ones.

Does it make any sense?

Thanks!

On Wed, Feb 14, 2018 at 12:50 PM Carlos Alonso  wrote:

> Another thing I've realised is that the stacktrace suggests it is using
> SerializerCoder instead of the MessageWithAttributesCoder custom one I have
> implemented. See it here: https://pastebin.com/86gWddi9
>
> Is it possible that, upon updates, custom coders are not chosen? To give a
> little more context. The MessageWithAttribtues object is contained within a
> KV and a kept in a stateful/timely processing step. The coder is set before
> that stateful step via .setCoder(KVCoder.of(StringUtf8Coder.of(),
> MessageWithAttribtuesCoder.of())) and the exception is thrown when the
> buffered items are flushed out.
>
> Thanks!
>
> On Wed, Feb 14, 2018 at 11:33 AM Carlos Alonso 
> wrote:
>
>> I've added a couple of methods to a case class and updated the job on
>> Dataflow and started getting
>>
>> java.lang.IllegalStateException: Unable to decode tag list using
>> org.apache.beam.sdk.coders.SerializableCoder@4ad81832
>>
>> Caused by java.io.InvalidClassException:
>> my.package.MessageWithAttributes; local class incompatible: stream
>> classdesc serialVersionUID = -5160195612720162441, local class
>> serialVersionUID = -9104690746829156208
>>
>> It seems that, although the data contained in the class has not changed,
>> the class has changed it cannot deserialise it anymore. How should I
>> proceed to avoid this situations?
>>
>> Thanks!
>>
>

Travel Assistance applications open for ApacheCon NA '18

[Jean-Baptiste Onofré]

Hi all,

I inform you that the travel assistance applications
(http://www.apache.org/travel/) are now open.

If you plan to attend to ApacheCon, but we can't for financial reason, you can
apply to the program.

Lot of committers, PMC members and members will be present, so it's a great
opportunity to discuss and meet all together.

I should be there and looking forward to meet some of you in person !

Regards
JB

-
The Travel Assistance Committee (TAC) are pleased to announce that travel
assistance applications for ApacheCon NA 2018 are now open!

We will be supporting ApacheCon NA Montreal, Canada on 24th - 29th September 
2018

 TAC exists to help those that would like to attend ApacheCon events, but are
unable to do so for financial reasons. For more info on this years applications
and qualifying criteria, please visit the TAC website at <
http://www.apache.org/travel/  >. Applications
are now open and will close 1st May.

Important: Applications close on May 1st, 2018. Applicants have until the
closing date above to submit their applications (which should contain as much
supporting material as required to efficiently and accurately process their
request), this will enable TAC to announce successful awards shortly afterwards.
As usual, TAC expects to deal with a range of applications from a diverse range
of backgrounds. We therefore encourage (as always) anyone thinking about sending
in an application to do so ASAP.   We look forward to greeting many of you in
Montreal

Kind Regards, Gavin - (On behalf of the Travel Assistance Committee)
—

Scio 0.5.0-beta1 released

[Filipe Regadas]

Hi all,

We just released Scio 0.5.0-beta1. This is mostly a bug fix release.

Cheers,
Regadas

https://github.com/spotify/scio/releases/tag/v0.5.0-beta1 


Features

Added ser/der support for joda DateTime #1038 

Password is now optional for jdbc connection #1040 

Bug fixes

Log exception in AsyncLookupDoFn only if cache put fails #1039 

ProjectId nonEmpty string check in BigQueryClient #1045 

Re: Strata Conference this March 6-8

[Ron Gonzalez]

 Folks,  Just wanted to confirm if we've finalized on meeting for the Strata 
Conference this March 6-8? I remember something about a calendar getting put 
somewhere but I can't seem to find that in beam.apache.org...
Thanks,Ron
On Monday, January 22, 2018, 2:13:01 PM CST, Griselda Cuevas 
 wrote:  
 
 Hi Everyone, 
+1 to the BoF. I'd suggest meeting at 3:30 p.m. on 3/7/2018 at the Philz Coffee 
Holden suggested. It takes about 10min to walk from the convention center 
there. 
re:Organizing a Meetup near the dates of Strata SJ. I can organize something 
for Wednesday night @ Google's campus. Would anyone have a use case or talk 
they'd like to share with the community?
re:Strata London -- @Matthias & Victor, happy to help on that as well. 
Cheers, G



On 19 January 2018 at 11:00, Tyler Akidau  wrote:

I'll be talking about streaming SQL at Strata SJC. It's related to the SQL work 
happening in Beam that Mingmin, James, and Anton are working on, but the talk 
itself is relatively conceptual, hence no Beam in the title. Is the BoF thing 
happening? If so, is Wed 3:20pm the confirmed time? I'll be flying back from 
QCon London that week, so will try to book flights that get me back in time for 
the BoF if I can.

-Tyler

On Thu, Jan 18, 2018 at 9:39 AM Jean-Baptiste Onofré  wrote:

I think Matthias has already some plan for London meetup later this year (it's
what he said to me).

Stay tuned !

Regards
JB

On 01/18/2018 06:29 PM, Ismaël Mejía wrote:
> My excuses I somehow misread the dates and thought you referred to the
> London conference, but well in the end this becomes two good ideas :)
>
> - A meetup in London for the week of May 21
> - A meetup in San Jose if someone can organize it for the March dates.
>
>
> On Thu, Jan 18, 2018 at 12:00 AM, Holden Karau  wrote:
>> So doing a streaming BoF join in would probably require meeting somewhere
>> other than a coffee shop so as not to be jerks in the coffee shop.
>>
>> On Wed, Jan 17, 2018 at 2:53 PM, Matthias Baetens
>>  wrote:
>>>
>>> Sure, I'd be very happy to organise something. This is about Strata San
>>> Jose though right? Maybe we can organise a remote session in which we can
>>> join (depending on when you would organise the BoF) or have a channel set-up
>>> if the talks would be broadcasted?
>>>
>>> Also: will there be any Beam talks on Strata London or is this not known
>>> yet? Keen to get involved and set things up around that date as well.
>>>
>>> On Wed, Jan 17, 2018 at 8:37 AM, Jean-Baptiste Onofré 
>>> wrote:

 That's a great idea ! I'm sure that Matthias (organizer of the Beam
 London Meetup) can help us to plan something.

 Regards
 JB


 On 01/17/2018 08:57 AM, Ismaël Mejía wrote:
>
> Maybe a good idea to try to organize a Beam meetup in london in the
> same dates in case some of the people around can jump in and talk too.
>
> On Wed, Jan 17, 2018 at 2:51 AM, Ron Gonzalez 
> wrote:
>>
>> Works for me...
>>
>> On Tuesday, January 16, 2018, 5:45:33 PM PST, Holden Karau
>>  wrote:
>>
>>
>> How would folks feel about during the afternoon break (3:20-4:20) on
>> the
>> Wednesday (same day as Eugene's talk)? We could do the Philz which is a
>> bit
>> of a walk but gets us away from the big crowd and also lets folks not
>> attending the conference but in the area join us.
>>
>> On Tue, Jan 16, 2018 at 5:29 PM, Ron Gonzalez 
>> wrote:
>>
>> Cool, let me know if you guys finally schedule it. I will definitely
>> try to
>> make it to Eugene's talk but having an informal BoF in the area would
>> be
>> nice...
>>
>> Thanks,
>> Ron
>>
>> On Tuesday, January 16, 2018, 5:06:53 PM PST, Boris Lublinsky
>>  wrote:
>>
>>
>> All for it
>>
>> Boris Lublinsky
>> FDP Architect
>> boris.lublin...@lightbend.com
>> https://www.lightbend.com/
>>
>> On Jan 16, 2018, at 7:01 PM, Ted Yu  wrote:
>>
>> +1 to BoF
>>
>> On Tue, Jan 16, 2018 at 5:00 PM, Dmitry Demeshchuk
>> 
>> wrote:
>>
>> Probably won't be attending the conference, but totally down for a BoF.
>>
>> On Tue, Jan 16, 2018 at 4:58 PM, Holden Karau 
>> wrote:
>>
>> Do interested folks have any timing constraints around a BoF?
>>
>> On Tue, Jan 16, 2018 at 4:30 PM, Jesse Anderson
>> 
>> wrote:
>>
>> +1 to BoF. I don't know if any Beam talks will be on the schedule.
>>
>>> We could do an informal BoF at the Philz nearby or similar?
>>
>>
>>
>>
>>
>> --
>> Twitter: https://twitter.com/h oldenkarau
>>
>>
>>
>>
>> --
>> Best regards,
>> Dmitry Demeshchuk.
>>
>>
>>
>>
>>
>>
>> --
>> Twitter: https://twitter.com/holdenkara u


 --
 Jean-Baptiste Onofré
 jbono...@apache.org
 http://blog.nanthrax.net
 Talend 

Re: Presentations about Apche Beam

[Eugene Kirpichov]

Sure, please go ahead and share them in this thread?

On Wed, Feb 14, 2018, 10:26 PM Davide Russo 
wrote:

> Dear Beam Community,
>
>
>
> My name is David and i’m a studet of University of Molise, Italy. I’m
> studing “Security of Software System” and during this degree I’m attending
> the course of “Complex Software Architecture and Styes”; for the exam I
> have to analyse an Apache complex system. I selected to analyse Apache Beam
> for many reason. I’m writing you because for this project I produced 3
> presentations about Beam that I would to submit you to add them on Beam
> website as presentation material. They derived in part form the existing
> presentation so if you think that these presentations are good and well
> done it could be cool if you add them on the Beam website. If you are
> interested let me know that I’ll send you as soon as possible my work.
>
>
>
> Best Regards.
>
> DR
>