Re: [External] Re: Setting a custom Kryo serializer in Flink-Python

2018-09-24 Thread Chesnay Schepler
I can't really help you here. Digging into the backing java internals isn't supported, and neither is registering a kryo serializer (which is why it isn't exposed in the python environment). The jython-related serialization logic doesn't care about Flink's usual type serialization mechanism,

Re: [External] Re: Setting a custom Kryo serializer in Flink-Python

2018-09-18 Thread Joe Malt
Bumping this (I hope that's OK!) - I've been trying to fix this for a week and got nowhere On Mon, Sep 17, 2018 at 8:40 AM, Kostas Kloudas wrote: > Hi Joe, > > Probably Chesnay (cc’ed) may have a better idea on why this is happening. > > Cheers, > Kostas > > On Sep 14, 2018, at 7:30 PM, Joe

Re: Setting a custom Kryo serializer in Flink-Python

2018-09-17 Thread Kostas Kloudas
Hi Joe, Probably Chesnay (cc’ed) may have a better idea on why this is happening. Cheers, Kostas > On Sep 14, 2018, at 7:30 PM, Joe Malt wrote: > > Hi, > > I'm trying to write a Flink job (with the Python streaming API) that handles > a custom type that needs a custom Kryo serializer. > >

Setting a custom Kryo serializer in Flink-Python

2018-09-14 Thread Joe Malt
Hi, I'm trying to write a Flink job (with the Python streaming API) that handles a custom type that needs a custom Kryo serializer. When we implemented a similar job in Scala we used addDefaultKryoSerializer, similar to the instructions in