Is the provided Serializer/TypeInformation checked "too late"?

2019-07-08 Thread Niels Basjes
Hi, Context: I'm looking into making the Google (BigQuery compatible) HyperLogLog++ implementation available in Flink because it is simply an Apache licensed opensource library - https://issuetracker.google.com/issues/123269269 - https://issues.apache.org/jira/browse/BEAM-7013 - https://github.com

Re: Is the provided Serializer/TypeInformation checked "too late"?

2019-07-08 Thread Timo Walther
Hi Niels, the type handling evolved during the years and is a bit messed up through the different layers. You are almost right with your last assumption "Is the provided serialization via TypeInformation 'skipped' during startup and only used during runtime?". The type extraction returns a Kr

Re: Is the provided Serializer/TypeInformation checked "too late"?

2019-07-09 Thread Niels Basjes
Hi Timo, Thanks for the clarification. It reassuring to hear that my code does the right thing. I'll just ignore these messages for now. Niels On Mon, 8 Jul 2019, 15:09 Timo Walther, wrote: > Hi Niels, > > the type handling evolved during the years and is a bit messed up > through the differe