PyFlink DDL UDTF join error

2020-07-28 Thread Manas Kale
Hi, Using pyFlink DDL, I am trying to: 1. Consume a Kafka JSON stream. This has messages with aggregate data, example: "data": "{\"0001\":105.0,\"0002\":1.21,\"0003\":0.69,\"0004\":1.46,\"0005\":47.43,\"0006\":103.3}" 2. I am splitting field "data" so that I can process its values

Re: PyFlink DDL UDTF join error

2020-07-28 Thread Wei Zhong
Hi Manas, It seems like a bug. You can try to replace the udtf sql call with such code as a workaround currently: t_env.register_table("tmp_view", t_env.from_path(f"{INPUT_TABLE}").join_lateral("split(data) as (featureName, featureValue)")) This works for me. I’ll try to find out what caused

Re: PyFlink DDL UDTF join error

2020-07-29 Thread Wei Zhong
Hi Manas, It seems a bug of the create view operation. I have created a JIRA for it: https://issues.apache.org/jira/browse/FLINK-18750 Before repairing, please do not use create view operation for udtf call. Best, Wei > 在 2020年7月28日,21:19,W

Re: PyFlink DDL UDTF join error

2020-07-29 Thread Manas Kale
Hi Wei, Thank you for the clarification and workaround. Regards, Manas On Wed, Jul 29, 2020 at 12:55 PM Wei Zhong wrote: > Hi Manas, > > It seems a bug of the create view operation. I have created a JIRA for it: > https://issues.apache.org/jira/browse/FLINK-18750 > > Before repairing, please do