Flink UDF Scalar Function called only once for all rows of select SQL in case of no parameter passed

2021-07-13 Thread shamit jain
f employee. Request you to please let me know if I am doing something wrong. regards, Shamit Jain

Re: Flink UDF Scalar Function called only once for all rows of select SQL in case of no parameter passed

2021-07-14 Thread shamit jain
Thanks!! On 2021/07/14 02:26:47, JING ZHANG wrote: > Hi, Shamit Jain, > In fact, it is an optimization to simplify expression. > If a Udf has no parameters, optimizer would be look it as an expression > which always generate constants results. > So it would be calculated once

Flink streaming file sink to s 3 cannot recover from failure

2021-10-08 Thread shamit jain
a:127) at org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.restore(Bucket.java:466) at org.apache.flink.streaming.api.functions.sink.filesystem.Def regards, Shamit Jain

Error while deploying from snapshot after adding new column in existing table

2021-12-28 Thread shamit jain
ousTypes, newRowSerializer.types)) { return TypeSerializerSchemaCompatibility.incompatible(); } Can you please help me to understand if we can add a new column in an existing table and deploy from the snapshot? Regards, Shamit Jain

Re: Error while deploying from snapshot after adding new column in existing table

2021-12-29 Thread shamit jain
cs-release-1.13/docs/dev/datastream/fault-tolerance/schema_evolution/#evolving-state-schema Regards, Shamit Jain On Wed, Dec 29, 2021 at 5:09 AM Martijn Visser wrote: > Hi Shamit, > > Adding columns means that you're trying to perform schema evolution, which > isn'

Re: Error while deploying from snapshot after adding new column in existing table

2022-01-01 Thread shamit jain
Thanks Martijn! I will check Datastream APIs, if it fits in our use case. Regards, Shamit Jain On Thu, Dec 30, 2021 at 3:44 AM Martijn Visser wrote: > Hi Shamit, > > Yes, there are more possibilities when using the DataStream API like with > the link you've included. You c