Re: Flink SQL Async UDF

2023-05-07 Thread Biao Geng
Hi Giannis, Would you mind executing SET 'sql-client.verbose' = 'true';. first in your SQL client and then run the above example to show the error output in the SQL client? For the complete example, you can refer to codes of HBaseRowDataAsyncLookupFunction. Besides, in your example, you actually im

Re: Flink Sql erroring at runtime

2023-05-07 Thread Hang Ruan
Hi, neha, I think the error occurred because of the deserialization. Is there some example data and runnable SQLs to reproduce the problem? Best, Hang neha goyal 于2023年5月2日周二 16:33写道: > Hello, > > I am using Flink 1.16.1 and observing a different behavior from Flink > 1.13.6. > > SELECT if(som

Re: Query on flink-parquet

2023-05-07 Thread Hang Ruan
Hi, Anuj, Classes annotated with @Internal or @Experimental can be changed across any two releases. Classes annotated with @PublicEvolving only can be changed across minor releases (1.17.0 and 1.18.0). So the classes you mentioned may be changed. If the API changed in a new release, you have to mo

Encryption of parameters in flink-conf.yaml

2023-05-07 Thread Anuj Jain
Hi Community, I am trying to create an amazon S3 filesystem distributor using flink and for this I am using hadoop S3a connector with Flink filesystem sink. My flink application would run in a non-AWS environment, on native cluster; so I need to put my access keys in flink configuration. For conne

Query on flink-parquet

2023-05-07 Thread Anuj Jain
> > > Hi Community, > > > I am trying to use flink-parquet for reading and writing parquet files > from the Flink filesystem connectors. > > In File source, I would be decoding parquet files and converting them to > avro records and similarly in file sink i would be encoding avro records to > parqu

[no subject]

2023-05-07 Thread Anuj Jain
Hi Community, I am trying to use flink-parquet for reading and writing parquet files from the Flink filesystem connectors. In File source, I would be decoding parquet files and converting them to avro records and similarly in file sink i would be encoding avro records to parquet files. For col

Re: Flink SQL Async UDF

2023-05-07 Thread Giannis Polyzos
Yes I have and the function is present in the catalog. And I have other udfs also registered, I’m just having issues with the Async one and can’t really find any examples. Best On Mon, 8 May 2023 at 3:46 AM, Shammon FY wrote: > Hi Giannis, > > Have you use "CREATE FUNCTION asyncfn AS 'Your full

Re: Flink SQL Async UDF

2023-05-07 Thread Shammon FY
Hi Giannis, Have you use "CREATE FUNCTION asyncfn AS 'Your full class name of async function class'" or "CREATE TEMPORARY FUNCTION asyncfn AS 'Your full class name of async function class'" to create a customized function named "asyncfn" before it is used in your sql? The error message "No match

Re: Can flink1.15.2 use flink sql to create a broadcast table? I didn't find anything related in https://flink.apache.org/

2023-05-07 Thread Shammon FY
Hi yxy, As Hang mentioned, I think lookup join matches your requirements too. You can refer to doc [1] to get more detailed information. [1] https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/dev/table/sql/queries/joins/#lookup-join Best, Shammon FY On Sat, May 6, 2023 at 5:54 PM