Re: Stateful functions roadmap

2023-06-01 Thread Frank Lyaruu
There has been a discussion about this on this email list lately, linking the thread: https://lists.apache.org/thread/g7b870vz704q0lc6gm9bmh4wop4zlf9d regards, Frank On Fri, Jun 2, 2023 at 3:25 AM Tarandeep Singh wrote: > Hi, > > I came across Flink stateful functions and the project/idea exci

Failing to process timestamp data from Kafka + Debezium Avro using Flink SQL

2023-03-06 Thread Frank Lyaruu
Hi all, I'm trying to ingest change capture data data from Kafka which contains some timestamps. I'm using Flink SQL, and I'm running into issues, specifically with the created_at field. //In postgres, it is of type 'timestamptz'. My table definition is this: CREATE TABLE contacts ( contact_id STR

Re: Using Parquet format in Flink hosted in k8s operator

2023-02-22 Thread Frank Lyaruu
; least org.apache.hadoop:hadoop-common > and org.apache.hadoop:hadoop-mapreduce-client-core. > > Best regards, > > Martijn > > On Thu, Feb 9, 2023 at 10:07 AM Frank Lyaruu wrote: > >> Hi all, I’m using the Flink k8s operator to run a SQL stream to/from >> various

How to use Postgres UUID types in Flink SQL?

2023-02-13 Thread Frank Lyaruu
HI Flink community, I'm trying to use a JDBC dataset from Postgres. That dataset contains a column of the postgres type UUID. I don't know how to 'type' this column in SQL. If I try: CREATE TABLE my_table (id: STRING) WITH () I get this error: java.lang.ClassCastException: class java.util.UUID ca

Using Parquet format in Flink hosted in k8s operator

2023-02-09 Thread Frank Lyaruu
Hi all, I’m using the Flink k8s operator to run a SQL stream to/from various connectors, and just added a Parquet format. I customized the image a bit per the example (mostly by adding maven downloads of flink-connector* jars). If I do that for flink-parquet-1.16.1 it fails on missing org/apache/ha