Re: Dynamin Windowing in with Pyflink

2023-05-17 Thread Dian Fu
Hi Nawaz, >> My concern is, as Flink does not support dynamic windows, is this approach going against Flink Architecture. Per my understanding, the session window could be seen as a kind of dynamic window. Besides, Flink also supports user-defined window with which users should also be able to

Re: 使用flink sql创建版本视图无法正常使用

2023-05-17 Thread Shammon FY
Hi, 你邮件里的图片无法显示,也没办法看到具体的错误信息 Best, Shammon FY On Thu, May 18, 2023 at 10:15 AM arkey w wrote: > flink版本:1.14.5 > 在项目使用版本表时,准备使用版本视图,但创建后无法正常使用。后根据官网提供的示例( Versioned Tables | Apache Flink >

使用flink sql创建版本视图无法正常使用

2023-05-17 Thread arkey w
flink版本:1.14.5 在项目使用版本表时,准备使用版本视图,但创建后无法正常使用。后根据官网提供的示例( Versioned Tables | Apache Flink )进行验证也同样无法使用,创建sql如下: 创建事实表: [image: image.png] 创建版本视图: [image: image.png] [image: image.png] Temporal

Re: [ANNOUNCE] Apache Flink Kubernetes Operator 1.5.0 released

2023-05-17 Thread Márton Balassi
Thanks, awesome! :-) On Wed, May 17, 2023 at 2:24 PM Gyula Fóra wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink Kubernetes Operator 1.5.0. > > The Flink Kubernetes Operator allows users to manage their Apache Flink > applications and their lifecycle

Re: [ANNOUNCE] Apache Flink Kubernetes Operator 1.5.0 released

2023-05-17 Thread Márton Balassi
Thanks, awesome! :-) On Wed, May 17, 2023 at 2:24 PM Gyula Fóra wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink Kubernetes Operator 1.5.0. > > The Flink Kubernetes Operator allows users to manage their Apache Flink > applications and their lifecycle

Re: MSI Auth to Azure Storage Account with Flink Apache Operator not working

2023-05-17 Thread Surendra Singh Lilhore
Hi Derocco, Good to hear that it is working. Let me create a Jira ticket and update the document. -Surendra On Wed, May 17, 2023 at 9:29 PM DEROCCO, CHRISTOPHER wrote: > Surendra, > > > > Your recommended config change fixed my issue. Azure Managed Service > Identity works for me now and I

RE: MSI Auth to Azure Storage Account with Flink Apache Operator not working

2023-05-17 Thread DEROCCO, CHRISTOPHER
Surendra, Your recommended config change fixed my issue. Azure Managed Service Identity works for me now and I can write checkpoints to ADLSGen2 storage. My client id is the managed identity that is attached to the azure Kubernetes nodepools. For anyone else facing this issue, my

RE: MSI Auth to Azure Storage Account with Flink Apache Operator not working

2023-05-17 Thread DEROCCO, CHRISTOPHER
Ivan, How did you use Azure Key Vault with CSI because the flink operator uses a configmap and not a Kubernetes secret to create the flink-conf file? I have also tried using pod-identities as well as the new workload identity

[ANNOUNCE] Apache Flink Kubernetes Operator 1.5.0 released

2023-05-17 Thread Gyula Fóra
The Apache Flink community is very happy to announce the release of Apache Flink Kubernetes Operator 1.5.0. The Flink Kubernetes Operator allows users to manage their Apache Flink applications and their lifecycle through native k8s tooling like kubectl. Release highlights: - Autoscaler

[ANNOUNCE] Apache Flink Kubernetes Operator 1.5.0 released

2023-05-17 Thread Gyula Fóra
The Apache Flink community is very happy to announce the release of Apache Flink Kubernetes Operator 1.5.0. The Flink Kubernetes Operator allows users to manage their Apache Flink applications and their lifecycle through native k8s tooling like kubectl. Release highlights: - Autoscaler

RocksDB segfault on state restore

2023-05-17 Thread Gyula Fóra
Hi All! We are encountering an error on a larger stateful job (around 1 TB + state) on restore from a rocksdb checkpoint. The taskmanagers keep crashing with a segfault coming from the rocksdb native logic and seem to be related to the FlinkCompactionFilter mechanism. The gist with the full

flink sql case when 中文数据写入doris出现乱码

2023-05-17 Thread casel.chen
使用flink sql写mysql表数据到doris表,发现case when语句判断交易类型使用了中文,写入后在doris查出是乱码,而mysql其他中文字段写入是正确的,想问一下这个sql中出现的乱码问题要解决?

Flink Sql erroring at runtime Flink 1.16

2023-05-17 Thread neha goyal
Hello, Looks like there is a bug with Flink 1.16's IF operator. If I use UPPER or TRIM functions(there might be more such functions), I am getting the exception. These functions used to work fine with Flink 1.13. select if( address_id = 'a', 'default', upper(address_id) ) as

flink integrate redis

2023-05-17 Thread 湘晗刚
Flinkwritedatatoredis,howtoassuredataaccuracy,forexampleiwangtosaveseveralmonthsdataeveryuser,,ifusestate,firstsavetothestate,thenjustsettoredis,butifuserdataistoolarge,iwillneedmuchmemory,istherebetterway? Thanksinadvance Kobe24