RE: Flink Kubernetes Operator Application mode multiple jobs

2024-05-07 Thread Guozhen Yang
Hi Raihan, We have encountered the same issue though we are using Flink Kubernetes Operator 1.6. Biao Geng's explanation is correct. We also have a detailed briefing in this jira ticket but it seems that submitting multiple jobs is not allowed b

RE: RocksDB: Memory is slowly increasing over time

2023-10-18 Thread Guozhen Yang
Hi, Patrick: We have encountered the same issue, that TaskManager's memory consumption increases almost monotonously. I'll try to describe what we have observed and our solution. You can check if it would solve the problem. We have observed that 1. Jobs with RocksDB state backend would fail afte

RE: Suggestions for Open Source FLINK SQL editor

2023-07-19 Thread Guozhen Yang
Hi Rajat, We are using apache zeppelin as our entry point for submitting flink ad-hoc queries (and spark jobs actually). It supports interactive queries, data visualization, multiple data query engines, multiple auth models. You can check out other features on its official website. But because o