Hybrid deployment style for Stateful Functions

2022-09-23 Thread Shekhar Sharma
Hi Flink Community, Me and my colleagues are working on a project using stateful functions where we want to have different deployment styles for different functions. For eg. We would like to have some functions running remotely and some functions running as embedded. Is this possible? If yes,

Re: Why is task manager shutting down?

2022-09-23 Thread John Smith
Sorry new file: https://www.dropbox.com/s/mm9521crwvevzgl/flink-flink-taskexecutor-274-flink-prod-v-task-0001.log?dl=0 On Fri, Sep 23, 2022 at 11:26 AM John Smith wrote: > Hi I have attached the logs here... > > >

Why is task manager shutting down?

2022-09-23 Thread John Smith
Hi I have attached the logs here... https://www.dropbox.com/s/12gwlps52lvxdhz/flink-flink-taskexecutor-274-flink-prod-v-task-0001.log?dl=0 1- It looks like a timeout issue. Can someone confirm? 2- The task manager is restarted, since I have restart on failure in SystemD. But it seems after a few

Re: StreamTableEnvironment.fromDataStream(dataStream)如何生成T类型的Schema?

2022-09-23 Thread Shammon FY
Hi 你的Event类定义没有贴完整,不过有个怀疑点,你应该有一个public Event(int, String, long, long)的构造函数,需要在Event定义里增加一个空的构造函数,类似这样 public class Event implements Serializable { private static final long serialVersionUID = 4826873295740075360L; public int t = 0; public String user = ""; public

Query/Issues - Statefun - Flink

2022-09-23 Thread Himanshu Sareen
Team, I'm looking for an flink documentation which addresses/documents the comparison of Remote functions/Embedded/Data Stream. I'm presently exploring Flink Remote State-fun functions and looking for a clarity on the following: 1. send_egress - Is there a way to get a callback

Re: Re: flink实时双流驱动join问题

2022-09-23 Thread Zhiwen Sun
实际业务的确是这样的。 state 永不过期, 要全量的数据计算,全量的数据放到 state 里面。 目前看来只有等 flink table store 了。 Zhiwen Sun On Fri, Sep 23, 2022 at 8:29 AM casel.chen wrote: > > 我这里只是举了一个例子表示Flink用于OLAP实时关联场景会遇到的一个问题,实际业务中确实会出现两张关联表都需要更新情况,不管哪一边更新数据业务都想获取到最新关联结果,而不是旧的关联状态。引出我想问的另一个问题是如果查询模式固定,Flink实时关联是否能取代OLAP系统例如Doris呢?