Re: Convert DataStream to Table with the same columns in Row

2021-05-16 Thread John Smith
Thanks for your help Timo and Fabian, Got it working with Timo’s suggestion. On Fri, May 14, 2021 at 6:14 AM Fabian Paul wrote: > Hi John, > > Can you maybe share more code about how you build the DataStrean? > It would also be good to know against which Flink version you are testing. > I just

Re: FlinKCEP

2021-05-16 Thread tonychen
在FLINK-SQL下用eventtime和proctime都可以进行CEP计算 -- Sent from: http://apache-flink.147419.n8.nabble.com/

Re: The heartbeat of JobManager timed out

2021-05-16 Thread Xintong Song
Hi Alexey & Smile, JM & RM are located in the same process, thus it's unlikely a network issue. Such timeouts are usually caused by one of the two endpoints not responding timely. Some common causes: - The process is under severe GC pressure. You can check the GC logs for the pressure. -

Re: pyflink双流join

2021-05-16 Thread qianhuan
非常感谢 -- Sent from: http://apache-flink.147419.n8.nabble.com/

Re: pyflink双流join

2021-05-16 Thread Dian Fu
用Table API的话,可以看一下这个: https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/dev/table/tableapi/#joins 另外,也可以直接在PyFlink中调用SQL语句:

Re: The heartbeat of JobManager timed out

2021-05-16 Thread Smile
JM log shows this: INFO org.apache.flink.yarn.YarnResourceManager - The heartbeat of JobManager with id 41e3ef1f248d24ddefdccd1887947106 timed out. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: The heartbeat of JobManager timed out

2021-05-16 Thread Smile
Hi Alexey, We also have the same problem running on Yarn using Flink 1.9.0. JM log shows this: We are also looking for a way to troubleshoot this problem. Best regards. Smile Alexey Trenikhun wrote > Hello, > > I periodically see in JM log (Flink 12.2): > >

pyflink双流join

2021-05-16 Thread qianhuan
想实现pyflink双流join,没有找到相关示例,有没有大神指导下用pyflink是否能实现? -- Sent from: http://apache-flink.147419.n8.nabble.com/

Re: 关于union之后的keyBy问题

2021-05-16 Thread HunterXHunter
这部分没人报bug,所以社区一般是不会去验证的。所以你要给出你的代码,同时对问题描述尽量清晰,否则很难有人去自己写代码验证问题。 -- Sent from: http://apache-flink.147419.n8.nabble.com/

Re: reactive mode and back pressure

2021-05-16 Thread Xintong Song
Hi Alexey, I don't think the new reactive mode makes any changes to the checkpoint/savepoint mechanism, at least not at the moment. However, you might want to take a look at the unaligned checkpoint [1]. The unaligned checkpoint is designed to be tolerant with back pressure. AFAIK, this can work

????union??????keyBy????

2021-05-16 Thread ????????????
Hi,All ??:??flink??union/joinkeybytimewindow??keybykey?? ~

ExtractionUtils#getClassReader 触发open too many files 异常

2021-05-16 Thread zhiping.lin
你好,对于org.apache.flink.table.types.extraction.ExtractionUtils的getClassReader方法我有个疑问,为何在打开inputStream后没有进行及时关闭? 源码如下: private static ClassReader getClassReader(Class cls) { final String className = cls.getName().replaceFirst("^.*\\.", "") + ".class"; try { return new

Exception: Could not perform checkpoint

2021-05-16 Thread gen
Hi, all: 我的一个任务 稳定运行了一段时间后, 出现异常 导致不断重启。 版本 Flink 1.10, 请问下 从这个异常上看是业务的问题么,还是flink问题? flink ui上日志为: 2021-05-14 16:12:30 java.lang.Exception: Could not perform checkpoint 6713 for operator Source: kafka topic[mt_elk_log] source -> Flat Map -> Sink: customerAccessLogIndex sink (2/4). at

Re: Handling "Global" Updating State

2021-05-16 Thread Rion Williams
Hey folks, After digging into this a bit it does seem like Broadcast State would fit the bill for this scenario and keeping the downstream operators up-to-date as messages arrived in my Kafka topic. My question is - is there a pattern for pre-populating the state initially? In my case, I need