Re: Is Scala the best language for Flink?

2022-01-29 Thread Adriel Peng
I think the richful functional programming features in scala are better. regards. On Sat, Jan 29, 2022 at 4:24 PM HG wrote: > Because? > I am using IntelliJ. > What are the drawbacks of Java then? > > On Fri, Jan 28, 2022, 19:05 sri hari kali charan Tummala < > kali.tumm...@gmail.com> wrote:

flink mysql cdc注册confluent schema registry

2022-01-29 Thread casel.chen
我想利用flink mysql cdc输出变更数据到kafka,同时将table schema注册到confluent schema registry,以模拟debezium kafka connect效果[1]。还请指教要如何下手呢?谢谢! [1] https://blog.csdn.net/OldDirverHelpMe/article/details/107881170

RE: Determinism of interval joins

2022-01-29 Thread Alexis Sarda-Espinosa
I think I spoke to soon when I said my watermark strategies were like the included ones. My generators mark themselves as idle when they start, and stay like that as long as they don't seen any event at all. In the tests, I presume a variable number of events (and watermarks) from stream1 were

Re: 如何确定分配内存的大小

2022-01-29 Thread cc vmaster
如果初次分配的内存过小,在运行过程中可以动态去扩吗?即指定任务的内存上下限,比如初始分配了4G,但运行一段时间不足了,Flink是否可以帮我们自动多加一些内存,但最大不超过上限值。(目前个人了解到的需要扩内存得需要执行SavePoint,调整后再从SavePoint启动,但这样操作很容易导致任务计算出现错误了,或者很麻烦,如果Flink能在一次Checkpoint对齐后自动帮我们做这件事,无疑可以提供很大便利) > 2022年1月11日 17:19,Chang Li 写道: > > 目前这个更多还是一个经验值,和具体业务有关使用有关,建议任务运行后观察JM和TM的GC情况后再做调整

Re: Is Scala the best language for Flink?

2022-01-29 Thread HG
Because? I am using IntelliJ. What are the drawbacks of Java then? On Fri, Jan 28, 2022, 19:05 sri hari kali charan Tummala < kali.tumm...@gmail.com> wrote: > Yes Scala is the best. > > On Fri, Jan 28, 2022, 9:57 AM Nicolás Ferrario > wrote: > >> Hi Seb. >> >> In my team we are migrating things