Why I can't run more than 19 tasks?

2023-05-24 Thread Hemi Grs
hey everybody, I have a problem with my apache flink, I am synchronizing from MySQL to Elasticsearch but it seems that I can't run more than 19 tasks. it gave me this error: -- Caused by: org.apache.flink.util.FlinkRuntimeException: org.apache.flink.util.FlinkRuntimeException: java.sql.SQLTra

Flink SQL: MySQL to Elaticsearch soft delete

2023-10-19 Thread Hemi Grs
hello everyone, right now I'm using flink to sync from mysql to elasticsearch and so far so good. If we insert, update, or delete it will sync from mysql to elastic without any problem. The problem I have right now is the application is not actually doing hard delete to the records in mysql, but

Strange Problem (0 AvailableTask)

2024-04-18 Thread Hemi Grs
Hello, I have several versions of Flink (1.17.0, 1.18.0, 1.18.1 and 1.19.0) on my server. I am still trying it out (on & off), and I was running a job for sync a table from mysql to elasticsearch and it was running find without any problems ( I was using 1.18.1 version). But after a few weeks, I f

Re: Strange Problem (0 AvailableTask)

2024-04-26 Thread Hemi Grs
you using standalone cluster or > using k8s/yarn as resource providers? > Also, it would be very helpful if you can share the full jobmanager log. > > Best, > Biao Geng > > Hemi Grs 于2024年4月18日周四 15:43写道: > >> Hello, >> >> I have several versions of Fli

Re: Strange Problem (0 AvailableTask)

2024-04-28 Thread Hemi Grs
ion that you can have a try on flink k8s operator: > https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/zh/docs/try-flink-kubernetes-operator/quick-start/ > > > Best, > Biao Geng > > > Hemi Grs 于2024年4月26日周五 19:03写道: > >> Hi Biao, >> >>