Re: [ANNOUNCE] Apache Flink 1.18.1 released

2024-01-25 Thread Jing Ge via user
Hi folks, The bug has been fixed and PR at docker-library/official-images has been merged. The official images are available now. Best regards, Jing On Mon, Jan 22, 2024 at 11:39 AM Jing Ge wrote: > Hi folks, > > I am still working on the official images because of the issue > https://issues.a

RE: Elasticsearch Sink 1.17.2 error message

2024-01-25 Thread Jiabao Sun
Hi Tauseef, We cannot directly write POJO types into Elasticsearch. You can try serializing the TopologyDTO into a JSON string like Jackson before writing it. public static void main(String[] args) throws IOException { try (RestHighLevelClient client = new RestHighLevelClient(

RE: 回复:RE: how to get flink accumulated sink record count

2024-01-25 Thread Jiabao Sun
Hi Enric, Could you kindly provide more specific details where you would like to capture the metric? Additionally, if it's convenient for you, could you please share some code examples? Best, Jiabao On 2024/01/25 10:43:30 Enric Ott wrote: > Thanks,Jiabao,but what I mean is capturing the metr

Elasticsearch Sink 1.17.2 error message

2024-01-25 Thread Tauseef Janvekar
Hi Team, We get the below error message when we try to add an elastick sink Caused by: org.apache.flink.streaming.runtime.tasks.ExceptionInChainedOperatorException: Could not forward element to next operator at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingCh

Re: Long execution of SQL query to Kafka + Hive (q77 TPC-DS)

2024-01-25 Thread Ron liu
Hi, Can you help to explain the q77 execution plan? And find which operator takes a long time in flink UI? Best Ron Вова Фролов 于2024年1月24日周三 09:09写道: > Hello, > > I am executing a heterogeneous SQL query (part of the data is in Hive > and part in Kafka. The query utilizes TPC-DS benchmark 10

??????RE: how to get flink accumulated sink record count

2024-01-25 Thread Enric Ott
Thanks,Jiabao,but what I mean is capturing the metric in Flink tasks. --  -- ??: "Jiabao Sun"https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/ops/metrics/ [2] https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/deployment/m