RE: OutOfMemoryError: Java heap space while implmentating flink sql api

2022-01-13 Thread Ronak Beejawat (rbeejawa)
for computing the query result might grow infinitely depending on the number of distinct input rows of all input tables and intermediate join results." Best regards, Martijn [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sql/queries/joins/ On Wed, 12 Jan 2022 at 11:

RE: Could not find any factory for identifier 'jdbc'

2022-01-13 Thread Ronak Beejawat (rbeejawa)
org> mailto:commun...@flink.apache.org>> Cc: dev mailto:dev@flink.apache.org>>, Ronak Beejawat (rbeejawa) mailto:rbeej...@cisco.com.invalid>>, u...@flink.apache.org<mailto:u...@flink.apache.org> mailto:u...@flink.apache.org>>, Hang Ruan mailto:ruanhang1...@gma

OutOfMemoryError: Java heap space while implmentating flink sql api

2022-01-12 Thread Ronak Beejawat (rbeejawa)
Hi Team, I was trying to implement flink sql api join with 2 tables it is throwing error OutOfMemoryError: Java heap space . PFB screenshot for flink cluster memory details. [Flink Memory Model][1] [1]: https://i.stack.imgur.com/AOnQI.png **PFB below code snippet which I was trying:** ``` E

what is efficient way to write Left join in flink

2022-01-12 Thread Ronak Beejawat (rbeejawa)
testtopic3 group by tumble window of 1 min duration) So the question is which API will be more efficient and faster for such use case (datastream API or sql API) for intensive joining logic? Thanks Ronak Beejawat From: Ronak Beejawat (rbeejawa) Sent: Tuesday, January 11, 2022 6:12 PM To: 

RE: Could not find any factory for identifier 'jdbc'

2022-01-12 Thread Ronak Beejawat (rbeejawa)
esnay Schepler mailto:ches...@apache.org>> Date: Tuesday, 11 January 2022 at 7:45 PM To: Ronak Beejawat (rbeejawa) mailto:rbeej...@cisco.com.INVALID>>, u...@flink.apache.org<mailto:u...@flink.apache.org> mailto:u...@flink.apache.org>> Cc: Hang Ruan mailto:ruanhang1...@gm

Could not find any factory for identifier 'jdbc'

2022-01-11 Thread Ronak Beejawat (rbeejawa)
Correcting subject -> Could not find any factory for identifier 'jdbc' From: Ronak Beejawat (rbeejawa) Sent: Tuesday, January 11, 2022 6:43 PM To: 'dev@flink.apache.org' ; 'commun...@flink.apache.org' ; 'u...@flink.apache.org' Cc: 'Hang Rua

what is efficient way to write Left join in flink

2022-01-11 Thread Ronak Beejawat (rbeejawa)
Hi Team, Getting below exception while using jdbc connector : Caused by: org.apache.flink.table.api.ValidationException: Could not find any factory for identifier 'jdbc' that implements 'org.apache.flink.table.factories.DynamicTableFactory' in the classpath. Available factory identifiers are:

RE: what is efficient way to write Left join in flink

2022-01-11 Thread Ronak Beejawat (rbeejawa)
Can please someone help / reply on below Question ? From: Ronak Beejawat (rbeejawa) Sent: Monday, January 10, 2022 7:40 PM To: dev@flink.apache.org; commun...@flink.apache.org; u...@flink.apache.org Cc: Hang Ruan ; Shrinath Shenoy K (sshenoyk) Subject: what is efficient way to write Left join

what is efficient way to write Left join in flink

2022-01-11 Thread Ronak Beejawat (rbeejawa)
Hi Team, We want a clarification on one real time processing scenario for below mentioned use case. Use case : 1. We have topic one (testtopic1) which will get half a million data every minute. 2. We have topic two (testtopic2) which will get one million data every minute. So we are doing join

RE: Regarding Connector Options - value.deserializer

2022-01-10 Thread Ronak Beejawat (rbeejawa)
you please share any link for sample example for the same ? Thanks Ronak Beejawat From: Hang Ruan Sent: Monday, January 10, 2022 3:06 PM To: dev@flink.apache.org; Ronak Beejawat (rbeejawa) Cc: commun...@flink.apache.org; u...@flink.apache.org Subject: Re: Regarding Connector Options - value.de

Regarding Connector Options - value.deserializer

2022-01-10 Thread Ronak Beejawat (rbeejawa)
Hi Team, Is there any way we use value.deserializer in Connector Options from kafka via sql api? PFB below code snippt : tableEnv.executeSql("CREATE TABLE cmrTable (\r\n" + " org_id STRING\r\n" + " ,cluster_id STRING\r\n" + " ,globalcallid_callmanage