Re: Moving from flinkkafkaconsumer to kafkasource issues

Hi Naga Could you provide detailed error information? I think it may be useful for positioning the issue Best, Shammon FY On Fri, Apr 21, 2023 at 12:56 AM naga sudhakar wrote: > Hi Team, > Greetings of the day.. > we are on flink 1.16.1 version and using flinkkafkaconsumer today. > When I rep

Re: Debug CEP Patterns

Thanks Biao, your insights were very helpful for me! I finally could debug properly, a couple of things were not correct there, in fact. Also, I think I'm not modeling properly the behaviour of the pattern so I definitely going to investigate better this. Regards *Ana Gómez González*

Moving from flinkkafkaconsumer to kafkasource issues

Hi Team, Greetings of the day.. we are on flink 1.16.1 version and using flinkkafkaconsumer today. When I replaced it with kafkasource,it's failing with not able to connect with kafka jaas configuration. Error says Kafka client entry not found in /tmp/jass config file. We are passing the flonk runt

Re: Facing issue when using S3 in Flink 1.17

Thanks a lot, Gabor. Do you know by any chance when this fix will be released? Thanks in advance. On Thu, Apr 20, 2023 at 9:06 PM Gabor Somogyi wrote: > Hi Sriram, > > This has been fixed in https://issues.apache.org/jira/browse/FLINK-31839 > > G > > > On Thu, Apr 20, 2023 at 4:57 PM Sriram Gane

Re: Facing issue when using S3 in Flink 1.17

Hi Sriram, This has been fixed in https://issues.apache.org/jira/browse/FLINK-31839 G On Thu, Apr 20, 2023 at 4:57 PM Sriram Ganesh wrote: > Hi Team, > > I am using S3 as FileSystem to write data from Flink. I am getting the > below error in Flink 1.17. The same code works in Flink 1.16. Coul

Facing issue when using S3 in Flink 1.17

Hi Team, I am using S3 as FileSystem to write data from Flink. I am getting the below error in Flink 1.17. The same code works in Flink 1.16. Could someone please help? Caused by: java.lang.IllegalStateException: Delegation token provider with service name {} has multiple implementations [s3]

RE: SplitEnumerator and SourceReader

Thanks a lot Martijn for quick response. For point 3, I might got confused on below link: https://cwiki.apache.org/confluence/display/FLINK/FLIP-27%3A+Refactor+Source+Interface#FLIP27:RefactorSourceInterface-where_run_enumerator Anyways, thanks for clarifying all things. Just a further question

Re: SplitEnumerator and SourceReader

Hi Kirti Dhar, 1. The SourceReader downloads the file, which is assigned to him by the SplitEnumerator 2. This depends on the format; a BulkFormat like Parquet or ORC can be read in batches of records at a time. 3. The SplitEnumerator runs on the JobManager, not on a TaskManager. Have you read som

SplitEnumerator and SourceReader

Hi Community, I have started using file source of Flink 1.17.x recently. I was going through the FLIP-27 documentation and as much I understand SplitEnumerator lists files (splits) and assigns to SourceReader. A single instance of SplitEnumerator runs whereas parallelism can be done on SourceR