Hi Shreekant, Since you're mentioning Iceberg, I'm assuming this means you've added the Iceberg runtime to Flink. I'm therefore wondering if this is a Flink issue or an Iceberg issue. I would lean towards the latter. Have you asked them?
Best regards, Martijn Visser https://twitter.com/MartijnVisser82 https://github.com/MartijnVisser On Fri, 22 Apr 2022 at 04:32, huweihua <huweihua....@gmail.com> wrote: > Hi, Which connector are you using? Is the increase in the number of > threads gradual or is it related to task failover? > > It would be helpful if you could provide a thread dump. > > > 2022年4月22日 上午2:12，SHREEKANT ANKALA <ask...@hotmail.com> 写道： > > Hi, Can somebody please help with this issue? This is really blocking us > in Production. If needed, I can provide the thread dump as well. > > Thanks, > Shreekant A. > > Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for > Windows > > ------------------------------ > *From:* SHREEKANT ANKALA <ask...@hotmail.com> > *Sent:* Sunday, April 17, 2022 12:37:50 AM > *To:* user@flink.apache.org <user@flink.apache.org> > *Subject:* Huge number of GAX-Threads in Flink > > Hi, we are using Flink 1.13.2 for one of our datalake project to process > json files from Google Cloud storage and write to Iceberg tables in S3. > After running the application in production for a couple of days, we are > noticing that the GAX-Threads in "Flink Task Threadgoup" are growing with > out any limit. In a couple of days, there are 1450 gax threads. > Is it possible to limit this thread group? > > thanks, > Shreekant A. > > >
