Re: XXX doesn't exist in the parameters of the SQL statement

Hi, John. Could you share the exception stack to us and the schema of the `dummy` table in your database? Best, Shengkai John Tipper 于2022年4月17日周日 21:15写道： > Hi all, > > I'm having some issues with getting a Flink SQL application to work, where > I get an exception and I'm not sure why it's oc

New JM pod tries to connect to failed JM pod

Hello, We are running Flink 1.13.6 in Kubernetes with k8s HA, the setup includes 1 JM and TM. Recently In jobmanager log I started to see: 2022-04-19T00:11:33.102Z Association with remote system [akka.tcp://flink@10.204.0.126:6123] has failed, address is now gated for [50] ms. Reason: [Associa

DecimalType.MAX_PRECISION, why 38?

Hey everyone, I'm curious if anyone knows the reason behind choosing 38 as a MAX_PRECISION for DecimalType in the Table API? I needed to process decimal types larger than that and I ended up monkey-patching DecimalType to use a higher precision. I understand it adds a bit of overhead, but I haven

Re: Adpative scheduler is not recognizing by Flink 1.14.0

Hi Madan, The reason might be that the -D parameters are not recognized since you used the old-fashioned YARN CLI command, where you need to add the -y prefix for command options. Use -yD instead of -D or use "flink run -t yarn-per-job -Dyarn.application.name=jobname" instead of "flink run -m

Adpative scheduler is not recognizing by Flink 1.14.0

Hello Team, I am trying to use adaptive schedule with flink 1.14 to run flink job based on available resources instead of waiting for required parallelism (scaling) but I don't see flink is getting recognize adaptive schedule. Ex: flink run  -m yarn-cluster -ynm jobName -p 128 -D jobmanager.sche

Re: how to initialize few things at task managers

If you are using Kubernetes to deploy Flink, you could think about an initContainer on the TMs or a custom Docker entry point that does this initialization. Best, Austin On Mon, Apr 18, 2022 at 7:49 AM huweihua wrote: > Hi, Init stuff when task manager comes up is not an option. > But if the Ke

Re: How to debug Metaspace exception?

Hi, can anyone help with this? I never looked at a dump file before. On Thu, Apr 14, 2022 at 11:59 AM John Smith wrote: > Hi, so I have a dump file. What do I look for? > > On Thu, Mar 31, 2022 at 3:28 PM John Smith wrote: > >> Ok so if there's a leak, if I manually stop the job and restart it

Re: how to initialize few things at task managers

Hi, Init stuff when task manager comes up is not an option. But if the Keystore file is not changeable and you are using yarn mode, maybe you can use ‘yarn.ship-files’[1] to localize it. [1]https://nightlies.apache.org/flink/flink-docs-master/zh/docs/deployment/config/#yarn-ship-files > 2022年4月1

Unable to create savepoint for iterative job

Hi all, We are trying to modify our Flink job with iteration ( https://nightlies.apache.org/flink/flink-docs-master/docs/dev/dataset/iterations/). The job works fine with expected outputs and the checkpoints are created successfully at regular intervals. However, when we'd like to create a savepoi

Re: Handling non-transient exceptions

Hello, Thank you for your answer. Yes, we are using the DataStream API. I agree that exceptions are developer’s responsibility but errors can still happen and I would like to have a progressive approach in case they happen instead of a blocking one. I will take a look at your suggestion. Would