Re: Weird Flink SQL error

Hi Dan, Which Flink version do you apply? I write a test case base on the code snippet you provided and it works normally in Flink 1.17-SNAPSHOT. Best, Shuiqiang Dan Hill 于2022年11月23日周三 13:55写道： > Hi. I'm hitting an obfuscated Flink SQL parser error. Is there a way to > get better errors for

Re: Weird Flink SQL error

Hi, Dan. I'm wondering what type of error you expect. IMO, I think most engines throw parse error in such way which tell you encounter an unexpected token. Best regards, Yuxia 发件人: "Dan Hill" 收件人: "User" 发送时间: 星期三, 2022年 11 月 23日 下午 1:55:20 主题: Weird Flink SQL error Hi. I'm hitting a

Unable to write checkpoint metadata to s3 using pyflink (1.16.0)

Hi team, Hope Everyone is doing good, We have an issue regarding writing checkpoints metadata to S3 using pyflink datastream api. we are using Apache-Flink==1.16.0. We are able to sink our Stream into s3 but when it comes to writing checkpoint data. we are getting the following error. We tried a p

Re: Unable to write checkpoint metadata to s3 using pyflink (1.16.0)

Hi, Like the error mentions "The scheme is directly supported by Flink through the following plugin(s): flink-s3-fs-presto. Please ensure that each plugin resides within its own subfolder within the plugins directory." You can't add the plugins via code; you need to follow the instructions in the

Re: Weird Flink SQL error

I'm using Flink 1.14.4 On Wed, Nov 23, 2022, 02:28 yuxia wrote: > Hi, Dan. > I'm wondering what type of error you expect. IMO, I think most engines > throw parse error in such way which tell you encounter an unexpected token. > > Best regards, > Yuxia > > -- > *发件人: *

Query about flink job manager dashboard

> Hi Team, > Greetings!!! > I am a software developer using apache flink and deploying flink jobs > using the same. I have two queries about flink job manager dashboard. Can > you please help with below? > > 1) is it possible to add login mechanism for the flink job manager dash > board and have a

Re: Weird Flink SQL error

For the error `Encountered "." at line 1, column 119.`, here are the confusing parts: 1. The error happens when I executed the last part of the sql query: INSERT INTO `test_content_metrics` SELECT * FROM `test_content_metrics_view` 2. Line 1 column 119 doesn't exist in that SQL statement. 3. Non

Physical memory and Auto Memory settings in TM

Hi All, Installation of flink clusters where we govern the memory configs by specifying 'taskmanager.memory.process.size' TM memory is auto calculated. But in this calculation we generally don't check the actual physical memory available. So in case of a wrong configuration where the JVM heap siz

Re: Weird Flink SQL error

I upgraded to Flink v1.16.0 and I get the same error. On Wed, Nov 23, 2022 at 9:47 AM Dan Hill wrote: > For the error `Encountered "." at line 1, column 119.`, here are the > confusing parts: > > 1. The error happens when I executed the last part of the sql query: > > INSERT INTO `test_content_m

Re: Weird Flink SQL error

Looks related to this issue. https://lists.apache.org/thread/1sb5bos6tjv39fh0wjkvmvht0824r4my In my case, it doesn't seem like it's a sink issue. Even if I change my minicluster test to SELECT * it, it fails the same way. CREATE TEMPORARY VIEW `test_content_metrics_view` AS SELECT DATE_FORMA

Re: Weird Flink SQL error

If I remove the "TEMPORARY VIEW" and just inline the SQL, this works fine. This seems like a bug with temporary views. On Wed, Nov 23, 2022 at 1:38 PM Dan Hill wrote: > Looks related to this issue. > https://lists.apache.org/thread/1sb5bos6tjv39fh0wjkvmvht0824r4my > > In my case, it doesn't seem

Flink 1.16.0: java.lang.NoSuchMethodException: org.apache.flink.metrics.prometheus.PrometheusReporter.()

When upgrading an application from Flink 1.14.6 to Flink 1.16.0, I get the following exception: ERROR org.apache.flink.runtime.metrics.ReporterSetup - Could not instantiate metrics reporter prom. Metrics might not be exposed/reported. java.lang.InstantiationException: org.apache.flink.metrics.pro

Apache vs Spotify Flink Operator?

At my job, we are using the Spotify Flink Operator in production. Are there any pros/cons of this Spotify Flink Operator versus the Apache Flink Operator? We are particularly interested in the forthcoming autoscaling functionality, but I understand that functionality isn't ready yet. Are there any

Re: Apache vs Spotify Flink Operator?

Hi Clayton, We recently discussed these topics with Robert and Gyula in this podcast. Cheers, Matyas On Wed, Nov 23, 2022 at 2:45 PM Clayton Wohl wrote: > At my job, we are using the Spotify Flink Operator in production. Are > there any pros/cons o

Query about flink job manager dashboard

> > Hi Team, > Greetings!!! > I am a software developer using apache flink and deploying flink jobs > using the same. I have two queries about flink job manager dashboard. Can > you please help with below? > > 1) is it possible to add login mechanism for the flink job manager dash > board and have

Re: Flink 1.16.0: java.lang.NoSuchMethodException: org.apache.flink.metrics.prometheus.PrometheusReporter.()

I had to change this configuration: metrics.reporter.prom.class: "org.apache.flink.metrics.prometheus.PrometheusReporter" to this for Flink 1.16: metrics.reporter.prom.factory.class: "org.apache.flink.metrics.prometheus.PrometheusReporterFactory" Someone emailed me this fix directly. It works!