Flink Stateful Functions 3.4

Hi there, Anyone knows which Flink version that Flink Stateful Functions 3.4 is compatible with? https://nightlies.apache.org/flink/flink-statefun-docs-master/docs/deployment/state-bootstrap/ I know Stateful Functions 3.3 is compatible with Flink 1.16.2, and Stateful Functions 3.2 is good with Fli

RE: aws zeppelin glue table connector

Hi- Don't see a response for this so taking one last stab. Any reply would be greatly appreciated. Thanks, -Dave David L Katz (he/him/his) why?<https://sites.jpmchase.com/sites/companyhome/about%20us/diversity/pages/language,-inclusion-%26-gender-pronous.aspx> | Executive Direc

aws zeppelin glue table connector

outlined above expected to be supported with that JIRA? 2. Do we know when the connector will be released? 3. Do we have a general sense of when AWS would make that version of flink will be available as a flink runtime? Thanks in advance! -Dave David L Katz (he/him/his) why?<ht

RE: [EXTERNAL]Re: aws glue connector

backed by an s3 bucket in one account and a streaming glue table backed by a kinesis data stream in another account and want to join the two as part of a streaming application by just going to the central lake database as a consumer. Thanks again! -Dave David L Katz (he/him/his) why?<ht

aws glue connector

, -Dave David L Katz (he/him/his) why?<https://sites.jpmchase.com/sites/companyhome/about%20us/diversity/pages/language,-inclusion-%26-gender-pronous.aspx> | Executive Director | Macro Technology | 545 Washington Blvd, Floor 4 | Jersey City, NJ 07310 This message is confidential and subj

RE: [EXTERNAL]multiple s3 sinks

Hi- Never mind. Error must have been from shutting down the prior version of the app (timestamp was after restart), issue is now resolved. Thanks, -Dave David L Katz (he/him/his) why?<https://sites.jpmchase.com/sites/companyhome/about%20us/diversity/pages/language,-inclusion-%26-gen

multiple s3 sinks

ot;sink_table_det", resultsDet); stmtSet.execute(); I read that switching to a StatementSet is the way to go, but I'm still missing something. Any help would be greatly appreciated! Thanks, -Dave David L Katz (he/him/his) why?<https://sites.jpmchase.com/sites/companyhome/about%20us/div

Re: Flink 1.12.8 release

rds, > > Martijn Visser > https://twitter.com/MartijnVisser82 > > [1] https://flink.apache.org/downloads.html#update-policy-for-old-releases > > > On Wed, 16 Feb 2022 at 08:54, Joey L wrote: > >> Hi, >> >> Is there a planned release date for 1.12.8 or scheduled release cycle for >> minor versions? >> >> Regards, >> J >> >

Flink 1.12.8 release

Hi, Is there a planned release date for 1.12.8 or scheduled release cycle for minor versions? Regards, J

Re: Kubernetes HA: New jobs stuck in Initializing for a long time after a certain number of existing jobs are running

anager pod) but fails. > SlotRequests are triggered but never actually fulfilled. They are put in > the queue for pending SlotRequests. The timeout kicks in after trying to > reach the ResourceManager for some time. That's > the NoResourcesAvailableException you are experiencing. >

Re: NoClassDefFoundError for RMIServerImpl when running Flink with Scala 2.12 and Java 11

me of > the examples with Java 11, without encountering the issue you describe (with > or without HA). Can you give more details on how exactly you built Flink > (ideally the full command), and how you ran the job? > > Best, > Nico > > On Thu, Oct 28, 2021 at 10:42 A

NoClassDefFoundError for RMIServerImpl when running Flink with Scala 2.12 and Java 11

Hi Flink developers, I encountered a weird error like follows. It only happens when I build Flink with Scala 2.12 profile and run with Java 11. No such error for Scala 2.11 + Java 8/11. Just search for relative info, but don't find any useful. Do you have any idea about this? Thanks. java.lan

Re: NoClassDefFoundError if Kafka classes are assemblied in application jar

ion? > > I don't think this is a general Flink issue or else no one would be able to > read from Kafka at all. > > On Fri, Oct 15, 2021 at 4:16 AM L. C. Hsieh wrote: >> >> Hi, Flink developers, >> >> Does anyone encounter the following error? >> &g

NoClassDefFoundError if Kafka classes are assemblied in application jar

Hi, Flink developers, Does anyone encounter the following error? java.lang.NoClassDefFoundError: org/apache/kafka/common/serialization/ByteArrayDeserializer at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.setDeserializer(FlinkKafkaConsumer.java:322) at org.apa

Re: Got NoClassDefFoundError on Flink native K8S cluster

Handling(FlinkUserCodeClassLoader.java:63) So it looks like user code cannot use plugin's classes (e.g. Hadoop classes)? I don't see hadoop-common is shaded at the plugin. On 2021/08/22 18:24:24, L. C. Hsieh wrote: > > As I know, flink-shaded-hadoop is not officially supported si

Re: Got NoClassDefFoundError on Flink native K8S cluster

g/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.8.3-10.0/flink-shaded-hadoop-2-uber-2.8.3-10.0.jar. > May help. > > L. C. Hsieh 于2021年8月22日周日 上午1:40写道： > > > > > BTW, I checked dependency tree, the flink-iceberg demo only has one Hadoop > > common dependency.

Re: Got NoClassDefFoundError on Flink native K8S cluster

imple test to verify Iceberg and Flink. On 2021/08/21 08:50:05, L. C. Hsieh wrote: > > Thanks for replying. > > I'm using Flink 1.12.x. And I think Iceberg 0.12 uses Flink 1.12 actually. > > Once I upgraded the Iceberg from 0.11.0 to 0.12.0 for the Java a

Re: Got NoClassDefFoundError on Flink native K8S cluster

ry.clusterHadoopConf(FlinkCatalogFactory.java:152) On 2021/08/21 08:11:33, Manong Karl wrote: > Iceberg v0.11 or v0.12 not capable with flink v1.13.x. > > L. C. Hsieh 于2021年8月21日周六 下午3:52写道： > > > Hi, I'm testing using Flink to write Iceberg table. I run Flink native

Got NoClassDefFoundError on Flink native K8S cluster

Hi, I'm testing using Flink to write Iceberg table. I run Flink native K8S cluster locally and submit a simple Java program that writes out Iceberg table (https://github.com/spancer/flink-iceberg-demo). But got an exception: java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration at

FlinkSQL Filter Error With Float Column on flink-1.12.0

Hi: Flink SQL filter data throw an exception, code: def main(args: Array[String]): Unit = { val env = StreamExecutionEnvironment.getExecutionEnvironment val source = env.fromElements( (1.0f, 11.0f, 12.0f), (2.0f, 21.0f, 22.0f), (3.0f, 31.0f, 32.0f), (4.0f, 41.0f, 42.

Request for removal from subscription

Unsubscribe

Query - External SSL setup

Hi, I am trying to authenticate Flink using NGINX. In the document it is mentioned to deploy a "side car proxy", here is the link for the section of the document which I have referred to https://ci.apache.org/projects/flink/flink-docs-release-1.7/ops/security-ssl.html#external--rest-connectivit

Flink window operation based on event time is triggered when watermark is less than the end of window ends

Please refer to the stackoverflow . Thanks. -- Thanks. · Lx wlxwol...@gmail.com

Re: Duplicates in self join

; based on its timestamp and the join window interval. > > Best, > Fabian > > [1] > https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/stream/operators/joining.html#interval-join > > Am Mo., 8. Okt. 2018 um 16:44 Uhr schrieb Eric L Goodman < > eric.good...@colo

Re: Duplicates in self join

assumption is correct, you can add a ProcessFunction after the join > to do distinct. > > Best, Hequn > > On Mon, Oct 8, 2018 at 10:37 PM Eric L Goodman > wrote: > >> If I change it to a Tumbling window some of the results will be lost >> since the pattern I'm mat

Re: Duplicates in self join

nk/flink-docs-release-1.6/api/java/org/apache/flink/streaming/api/windowing/evictors/Evictor.html >> >> Best Regards, >> Dominik. >> >> pon., 8 paź 2018 o 08:00 Eric L Goodman >> napisał(a): >> >>> What is the best way to avoid or remove duplica

Duplicates in self join

What is the best way to avoid or remove duplicates when joining a stream with itself? I'm performing a streaming temporal triangle computation and the first part is to find triads of two edges of the form vertexA->vertexB and vertexB->vertexC (and there are temporal constraints where the first edg

multiple input streams

If I have a standalone cluster running flink, what is the best way to ingest multiple streams of the same type of data? For example, if I open a socket text stream, does the socket only get opened on the master node and then the stream is partitioned out to the worker nodes? DataStream text = env

Re: Flink test examples

Well, I got some bundled examples on the Flink page, but is there an elaborated test set with more details (e.g. Google keyword search simulation) around? Thanks++ ___ Dr.-Ing. Plamen L. Simeonov Department 1: Geodäsie und Fernerkundung Sektion 1.5

Re: Flink test examples

Dear all, can somebody of you help us with some information about ready to run examples for a fresh flink installation. We simply wish to know how it works when we feed it with some data (what comes out and how it performs). many thanks! ___ Dr.-Ing. Plamen L

Re: Runtime generated (source) datasets

That’s fine. All this should come in the definition of a „flink-something“. ___ Dr.-Ing. Plamen L. Simeonov Department 1: Geodäsie und Fernerkundung Sektion 1.5: Geoinformatik Tel.: +49 (0)331/288-1587 Fax: +49 (0)331/288-1732 email: simeo...@gfz-potsdam.de http

Re: Runtime generated (source) datasets

good idea. ___ Dr.-Ing. Plamen L. Simeonov Department 1: Geodäsie und Fernerkundung Sektion 1.5: Geoinformatik Tel.: +49 (0)331/288-1587 Fax: +49 (0)331/288-1732 email: simeo...@gfz-potsdam.de http://www.gfz-potsdam.de/ ___ Helm

Re: Runtime generated (source) datasets

Absolutely correct and good idea! Why don’t call it a „digester“, taking the term from chemistry/ medicine: Chemistry A vessel („pipeline“) in which substances are softened or decomposed, usually for further processing. All the best! ___ Dr.-Ing. Plamen L