How to use OpenTSDB as Source?

2020-04-21 Thread Lucas Kinne
am not sure whether this is an efficient way. And if I did it this "manual" way, how do I avoid pulling the whole database everytime? Any help is much appreciated, even if it is just a small pointer to the right direction. Thanks in advance! Sincerely, Lucas 0x7306CB12E816710C.asc Description: application/pgp-keys signature.asc Description: OpenPGP digital signature

Fwd: Avro and Kafka Schema Registry Client versions out of date

2020-07-09 Thread Lucas Heimberg
there are specific obstacles for that? Thank you very much & kind regards, Lucas -- Dr. Lucas Heimberg

Fwd: Avro and Kafka Schema Registry Client versions out of date

2020-07-09 Thread Lucas Heimberg
there are specific obstacles for that? Thank you very much & kind regards, Lucas -- Dr. Lucas Heimberg

Re: [ANNOUNCE] Apache Flink 1.8.0 released

2019-04-12 Thread Patrick Lucas
The Docker images for 1.8.0 are now available. Note that like Flink itself, starting with Flink 1.8 we are no longer providing images with bundled Hadoop. Users who need an image with bundled Hadoop should create their own, starting from the images published on Docker Hub and fetching the appropri

Re: TM get killed/disconnected after a while

2017-10-09 Thread Patrick Lucas
exited? -- Patrick Lucas On Fri, Oct 6, 2017 at 8:16 PM, Hao Sun wrote: > Hi, I am running Flink 1.3.2 on kubernetes, I am not sure why sometime one > of my TM is killed, is there a way to debug this? Thanks > > = Logs > > *2017-10-05

Re: javax.net.ssl.SSLPeerUnverifiedException: peer not authenticated for S3 access

2017-10-11 Thread Patrick Lucas
search for "javax.net.ssl.SSLPeerUnverifiedException aws" yielded a number of results—have you checked those out? -- Patrick Lucas On Wed, Oct 4, 2017 at 5:25 PM, Hao Sun wrote: > Here is what my docker file says: > > ENV FLINK_VERSION=1.3.2 \ > HADOOP_VERSION=27 \ &g

Re: Docker and AWS taskmanager configuration

2017-11-21 Thread Patrick Lucas
kmanager—then they should all be able to discover, address, and communicate with each other with no problems. -- Patrick Lucas On Tue, Nov 21, 2017 at 6:44 AM, Colin Williams < colin.williams.seat...@gmail.com> wrote: > Hi, > > We noticed that we couldn't parallelize our flink

Re: Should multiple apache flink task managers have strong identity? Also, should I point their state.checkpoints.dir to the same HDFS?

2018-01-24 Thread Patrick Lucas
e same for all jobmanagers and taskmanagers. All members of the cluster need to be able to see all the data, and Flink ensures that things are written to the correct subpath. -- Patrick Lucas On Mon, Jan 22, 2018 at 7:23 PM, Felipe Cavalcanti wrote: > Hi, > > I'm deploying flin

Re: deploying flink in AWS - some teething issues

2017-03-29 Thread Patrick Lucas
the job's metrics from outside the Flink cluster. -- Patrick Lucas On Wed, Mar 29, 2017 at 10:58 AM, Chakravarthy varaga < chakravarth...@gmail.com> wrote: > Hi, > > Any updates here? I'm sure many would have faced similar issues like > these, any help here is high

Re: deploying flink in AWS - some teething issues

2017-03-30 Thread Patrick Lucas
I think Log4j includes a Syslog appender—the log4j config included with Flink just logs to the logs/ dir, but you should just be able to modify it (log4j.properties) to suit your needs. -- Patrick Lucas On Thu, Mar 30, 2017 at 2:39 PM, Chakravarthy varaga < chakravarth...@gmail.com> wrote:

Re: Docker PID 1

2017-04-13 Thread Patrick Lucas
I concur with Nico. We're actively working on improving Flink-on-Docker, and this is a valid concern. -- Patrick Lucas On Tue, Apr 11, 2017 at 11:01 AM, Nico Kruber wrote: > Hi Kat, > yes, this looks like it may be an issue, please create the Jira ticket. > > Some background:

TypeInfo issue with Avro SpecificRecord

2021-06-14 Thread Patrick Lucas
Hi, I have read [1] when it comes to using Avro for serialization, but I'm stuck with a mysterious exception when Flink is doing type resolution. (Flink 1.13.1) Basically, I'm able to use a SpecificRecord type in my source, but I am unable to use different SpecificRecord types later in the pipeli

Re: TypeInfo issue with Avro SpecificRecord

2021-06-15 Thread Patrick Lucas
idered a bug, but I'll leave a comment on the above issue. -- Patrick Lucas On Mon, Jun 14, 2021 at 5:06 PM Patrick Lucas wrote: > Hi, > > I have read [1] when it comes to using Avro for serialization, but I'm > stuck with a mysterious exception when Flink is doing type resolut

flink-kubernetes-operator: image entrypoint misbehaves due to inability to write

2022-11-30 Thread Lucas Caparelli
Hello folks, Not sure if this is the best list for this, sorry if it isn't. I'd appreciate some pointers :-) When using flink-kubernetes-operator [1], docker-entrypoint.sh [2] goes through several failures to write into $FLINK_HOME/conf/. We believe this is due to this volume being mounted from a

Feasability Question: Distributed FlinkCEP

2016-10-20 Thread Lucas Konstantin Bärenfänger
esultStream}} followed_by {{node3ResultStream}}* *Node2: A and B* *Node3: C or D* Long story short: I want to execute the query in a distributed fashion. Is that currently possible using FlinkCEP? Thank you very much in advance! Best Lucas