Flink Elasticsearch connector 7 with SSL

2022-06-30 Thread shishal singh
Hi Flink community members, In my flink job, I am trying to use *elasticsearch7* connector. I could not find a way to communicate over SSL when using *Elasticsearch7SinkBuilder* Am I missing something? Also there is an deprecated class *ElasticsearchSink.Builder* where it has *RestClientFactory*

Re: Flink job hangs using rocksDb as backend

2018-07-23 Thread shishal singh
NCELLATION);* *env.getCheckpointConfig().setMaxConcurrentCheckpoints(1);* The last thing I am intended to try is using FSSatebackend to be sure if its rocksDB related issue, but the problem is sometimes issue get reproduced after couple of days. Regards, Shishal On Mon, Jul 23, 2018 at 10:08

Re: Flink job hangs using rocksDb as backend

2018-07-20 Thread shishal singh
Task.run(OneInputStreamTask.java:69)* * at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:264)* * at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718)* * at java.lang.Thread.run(Thread.java:748)* * Locked ownable synchronizers:* Regards, Shishal On Thu

Re: Flink job hangs using rocksDb as backend

2018-07-12 Thread shishal singh
sionid: 0x2648355f7c6010f after 10ms* *2018-07-12 14:36:11,957 DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager* As I expected checkpoint also start to fail during this time. My Job Graph is pretty much simple : Source-->filter->Sink Regards, Shis

Flink job hangs using rocksDb as backend

2018-07-11 Thread shishal
Hi, I am using flink 1.4.2 with rocksdb as backend. I am using process function with timer on EventTime. For checkpointing I am using hdfs. I am trying load testing so Iam reading kafka from beginning (aprox 7 days data with 50M events). My job gets stuck after aprox 20 min with no error.

Re: Collect event which arrive after watermark

2018-04-04 Thread shishal
Thanks Fabian, My understand was that late event older than watermark is dropped. So processFunction wont be called for late event. So I guess my understanding was wrong. Or there is something more to it? -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Collect event which arrive after watermark

2018-04-04 Thread shishal
. Thanks, Shishal -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Flink CEP detect multiple pattern witin their specific time window

2018-03-23 Thread shishal
and elastic sink is same for both job. Regards, Shishal -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Flink CEP window for 1 working day

2018-03-20 Thread shishal
Thanks Fabian, So by non working day, I mean, I have a list of non working day in a year, which I can use to compare. I am very new to Flink and Flick CEP. Initially I thought there is a way to have within(time) value expression dynamically. So now I guess that's not possible. If I understand

Flink CEP window for 1 working day

2018-03-20 Thread shishal
I am using flink CEP , and to match a event pattern in given time window we use *.within(Time.days(1))* Now in one of the case I need to wait for 1 working day instead of 1 day. Is there any way to do that in Flink CEP? -- Sent from:

design flink cep pattern for transaction life cycle

2018-03-14 Thread shishal singh
atternTimeoutFunction to trigger alert. Regards, Shishal