Re: has insufficient permissions to access it - Error

2017-04-11 Thread Nico Kruber
Hi Marc, the file path doesn't look quite right, unless you really have such an (absolute!) file path. Nico On Saturday, 8 April 2017 17:41:28 CEST Kaepke, Marc wrote: > Hi, > > if I run my small Gelly application on IntelliJ (macOS and Ubuntu as well) I > have this error: > > Caused by: java.

Re: Docker PID 1

2017-04-11 Thread Nico Kruber
Hi Kat, yes, this looks like it may be an issue, please create the Jira ticket. Some background: Although docker-entrypoint.sh uses "exec" to run succeeding bash scripts for jobmanager.sh and taskmanager.sh, respectively, and thus replaces itself with these scripts, they do not seem to use exec

Problems with Kerberos Kafka connection in version 1.2.0

2017-04-11 Thread Diego Fustes Villadóniga
Hi all, I'm trying to connect to a kerberized Kafka cluster from Flink 1.2.0. I've configured Flink correctly following instructions to get the credentials from a given keytab. Here is the configuration: security.kerberos.login.keytab: /home/biguardian/biguardian.keytab security.kerberos.login

Custom timer implementation using Flink

2017-04-11 Thread jaxbihani
I have a use case which I am trying to solve using Flink. Need an advice to decide on the correct approach. Use case: -- I have a stream of events partitioned by a key. For some events, I need to start a timer (conside this as a SLA i.e. if something is not done in x secs/minutes do some

Re: Aggregation problem.

2017-04-11 Thread Nico Kruber
maxBy() is still a member of org.apache.flink.api.scala.GroupedDataSet in the current sources - what did you upgrade flink to? Also please make sure the new version is used, or - if compiled from sources - try a "mvn clean install" to get rid of old intermediate files. Regards Nico On Sunday,

Re: Flink slots, threads, task, etc

2017-04-11 Thread Flavio Pompermaier
Any feedback here..? On Wed, Apr 5, 2017 at 7:43 PM, Flavio Pompermaier wrote: > Hi to all, > I had a very long but useful chat with Fabian and I understood a lot of > concepts that was not clear at all to me. We started from the Flink runtime > documentation page (https://ci.apache.org/projects

CEP timeout does not trigger under certain conditions

2017-04-11 Thread vijayakumar palaniappan
-TimeoutPattern does not trigger under certain conditions. Following are the preconditions: -Assume a pattern of Event A followed by Event B within 2 Seconds -PeriodicWaterMarks every 1 second -Assume follwoing events have arrived. -Event A-1[time: 1 sec] -Event B-1[time: 2 sec] -Event A-2[ti

Re: CEP timeout does not trigger under certain conditions

2017-04-11 Thread vijayakumarpl
This is with 1.2.0 version of Flink libraries -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/CEP-timeout-does-not-trigger-under-certain-conditions-tp12584p12585.html Sent from the Apache Flink User Mailing List archive. mailing list archive

CEP Pattern detection progressively slower

2017-04-11 Thread vijayakumar palaniappan
While trying to use Pattern detection on KeyedStream, list of unique keys encountered, keeps accumulating in AbstractKeyedCEPPatternOperator.java. On encountering watermarks these accumulated keys are looped over to detect patterns. This causes spike in CPU usage and progressively gets slower. Is

Comparsion between Flink vs Kafka Stream Processing

2017-04-11 Thread kant kodali
Hi All, I have simple question. Here is a article that addresses the differences between Flink vs Kafka Streaming (in fact there is a table if you scroll down). While I understand those are the difference

Re: Custom timer implementation using Flink

2017-04-11 Thread Tzu-Li (Gordon) Tai
Hi, I just need to  start a timer of x days/hours (lets say) and when it is fired just trigger  something. Flink’s lower-level ProcessFunction [1] should be very suitable to implement this. Have you taken a look at this and see if it suits your case? [1]  https://ci.apache.org/projects/flink/fli

Re: Problems with Kerberos Kafka connection in version 1.2.0

2017-04-11 Thread Tzu-Li (Gordon) Tai
Hi Diego, I think the problem is here: security.kerberos.login.contexts: Client, KafkaClient The space between “Client,” and “KafkaClient” is causing the problem. Removing it should fix your issue. Cheers, Gordon On April 11, 2017 at 3:24:20 AM, Diego Fustes Villadóniga (dfus...@oesia.com) wrot

RE: Aggregation problem.

2017-04-11 Thread Kürşat Kurt
I have downloaded latest binary (http://www.apache.org/dyn/closer.lua/flink/flink-1.2.0/flink-1.2.0-bin-hadoop27-scala_2.11.tgz). I am getting this error in eclipse Neon(3) Regards, Kursat -Original Message- From: Nico Kruber [mailto:n...@data-artisans.com] Sent: Tuesday, April 11, 2017

Cassandra connector POJO - tombstone question

2017-04-11 Thread Tarandeep Singh
Hi, I am using flink-1.2 and Cassandra connector to write to cassandra tables. I am using POJOs with DataStax annotations as described here- https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/connectors/cassandra.html My question is- how are nulls handles by cassandra sink? Datastax

Re: Custom timer implementation using Flink

2017-04-11 Thread jaxbihani
Hi Gordon I somehow missed this in the docs. Looks really helpful for this use case. Thanks. I now have some other ideas for this use case. I will post here if I use this or not. If not, will post the approach which I will take. -- View this message in context: http://apache-flink-user-mailin