flink kafka consumer lag

2017-07-08 Thread Karthik Deivasigamani
Hi, I'm using Flink 1.2.1 and FlinkKafkaConsumer09 to read data from Kafka Server (0.10.1.0). My consumer is able to read and everything works fine. But when I use the kafka_consumer_groups.sh command to find the lag metrics it does not return the lag. Upon reading online I found that Flink Kafk

System properties when submitting flink job to YARN Session

2017-07-08 Thread Jins George
Hello, I want to set the path of a properties file as System property in my application(something like -Dkey=value). Is there a way to set it while submitting a flink job to running YARN Session? I am using //bin/flink run/ to submit the job to a already running YARN session. Thanks, Jins Ge