Hi Mohit,
is there new data being produced into the topic?
The properties.setProperty("auto.offset.reset", "earliest"); setting only
applies if you haven't consumed anything in this consumer group.
So if you have read all the data in the topic before, you won't see
anything new showing up.
On Sat, Feb 18, 2017 at 2:09 AM, Mohit Anchlia <mohitanch...@gmail.com>
wrote:
> Interestingly enough same job runs ok on Linux but not on windows
>
> On Fri, Feb 17, 2017 at 4:54 PM, Mohit Anchlia <mohitanch...@gmail.com>
> wrote:
>
>> I have this code trying to read from a topic however the flink process
>> comes up and waits forever even though there is data in the topic. Not sure
>> why? Has anyone else seen this problem?
>>
>> StreamExecutionEnvironment env = StreamExecutionEnvironment
>>
>> .*createLocalEnvironment*();
>>
>> Properties properties = *new* Properties();
>>
>> properties.setProperty("bootstrap.servers", "xxxx:9092");
>>
>> properties.setProperty("group.id", "test1");
>>
>> properties.setProperty("auto.offset.reset", "earliest");
>>
>> FlatMapFunction<Integer, Tuple2<Integer, Integer>> flatMapper =
>> //something
>>
>>
>>
>> DataStream<String> stream = env
>>
>> .addSource(*new* FlinkKafkaConsumer010<>("test", *new*
>> SimpleStringSchema(), properties));
>>
>> stream.map(s -> Integer.*valueOf*(s)).flatMap(flatMapper).returns(
>>
>> *new* TypeHint<Tuple2<Integer, Integer>>() {
>>
>> }).print();
>>
>> JobExecutionResult *res* = env.execute();
>>
>>
>>
>> 02/17/2017 16:50:25 Source: Custom Source -> Map -> Flat Map -> Sink:
>> Unnamed(4/4) switched to RUNNING
>>
>>
>> 02/17/2017 16:50:25 Source: Custom Source -> Map -> Flat Map -> Sink:
>> Unnamed(1/4) switched to RUNNING
>>
>>
>> 02/17/2017 16:50:25 Source: Custom Source -> Map -> Flat Map -> Sink:
>> Unnamed(2/4) switched to RUNNING
>>
>>
>>
>
