Re: RemoteTransportException when trying to redis in flink code

2016-04-06 Thread Till Rohrmann
Great to hear that you solved your problem :-) On Wed, Apr 6, 2016 at 2:29 PM, Balaji Rajagopalan < balaji.rajagopa...@olacabs.com> wrote: > Till, > Found the issue, it was my bad assumption about GlobalConfiguration, > what I thought was once the configuration is read from the client machine

Re: RemoteTransportException when trying to redis in flink code

2016-04-06 Thread Balaji Rajagopalan
Till, Found the issue, it was my bad assumption about GlobalConfiguration, what I thought was once the configuration is read from the client machine GlobalConfiguration params will passed on to the task manager nodes, as well, it was not and values from default was getting pickup, which was

Re: RemoteTransportException when trying to redis in flink code

2016-04-06 Thread Till Rohrmann
Hmm I'm not a Redis expert, but are you sure that you see a successful ping reply in the logs of the TaskManagers and not only in the client logs? Another thing: Is the redisClient thread safe? Multiple map tasks might be accessing the set and get methods concurrently. Another question: The code

Re: RemoteTransportException when trying to redis in flink code

2016-04-06 Thread Balaji Rajagopalan
Till, I have checked from all the taskmanager nodes I am able to establish a connection by installing a redis-cli on those nodes. The thing is in the constructor I am able to set and get values, also I am getting PONG for the ping. But once object is initialized when I try to call

Re: RemoteTransportException when trying to redis in flink code

2016-04-06 Thread Till Rohrmann
Hi Balaji, from the stack trace it looks as if you cannot open a connection redis. Have you checked that you can access redis from all your TaskManager nodes? Cheers, Till On Wed, Apr 6, 2016 at 7:46 AM, Balaji Rajagopalan < balaji.rajagopa...@olacabs.com> wrote: > I am trying to use AWS EMR

RemoteTransportException when trying to redis in flink code

2016-04-05 Thread Balaji Rajagopalan
I am trying to use AWS EMR yarn cluster where the flink code runs, in one of apply window function, I try to set some values in redis it fails. I have tried to access the same redis with no flink code and get/set works, but from the flink I get into this exception. Any inputs on what might be