All containers not starting.

2015-12-29 Thread Mhaskar, Tushar
Hi , I wanted to start a samza job with container count as 10. When I deploy , I see only 7 containers have been spawned. I did restart the job after killing it. I do not see any errors in the ApplicationMaster logs nor anywhere in the container. Any pointers will be helpful. Below is my pro

Running multiple tasks in multi-node Yarn environment leaves some jobs stucked in ASSIGNED state.

2015-09-07 Thread Mhaskar, Tushar
Hi All, I was trying to run wikipedia-feed(feed) and wikipedia-stats(stats) job in multi-node YARN environment(http://samza.apache.org/learn/tutorials/0.7.0/run-in-multi-node-yarn.html). Config : 1 Master – 1 slave (as mentioned in the example) Whichever task I run second, gets stuck in ASSIGNE

Unable to see application logs in multi node yarn environment

2015-09-07 Thread Mhaskar, Tushar
Hi All, I started the wikipedia task using https://samza.apache.org/learn/tutorials/0.7.0/run-in-multi-node-yarn.html I am unable to see the application logs/container logs in the "deploy/yarn/logs/userlogs” folder (which we see, if we just run the hello samza example in single node environmen

Samza Task searching for Resource Manager at wrong address at startup

2015-09-04 Thread Mhaskar, Tushar
Hi All, I am trying to run the hello samza project . When I execute the following command , bin/grid start yarn The Resource Manager starts on 127.0.0.0:3032 , but when I start the task it searches the Resource Manager on 0.0.0.0:8032. What could be the config change? Thanks, Tushar

key not found exception while starting a job with RocksDB kv store

2015-08-26 Thread Mhaskar, Tushar
Hi All, I am getting the following exception while starting a samza job 2015-08-26 12:05:13 VerifiableProperties [INFO] Verifying properties 2015-08-26 12:05:13 VerifiableProperties [INFO] Property auto.offset.reset is overridden to smallest 2015-08-26 12:05:13 VerifiableProperties [INFO] Prope

[DISCUSS] Sliding window implementation in Samza

2015-08-19 Thread Mhaskar, Tushar
Hi, 1. I came across Windowing functionality in Samza. It looks like it implements a static window. Is there a sliding window functionality available in Samza? 2. How to do aggregation across multi-node yarn node, any pointers to it? E.g : Lets say I have 2 slave machines wher