Samza 13.1 and Kafka 1.0

Hi, Does anyone know if Samza 13.1 is compatible with Kafka 1.0? Thanks, Xiaochuan Yu

Exit code 248 from YARN and InterruptedException

exit code 248? Could a problem with Kafka cause something like this? Thanks, Xiaochuan Yu

Re: Samza Job Slow to Restart

into it. Thanks, Xiaochuan Yu On Sat, Sep 23, 2017 at 6:17 PM XiaoChuan Yu <xiaochuan...@kik.com> wrote: > >> How long does it take? > It took around 10 minute from "Got offset 0 for topic > ..." to init() being called on the Task. > > >> Have you me

Historical container logs in YARN UI

and timeline server in YARN. I know there's a history server implementation for Map Reduce. Is there a similar history server implementation available for Samza? Thanks, Xiaochuan Yu

Re: Samza Job Slow to Restart

e for us to take a look? > > >> 3. Any ideas on how to fix this? > > We can perhaps, try to narrow down where the time is spent in startup from > the logs? Depending on that, I can suggest a fix :-) > > Thanks, > Jagadish > > On Wed, Sep 20, 2017 at 11:21 AM,

Samza Job Slow to Restart

and make requests for each. Questions: 1. What does that loop do exactly? 2. Is this an expected behaviour? Is "Got offset 0 for topic ..." normal? 3. Any ideas on how to fix this? Thanks, Xiaochuan Yu

Deploying Samza Jobs Using S3 and YARN on AWS

eSystem. Whats the right way to set this up? Should I just copy over the required AWS jars to the Hadoop conf directory (2.)? Should I be editing run-job.sh or run-class.sh? Thanks, Xiaochuan Yu

Re: Kafka 0.10.2 compatibility with Samza 0.13.1

with success. The testing was done on AWS EC2 instances running RedHat 7. We also found out that running against CDH YARN required various dependency overrides such as the ones in Hello Samza's "cdh5" build profile <https://github.com/apache/samza-hello-samza/blob/master/pom.xml#L282-L297>. T

Kafka 0.10.2 compatibility with Samza 0.13.1

rsions. Cloudera Kafka version table: https://www.cloudera.com/documentation/kafka/latest/topics/kafka_packaging.html . Thanks, Xiaochuan Yu

Re: Custom ordering when using async

are processed serially. Thanks, Xiaochuan Yu On Thu, Aug 10, 2017 at 11:28 PM Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > Hi XiaoChuan, > > Are you setting task.max.concurrency > 1 that allows multiple messages > in-flight? (The "keyed executo

Custom ordering when using async

on user IDs in parallel using processAsync but would like each user's event be processed in order. Does this then require custom ordering logic mentioned in the article? Thanks, Xiaochuan Yu

Re: Steps to Upgrading Samza (0.9 to 0.12)

t; > > > > I > > > > > > believe > > > > > you > > > > > > > > > > > > > > > > > >will be fine. (but I'm not sure) > > > > > > > > > > > > *Kafka version: * &

Steps to Upgrading Samza (0.9 to 0.12)

installation of Kafka and YARN were managed through Puppet. I'm extremely new to Samza in terms of operations aspect. I'm not sure what information would be relevant in this case so please ask away. Thanks, Xiaochuan Yu