RE: Old style "low level" Tasks with alternative deployment model(s)

Wow, what great timing, and what a great thread! I definitely have some good starters to go off of here. If it is helpful for everyone, once I get the low-level API + ZkJobCoordinator + Docker + K8s working, I'd be glad to formulate an additional sample for hello-samza. One thing I'm still cu

Re: Old style "low level" Tasks with alternative deployment model(s)

Hey there! You are correct that this is focused on the higher-level API but doesn't preclude using the lower-level API. I was at the same point you were not long ago, in fact, and had a very productive conversation on the list: you should look for "Question about custom StreamJob/Factory" in the

[GitHub] samza pull request #448: SAMZA-1564: Host affinity in standalone.

GitHub user shanthoosh opened a pull request: https://github.com/apache/samza/pull/448 SAMZA-1564: Host affinity in standalone. SEP-11 Patch 1: Introducing MetadataStore interface and the associated classes. Followup patches will contain the TaskNameGrouper changes and oth

Old style "low level" Tasks with alternative deployment model(s)

Hi all, We are using Samza (0.12.0) in about 2 dozen jobs implementing several processing pipelines. We have also begun a significant move of other services within our company to Docker/Kubernetes. Right now our Hadoop/Yarn cluster has a mix of stream and batch "Map Reduce" jobs (many reporting