Review Request 46287: Add a double serde.

2016-04-15 Thread Jon Bringhurst
://reviews.apache.org/r/46287/diff/ Testing --- A simple unit test was added. Thanks, Jon Bringhurst

Re: Review Request 40933: SAMZA-829: Add YARN configure doc to allow clean shutdown for large state jobs

2015-12-03 Thread Jon Bringhurst
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/40933/#review108908 --- Ship it! - Jon Bringhurst On Dec. 3, 2015, 11:10 p.m., Yi Pan

Re: Streaming SQL - object models, ASTs and algebras

2015-01-27 Thread Jon Bringhurst
Hey Julian, Most of the general discussion surrounding a high level language for Samza can be found at: https://issues.apache.org/jira/browse/SAMZA-390 Early mockups of Yi's work on what the lower level APIs (phases after AST rewriting) might look like can also be found at: https://issues.apa

Re: Changelog cleanup.policy and segment.bytes in 0.8.0

2015-01-26 Thread Jon Bringhurst
Hey Zach, That's correct. You probably want to look into the following topic-level configs: cleanup.policy min.cleanable.dirty.ratio segment.ms segment.bytes (we usually use the default value) Also, here's some broker configs of interest that you might want to tweak (along with the settings we

Re: Local state write throughput

2015-01-26 Thread Jon Bringhurst
Right now we're mostly running with noop for our most recently installed SSDs. Some older ones are running with cfq. Early on in the development of samza-kv, I tried deadline and noop (in place of cfq) and didn't notice a significant change in performance. However, I don't have any numbers to b