Hi everyone, I wanted to circle back on this thread and with another invitation to a discussion. Work on the high level refactorings to align the Java SDK with the primitives of the proposed model is pretty far along, as is moving out the stuff that we don't want in the user-facing SDK.
Since our runners are all Java-based, and we tend to discuss the model in Java first, I think part of the proposal that may have received less attention was the concrete Avro schema towards the bottom of the doc. Since our serialization tech discussion seemed to favor JSON on the front end, I just spent a few minutes to port the Avro schema to a JSON schema and do some project set up to demonstrate where & how it would incorporate into the project structure. I'd done the same for Avro previously, so we can see how they compare. I put the code in a PR, for discussion only at this point, at https://github.com/apache/incubator-beam/pull/662. I'd love if you took a look at the notes on the PR and briefly at the schema; I'll continue to evolve it according to current & future feedback. Kenn On Wed, Mar 23, 2016 at 2:17 PM, Kenneth Knowles <k...@google.com> wrote: > Hi everyone, > > Incorporating the feedback from the 1-pager I circulated a week ago, I > have put together a concrete design document for the new API(s). > > > https://docs.google.com/document/d/1bao-5B6uBuf-kwH1meenAuXXS0c9cBQ1B2J59I3FiyI/edit?usp=sharing > > I appreciate any and all feedback on the design. > > Kenn >