Hi folks, I updated SEP-14 based on some feedback and discussions on the PR. Major changes are:
1. We will not support system level serdes _out of the box_ (e.g., for GenericSystemDescritors). Users must specify a stream level serde when creating Input/OutputStreamDescriptors. System implementers may still choose to support system level serdes for their own descriptors. 2. We will not support stream level input transformers in the initial implementation. We can add them later if we find this to be a common use case. 3. We changed the SystemDescriptor base classes to optional interfaces for providing input and output descriptors. This allows system implementers more flexibility in providing input and output descriptors to users. Please let me know if you have any questions or suggestions. If not, we can move SEP-14 from discussion to voting. Thanks, Prateek > On Aug 6, 2018, at 4:20 PM, Prateek Maheshwari <prate...@utexas.edu> wrote: > > Hi all, > > Here's the proposal for System and Stream Descriptors - a way of > specifying systems, input and output streams properties in application > code instead of configurations. > https://cwiki.apache.org/confluence/display/SAMZA/SEP-14%3A+System+and+Stream+Descriptors > > Here's the PR with an implementation for the proposal above: > https://github.com/apache/samza/pull/603 > > Please let me know if you have any questions or feedback for the SEP above. > > Thanks, > Prateek