Re: [DISCUSS] SEP-4: Adjunct Data Store for Unbounded DataSets

2017-05-19 Thread Wei Song
Thanks much for your comment, Jahadish! Please see inline for my response … -Wei On 5/19/17, 5:47 PM, "Jagadish Venkatraman" wrote: Thanks for writing up this proposal, Wei. This will go a long way in satisfying a number of Samza use-cases. I'm +1 to this idea. >> Section on

Re: [DISCUSS] SEP-4: Adjunct Data Store for Unbounded DataSets

2017-05-19 Thread Jagadish Venkatraman
Thanks for writing up this proposal, Wei. This will go a long way in satisfying a number of Samza use-cases. I'm +1 to this idea. >> Section on proposed changes: Provide hooks to transform an incoming message to desired types (this is useful to store a subset of the incoming message). 1. I believ

Re: [DISCUSS] SEP-4: Adjunct Data Store for Unbounded DataSets

2017-05-19 Thread Jagadish Venkatraman
Thanks for writing up this proposal, Wei. This will go a long way in satisfying a number of Samza use-cases. I'm +1 to this idea. >> Section on proposed changes: Provide hooks to transform an incoming message to desired types (this is useful to store a subset of the incoming message). 1. I believ

Re: [DISCUSS] SEP-4: Adjunct Data Store for Unbounded DataSets

2017-05-19 Thread Jagadish Venkatraman
Thanks for writing up this proposal, Wei. This will go a long way in satisfying a number of Samza use-cases. I'm +1 to this idea. >> Section on proposed changes: Provide hooks to transform an incoming message to desired types (this is useful to store a subset of the incoming message). 1. I believ

[GitHub] samza pull request #181: SAMZA-1193. re-enable the test TestZkBarrierForVers...

2017-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/samza/pull/181 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Re: [DISCUSS] SEP-4: Adjunct Data Store for Unbounded DataSets

2017-05-19 Thread Wei Song
Thanks Xinyu for your feedback. With regard to your question, when a new version of a file becomes available, we would already be in the normal processing mode, either the connector or external system would need to inject an indication to signal the end of the current version and continue send the

Re: [DISCUSS] SEP-4: Adjunct Data Store for Unbounded DataSets

2017-05-19 Thread xinyu liu
Hi, Wei, +1 on the proposed design. This is going to reduce a lot of heavy-lifting work that's needed done by user code today to bootstrap a data stream into local store. The configs look quite straightforward and easy to set up. Overall the design looks great to me. I have one question: in the p

[CANCEL][VOTE] Apache Samza 0.13.0 release

2017-05-19 Thread Bharath Kumara Subramanian
Hi all, This is an official CANCEL for the RC0 vote, and a status update for the new RC. Resending this since previous emails did not get delivered to the list. We found a few issues in RC0 during further testing. The following issues are already fixed and will be available in new RC: SAMZA-128

[GitHub] samza pull request #197: SAMZA-1298: Create zk path.

2017-05-19 Thread sborya
GitHub user sborya opened a pull request: https://github.com/apache/samza/pull/197 SAMZA-1298: Create zk path. if ZK path contains extra path at the end, it needs to be created in ZK at first connect. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] samza pull request #178: SAMZA-1258. Integration tests. Happy Path.

2017-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/samza/pull/178 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl