[DISCUSS] DL Stream Operation Primitives

2016-11-09 Thread Gerrit Sundaram
As what Sijie suggested in the other email thread, I started this email thread for discussing the stream operation primitives. The stream operations that I am aware of that DL supports are * Open a distributedlog stream * Delete a distributedlog stream * List all the distributedlog streams under

Re: FileSystem API over distributedlog logs

2016-11-09 Thread Gerrit Sundaram
Sijie, thank your for your comments and suggestions. I will start a separate thread for discussing the metadata operation primitives. BTW, I didn't find any code in kestrel that is related to distributedlog :( Can you kindly point me the files? - Gerrit On Wed, Nov 2, 2016 at 10:35 AM, Sijie

Re: Use DL stream to store offsets?

2016-11-09 Thread Jay Juma
I am also interested in a framework/library that makes building state machine easier. When do you think you can share that? I'd like to contribute too. - Jay On Wed, Nov 2, 2016 at 9:19 AM, Leigh Stewart wrote: > Whats your timeline Khurrum? Maybe we can work

Re: Proxy Client - Batch Ordering / Commit

2016-11-09 Thread Xi Liu
Cameron, Have you started any work for this? I just updated the proposal page - https://cwiki.apache.org/confluence/display/DL/DP-2+-+Epoch+Write+Support Maybe we can work together with this. Sijie, Leigh, can you guys help review this to make sure our proposal is in the right direction? - Xi