Thanks Khurrum. At this point, we don't have any specific process to follow for big features. We were discussing one under http://mail-archives.apache.org/mod_mbox/incubator-distributedlog-dev/201607.mbox/browser
But ideally, let's use mail list for discussion and use confluence page for reflecting the discussions into a design doc. If you already have a confluence account (if not, please create one), please email me your account. I can grant the permission to you, then you can edit. - Sijie On Mon, Aug 1, 2016 at 9:01 AM, Khurrum Nasim <[email protected]> wrote: > Sijie, > > Thank you so much for your quick reply. We are using Kafka now and we are > interested in the features in DL like durability and handling slow > machines. > > If it is okay to the community, we'd like to give a try and evaluate the > solution. Is there any process that I should follow? > > KN > > On Sunday, July 31, 2016, Sijie Guo <[email protected] > <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > > > Khurrum, > > > > Interesting. Thank you for your interests in DistributedLog. > > > > Three years ago when we started the project internally at Twitter, we did > > have a plan to use it as a backend for both kestrel (Twitter's in-house > > queue system) and Kafka. However, we didn't go down that direction. > > Instead, we built a similar self-serve pub/sub system over DistributedLog > > to consolidate our kestrel and kafka. So we don't have a concrete plan to > > build the kafka's interface over DistributedLog. The module was put under > > tutorials is mostly to give people an idea how it can be used for > building > > a partition based pub/sub system. > > > > However, I don't have any strong preference here. If you think it would > be > > useful to other people, you are welcome to contribute. We'd be happy to > > guide and offer any helps. > > > > Also, it might be good if you can explain more about what you are > planning > > to do. Other people in the community can chime in and discuss. > > > > Please let us know your thoughts. You are very welcome to make any > > contributions. > > > > - Sijie > > > > On Sat, Jul 30, 2016 at 10:33 PM, Khurrum Nasim <[email protected] > > > > wrote: > > > > > Hello folks, > > > > > > I saw there is a 'distributedlog-kafka' module in tutorials. But it > seems > > > not complete yet. I am wondering if there is a plan to fully implement > > the > > > kafka's interface. It would be great if we can use kafka's interface to > > > access distributed log. I'd like to contribute if there is a plan. > > > > > > Thanks, > > > KN > > > > > >
