Thanks Leigh and Sijie.
I will move the development to under a contrib project. I am going to also
talk the kafka folks if that is the best place to host this idea.
KN
On Mon, Aug 29, 2016 at 7:45 AM, Leigh Stewart wrote:
> Agree with Sijie, I think this is exciting work and I didn't mean to c
Agree with Sijie, I think this is exciting work and I didn't mean to cut
off your options. My objection was just about code organization.
A contribs project seems like a good compromise for now, until we can think
of a better place to put the code.
Sijie's right though, if we want to fully produc
+ Leigh
Khurrum,
Thanks for your hard working on this. The approach in general looks good to
me.
However, I am kind of agreeing with what Leigh commented at pull request.
Ideally we want to make DL more focus on single streams itself, such as
durability, consistency and performance. As different
I sent out another pull request to improve the kafka publisher in the
tutorial : https://github.com/apache/incubator-distributedlog/pull/16
We tried to use the existing kafka configuration, key/value serializer and
partitioner as possible as we can. So we don't need to rewrite our existing
service
I sent out a pull request about the offset sequencer.
https://github.com/apache/incubator-distributedlog/pull/15
I am not sure if there is any code guideline to follow. I tried my best to
follow existing code style. If I did anything wrong, please help me fix
them.
- KN
On Tue, Aug 23, 2016 a
Hi All,
After read the DL code, we have a better idea on how to use distributed log
as the kafka implementation. There are two approaches to do that: one is to
use distributedlog-core library directly in kafka broker, while the other
one is to use all the DL components.
The first approach is basi
Thanks Khurrum.
At this point, we don't have any specific process to follow for big
features. We were discussing one under
http://mail-archives.apache.org/mod_mbox/incubator-distributedlog-dev/201607.mbox/browser
But ideally, let's use mail list for discussion and use confluence page for
reflecti
Sijie,
Thank you so much for your quick reply. We are using Kafka now and we are
interested in the features in DL like durability and handling slow machines.
If it is okay to the community, we'd like to give a try and evaluate the
solution. Is there any process that I should follow?
KN
On Sunda
Khurrum,
Interesting. Thank you for your interests in DistributedLog.
Three years ago when we started the project internally at Twitter, we did
have a plan to use it as a backend for both kestrel (Twitter's in-house
queue system) and Kafka. However, we didn't go down that direction.
Instead, we b
Hello folks,
I saw there is a 'distributedlog-kafka' module in tutorials. But it seems
not complete yet. I am wondering if there is a plan to fully implement the
kafka's interface. It would be great if we can use kafka's interface to
access distributed log. I'd like to contribute if there is a pla
10 matches
Mail list logo
