vibe.d kafka driver & probabilistic linear counting

[yawniek via Digitalmars-d-announce]

we pushed 2 new projects:

a native kafka driver to work with the vibe.d eventloop
http://code.dlang.org/packages/kafka-d
it's not full featured yet (no zookeeper) but the basic use cases 
work fine.
throughput depends on the buffer sizes but we achieved gigabit 
speeds in benchmarks.

thanks to Piotr for most of the implementation.

after unsuccessful C bindings to redis hyperloglog datastructure 
i came to
the conclusion that a linear probabilistc counter should be 
sufficient for many use cases.

even contains some optimizations for UUID.
thanks Ilya for the implementation:

http://code.dlang.org/packages/lincount

Re: vibe.d kafka driver & probabilistic linear counting

[André via Digitalmars-d-announce]

On Sunday, 10 April 2016 at 10:51:38 UTC, yawniek wrote:

we pushed 2 new projects:

a native kafka driver to work with the vibe.d eventloop
http://code.dlang.org/packages/kafka-d
it's not full featured yet (no zookeeper) but the basic use 
cases work fine.
throughput depends on the buffer sizes but we achieved gigabit 
speeds in benchmarks.

thanks to Piotr for most of the implementation.


The news on Kafka are really great! Thanks a lot for the work! 
Did you inform the Kafka developers that there is a new language 
supported? Maybe this could be added to this Wiki page which 
lists all supported libs and languages: 
https://cwiki.apache.org/confluence/display/KAFKA/Clients.


Regards,
André

Re: vibe.d kafka driver & probabilistic linear counting

[Yawniek via Digitalmars-d-announce]

On Monday, 11 April 2016 at 09:08:34 UTC, André wrote:

On Sunday, 10 April 2016 at 10:51:38 UTC, yawniek wrote:

we pushed 2 new projects:

a native kafka driver to work with the vibe.d eventloop
http://code.dlang.org/packages/kafka-d
it's not full featured yet (no zookeeper) but the basic use 
cases work fine.
throughput depends on the buffer sizes but we achieved gigabit 
speeds in benchmarks.

thanks to Piotr for most of the implementation.


The news on Kafka are really great! Thanks a lot for the work! 
Did you inform the Kafka developers that there is a new 
language supported? Maybe this could be added to this Wiki page 
which lists all supported libs and languages: 
https://cwiki.apache.org/confluence/display/KAFKA/Clients.


Regards,
André


Not yet, i have too little outside feedback yet. So please test 
and fill tickets with bugs/feature requests on gh