SPARKTA: a real-time aggregation engine

/sparkta/development/ We are open to your ideas and contributors are welcome. Regards. -- David Morales de Frías :: +34 607 010 411 :: @dmoralesdf https://twitter.com/dmoralesdf http://www.stratio.com/ Vía de las dos Castillas, 33, Ática 4, 3ª Planta 28224 Pozuelo de Alarcón, Madrid Tel: +34 91

Re: Ship Kafka in on prem product

your packaging script? Deb package for kafka 0.8.2 (or any other version for that matter) is sorely missed. Thanks, 2015-02-11 21:34 GMT+03:00 David Morales dmora...@stratio.com: Regarding RPM/DEB packages, we, at stratio.com, have a public repository which includes RPM and dev packages

Re: Ship Kafka in on prem product

for a reference about shipping kafka as part of Enterprise on prem product. Does anyone know if Kafka can be redistributed safely and/or is found secure enough to ship as part of enterprise product? Thanks in advance for your help. Thanks and regards, Geeta -- David Morales

Re: Ship Kafka in on prem product

of enterprise product? Thanks in advance for your help. Thanks and regards, Geeta -- David Morales de Frías :: +34 607 010 411 :: @dmoralesdf https://twitter.com/dmoralesdf http://www.stratio.com/ Vía de las dos Castillas, 33, Ática 4, 3ª Planta

Re: Reg: Perf test

to measure the producer and consumer performance. -- Regards Selvakumar.V -- David Morales de Frías :: +34 607 010 411 :: @dmoralesdf https://twitter.com/dmoralesdf http://www.stratio.com/ Vía de las dos Castillas, 33, Ática 4, 3ª Planta 28224 Pozuelo de Alarcón, Madrid Tel: +34 91 828

Re: Resilient Producer

anyone knows about something like that? Thanks! Fernando. -- David Morales de Frías :: +34 607 010 411 :: @dmoralesdf https://twitter.com/dmoralesdf http://www.stratio.com/ Vía de las dos Castillas, 33, Ática 4, 3ª Planta 28224 Pozuelo de Alarcón, Madrid Tel: +34 91 828 6473

Re: Routing modifications at runtime

are so big that they don't fit in memory. Are there any patterns for bookkeeping internal data structures and how route to them? T. -- David Morales de Frías :: +34 607 010 411 :: @dmoralesdf https://twitter.com/dmoralesdf http://www.stratio.com/ Vía de las dos Castillas, 33

Re: Need to use Kafka with spark

This is a very nice intro to spark and kafka, with some valuable details about partitioning and parallelism http://www.michael-noll.com/blog/2014/10/01/kafka-spark-streaming-integration-example-tutorial/ 2014-12-05 21:31 GMT+01:00 sanjeeb kumar sanjeebpand...@gmail.com: Hi Team, I am able

consumer reaction to auto-create topics (0.8.1)

Hi there, A few days ago i have written about an issue (0.8.0) when auto-create topic is enabled and consumer starts before producer (consumer never sees any message and they seem to be lost even by the brokers) Now i have done the same test with 0.8.1 and the issue is partially fixed but now

Re: consumer reaction to auto-create topics

while rebalancing and issuing fetch requests for the topic. Could you try to run this from scratch (following the quickstart). Ensure that the broker and zookeeper have been started successfully. Thanks, Neha On Thu, Mar 6, 2014 at 9:34 AM, David Morales de Frías dmora

Re: consumer reaction to auto-create topics

0.8, thanks. 2014-03-06 18:27 GMT+01:00 Jun Rao jun...@gmail.com: Which version of Kafka are you using? Thanks, Jun On Thu, Mar 6, 2014 at 2:10 AM, David Morales de Frías dmora...@paradigmatecnologico.com wrote: Hi there, If i start a consumer in a non-existent topic (auto

Re: Reg Partition and Replica?

Maybe these pictures can help you: https://kafka.apache.org/images/log_anatomy.png http://www.michael-noll.com/blog/uploads/kafka-topics-partitions-replicas.png http://www.michael-noll.com/blog/uploads/kafka-cluster-overview.png And of course, this post might help too:

calling ad-hoc topic creation from code

Hi there, I'm trying to create a topic from java code, by calling CreateTopicCommand: *ZkClient zkClient = new ZkClient(zookeeperCluster, 3, 3);* *CreateTopicCommand.createTopic(zkClient, topic, numPartitions.intValue(),replicationFactor.intValue(), );* *zkClient.close();* The

Re: calling ad-hoc topic creation from code

2014-02-25 17:25 GMT+01:00 Jun Rao jun...@gmail.com: Is the ZK connection string + namespace the same btw the code and the script? Thanks, Jun On Tue, Feb 25, 2014 at 3:01 AM, David Morales de Frías dmora...@paradigmatecnologico.com wrote: Hi there, I'm trying to create a topic

Re: calling ad-hoc topic creation from code

is less than the replication factor at topic creation time. Thanks, Neha On Tue, Feb 25, 2014 at 8:39 AM, David Morales de Frías dmora...@paradigmatecnologico.com wrote: This is the code that i can see in CreateTopicCommand var zkClient: ZkClient = null try { zkClient