Local Storage

2015-12-17 Thread Heath Ivie
Maybe someone can answer this question for, because I cannot seem to find it.

What is the data store that Kafka uses when it writes the logs to disk?

I thought I saw a reference to KahaDB, but I am not sure if that is correct.


Heath Ivie
Solutions Architect


Warning: This e-mail may contain information proprietary to AutoAnything Inc. 
and is intended only for the use of the intended recipient(s). If the reader of 
this message is not the intended recipient(s), you have received this message 
in error and any review, dissemination, distribution or copying of this message 
is strictly prohibited. If you have received this message in error, please 
notify the sender immediately and delete all copies.


Re: Local Storage

2015-12-17 Thread Gwen Shapira
Hi,

Kafka *is* a data store. It writes data to files on the OS file system. One
directory per partition, and a new file every specific amount of time (you
can control this with log.roll.ms). The data format is specific to Kafka.

Hope this helps,

Gwen

On Thu, Dec 17, 2015 at 3:32 PM, Heath Ivie  wrote:

> Maybe someone can answer this question for, because I cannot seem to find
> it.
>
> What is the data store that Kafka uses when it writes the logs to disk?
>
> I thought I saw a reference to KahaDB, but I am not sure if that is
> correct.
>
>
> Heath Ivie
> Solutions Architect
>
>
> Warning: This e-mail may contain information proprietary to AutoAnything
> Inc. and is intended only for the use of the intended recipient(s). If the
> reader of this message is not the intended recipient(s), you have received
> this message in error and any review, dissemination, distribution or
> copying of this message is strictly prohibited. If you have received this
> message in error, please notify the sender immediately and delete all
> copies.
>


RE: Local Storage

2015-12-18 Thread Heath Ivie
Thank you very much Gwen

-Original Message-
From: Gwen Shapira [mailto:g...@confluent.io] 
Sent: Thursday, December 17, 2015 3:45 PM
To: users@kafka.apache.org
Subject: Re: Local Storage

Hi,

Kafka *is* a data store. It writes data to files on the OS file system. One 
directory per partition, and a new file every specific amount of time (you can 
control this with log.roll.ms). The data format is specific to Kafka.

Hope this helps,

Gwen

On Thu, Dec 17, 2015 at 3:32 PM, Heath Ivie  wrote:

> Maybe someone can answer this question for, because I cannot seem to 
> find it.
>
> What is the data store that Kafka uses when it writes the logs to disk?
>
> I thought I saw a reference to KahaDB, but I am not sure if that is 
> correct.
>
>
> Heath Ivie
> Solutions Architect
>
>
> Warning: This e-mail may contain information proprietary to 
> AutoAnything Inc. and is intended only for the use of the intended 
> recipient(s). If the reader of this message is not the intended 
> recipient(s), you have received this message in error and any review, 
> dissemination, distribution or copying of this message is strictly 
> prohibited. If you have received this message in error, please notify 
> the sender immediately and delete all copies.
>