All the data log files for a given topic-partition are stored under a topic-partition directory in a particular data.dir. So a topic-partition directory can grow up to the capacity of the log.dir director. And there can be multiple topic-partition directories in a data.dir. It depends topic-partitions retention size and the disk capacity.
After JBOD improvements (KAFKA-4763) and with multiple disks, broker will continue to work even after disk failures. On Fri, Dec 1, 2017 at 6:16 AM, Raghav <raghavas...@gmail.com> wrote: > Can someone please help here ? > > On Thu, Nov 23, 2017 at 10:42 AM, Raghav <raghavas...@gmail.com> wrote: > > > Anyone here ? > > > > On Wed, Nov 22, 2017 at 4:04 PM, Raghav <raghavas...@gmail.com> wrote: > > > >> Hi > >> > >> If I give several locations with smaller capacity for log.dirs vs one > >> large drive for log.dirs, are there any PROS or CONS between the two > >> (assuming total storage is same in both cases). > >> > >> I don't have access to one drive for log.dirs, but several smaller > >> directories. I just want to ensure that there are no issues. > >> > >> Thanks. > >> > >> -- > >> Raghav > >> > > > > > > > > -- > > Raghav > > > > > > -- > Raghav >
