Hi Peter, Thanks for your response, we have the following configuration:
Partition count=4 Replication factor=3 All four brokers have topics-partitions in /data/1/kafka/data and are receiving data. Each server has 6 x 2TB disks for kaka data. Many Thanks, Chris > On 16 Sep 2022, at 1:56 am, Peter Bukowinski <pmb...@gmail.com> wrote: > > Hi Chris, > > Can you share the partition count and replication factor of your partitions? > Also, do all four brokers contain topic-partition directories in > /data/1/kafka/data or just a single broker? Depending on your topic config, > it may be entirely normal that his has happened. > > > — > Peter Bukowinski > >> On Sep 15, 2022, at 3:35 AM, Chris Peart <ch...@peart.me.uk> wrote: >> >> >> >> Hi All, >> >> I have a 4 node kafka cluster running version 2.8.1, we have started pushing >> data to the cluster but can only see one disk being used. >> >> We had 6 disk configured as non-raid and 1 partition per disk, we have the >> following in fstab: >> >> /dev/mapper/VolGroup01-data /data/1 xfs nodev,noatime,nofail 1 2 >> >> /dev/mapper/VolGroup02-data /data/2 xfs nodev,noatime,nofail 1 2 >> >> /dev/mapper/VolGroup03-data /data/3 xfs nodev,noatime,nofail 1 2 >> >> /dev/mapper/VolGroup04-data /data/4 xfs nodev,noatime,nofail 1 2 >> >> /dev/mapper/VolGroup05-data /data/5 xfs nodev,noatime,nofail 1 2 >> >> /dev/mapper/VolGroup06-data /data/6 xfs nodev,noatime,nofail 1 2 >> >> We configured server.properties to be: >> log.dirs=/data/1/kafka/data,/data/2/kafka/data,/data/3/kafka/data,/data/4/kafka/data,/data/5/kafka/data,/data/6/kafka/data >> >> i can see all our topics in /data/1/kafka/data but don't see anything in >> /data/2-5 >> >> Any help would be appreciated as this is going to production next week? >> >> Many Thanks, >> >> Chris >
