[
https://issues.apache.org/jira/browse/KAFKA-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574281#comment-16574281
]
fangbin sun commented on KAFKA-7262:
------------------------------------
[~huxi_2b] Maybe we need "topic-isolation", key topic-partition distributes to
SSD-mounted directories, the others to HDD-mounted directories. As Kafka ensure
that number of partitions is evenly distributed across the disks, a large
amount of partitions should be moved back and forth between SSD and HDDs. It's
a huge amount of work especially with numerous brokers and partitions.
> Ability to support heterogeneous storage in Kafka
> -------------------------------------------------
>
> Key: KAFKA-7262
> URL: https://issues.apache.org/jira/browse/KAFKA-7262
> Project: Kafka
> Issue Type: Improvement
> Components: log
> Affects Versions: 2.0.0
> Reporter: fangbin sun
> Priority: Major
>
> Currently we have a batch of servers, each broker has one SSD (1.5T) and ten
> HDDs (10T). For all I know, Kafka itself doesn't know much about the
> underlying hardware, it chooses the directory with the least number of
> partitions when creating a topic-partition.
> Is it possible to deploy a heterogeneous cluster for taking advantage of SSD
> with smaller disk capacity? Hope you all consider this. Any insights or
> guidance would be greatly appreciated.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
