回复：Architecture Advice: Best practices for consuming Kafka streams into Impala at 500k QPS

Tue, 13 Jan 2026 00:49:07 -0800 

We look forward to receiving your suggestions


         原始邮件
         
       
发件人：汲广熙 <[email protected]&gt;
发件时间：2026年1月12日 14:29
收件人：dev <[email protected]&gt;
主题：Architecture Advice: Best practices for consuming Kafka streams into Impala 
at 500k QPS




Hi Impala Devs,

I am planning a production pipeline to ingest data from Kafka into 
Impala&nbsp;with a high throughput of approximately 500,000 QPS. Given the 
metadata overhead and file management constraints in Impala, I would like to 
get your recommendations on the most robust architecture.

My Current Environment:


Impala Version:&nbsp;4.5.0



Storage:&nbsp;Tencent Cloud COS (Object Storage)



Table Format:&nbsp;Apache Iceberg

Reply via email to