[
https://issues.apache.org/jira/browse/KYLIN-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930052#comment-17930052
]
ASF subversion and git services commented on KYLIN-6025:
--------------------------------------------------------
Commit 1b3d5d56ce8612e228c0807536033ffaad60fa16 in kylin's branch
refs/heads/kylin5 from Zhiting Guo
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=1b3d5d56ce ]
KYLIN-6025 sort data to avoid too much data folder for internal table
> Support file merging within partitions for internal tables
> ----------------------------------------------------------
>
> Key: KYLIN-6025
> URL: https://issues.apache.org/jira/browse/KYLIN-6025
> Project: Kylin
> Issue Type: New Feature
> Affects Versions: 5.0.0
> Reporter: Guoliang Sun
> Priority: Major
>
> When multiple tasks write to the same internal table partition during the
> build phase, the data is written into multiple subdirectories, which can
> easily lead to an excessive number of files and increase HDFS pressure. A
> reasonable merging mechanism is needed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
