Hi,
1.checkpoint会强制滚动
2.目前最简单的思路是加大checkpoint interval，另一个思路是在partition commit时触发hive去compaction。
3.success文件的生成依赖checkpoint interval，所以会有一定延迟。
Best,
Jingsong
On Thu, Jul 30, 2020 at 1:14 PM kandy.wang wrote:
> 现象：
> CREATE TABLE test.xxx_5min (
>
> ..
>
> ) PARTITIONED BY (dt string , hm
现象：
CREATE TABLE test.xxx_5min (
..
) PARTITIONED BY (dt string , hm string) stored as orc TBLPROPERTIES(
'sink.partition-commit.trigger'='process-time',
'sink.partition-commit.delay'='5 min',
'sink.partition-commit.policy.kind'='metastore,success-file',
