[ https://issues.apache.org/jira/browse/HUDI-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Danny Chen updated HUDI-5487: ----------------------------- Fix Version/s: 0.13.1 > Reduce duplicate Logs in ExternalSpillableMap > --------------------------------------------- > > Key: HUDI-5487 > URL: https://issues.apache.org/jira/browse/HUDI-5487 > Project: Apache Hudi > Issue Type: Improvement > Reporter: dzcxzl > Priority: Minor > Labels: pull-request-available > Fix For: 0.13.1 > > > We see hundreds of thousands of duplicate logs in the executor log. > {code:java} > 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage > 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size > to => 4567 > 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage > 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size > to => 4567 > 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage > 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size > to => 4567 > 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage > 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size > to => 4567 > 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage > 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size > to => 4567 > 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage > 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size > to => 4567 > 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage > 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size > to => 4567 {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)