[ https://issues.apache.org/jira/browse/HDDS-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sammi Chen updated HDDS-3943: ----------------------------- Description: Here is the log after datanode restart. One thing actullay I'd like to know is why these are empty directories. 2020-07-07 22:53:55,716 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 37711 2020-07-07 22:53:55,716 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 37430 2020-07-07 22:53:55,716 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 37528 2020-07-07 22:53:55,716 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 105470 2020-07-07 22:53:55,716 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 94705 2020-07-07 22:53:55,716 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 70861 2020-07-07 22:53:55,716 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 26296 2020-07-07 22:53:55,717 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 26440 2020-07-07 22:53:55,717 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 13725 2020-07-07 22:53:55,717 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 13639 2020-07-07 22:53:55,717 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 70989 2020-07-07 22:53:55,718 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 71111 2020-07-07 22:53:55,718 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 71030 2020-07-07 22:53:55,718 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 9801 2020-07-07 22:53:55,718 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 109694 2020-07-07 22:53:55,719 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 15166 2020-07-07 22:53:55,720 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 79205 2020-07-07 22:53:55,720 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 78877 2020-07-07 22:53:55,721 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 102541 2020-07-07 22:53:55,722 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 94557 2020-07-07 22:53:55,723 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87951 2020-07-07 22:53:55,724 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87865 2020-07-07 22:53:55,724 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87752 2020-07-07 22:53:55,724 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87578 2020-07-07 22:53:55,724 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87935 2020-07-07 22:53:55,724 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87870 2020-07-07 22:53:55,724 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 55222 2020-07-07 22:53:55,725 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 70266 2020-07-07 22:53:55,725 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 55148 2020-07-07 22:53:55,725 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 70472 2020-07-07 22:53:55,725 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 70291 2020-07-07 22:53:55,725 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 32741 2020-07-07 22:53:55,726 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 32490 2020-07-07 22:53:55,726 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 32762 2020-07-07 22:53:55,727 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 20787 was: 2020-07-07 22:53:55,716 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 37711 2020-07-07 22:53:55,716 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 37430 2020-07-07 22:53:55,716 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 37528 2020-07-07 22:53:55,716 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 105470 2020-07-07 22:53:55,716 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 94705 2020-07-07 22:53:55,716 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 70861 2020-07-07 22:53:55,716 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 26296 2020-07-07 22:53:55,717 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 26440 2020-07-07 22:53:55,717 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 13725 2020-07-07 22:53:55,717 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 13639 2020-07-07 22:53:55,717 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 70989 2020-07-07 22:53:55,718 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 71111 2020-07-07 22:53:55,718 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 71030 2020-07-07 22:53:55,718 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 9801 2020-07-07 22:53:55,718 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 109694 2020-07-07 22:53:55,719 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 15166 2020-07-07 22:53:55,720 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 79205 2020-07-07 22:53:55,720 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 78877 2020-07-07 22:53:55,721 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 102541 2020-07-07 22:53:55,722 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 94557 2020-07-07 22:53:55,723 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87951 2020-07-07 22:53:55,724 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87865 2020-07-07 22:53:55,724 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87752 2020-07-07 22:53:55,724 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87578 2020-07-07 22:53:55,724 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87935 2020-07-07 22:53:55,724 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 87870 2020-07-07 22:53:55,724 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 55222 2020-07-07 22:53:55,725 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 70266 2020-07-07 22:53:55,725 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 55148 2020-07-07 22:53:55,725 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 70472 2020-07-07 22:53:55,725 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 70291 2020-07-07 22:53:55,725 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 32741 2020-07-07 22:53:55,726 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 32490 2020-07-07 22:53:55,726 [Thread-5] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 32762 2020-07-07 22:53:55,727 [Thread-13] ERROR org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing .container file for ContainerID: 20787 > Cleanup empty container directory > --------------------------------- > > Key: HDDS-3943 > URL: https://issues.apache.org/jira/browse/HDDS-3943 > Project: Hadoop Distributed Data Store > Issue Type: Improvement > Reporter: Sammi Chen > Priority: Major > > Here is the log after datanode restart. > One thing actullay I'd like to know is why these are empty directories. > 2020-07-07 22:53:55,716 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 37711 > 2020-07-07 22:53:55,716 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 37430 > 2020-07-07 22:53:55,716 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 37528 > 2020-07-07 22:53:55,716 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 105470 > 2020-07-07 22:53:55,716 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 94705 > 2020-07-07 22:53:55,716 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 70861 > 2020-07-07 22:53:55,716 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 26296 > 2020-07-07 22:53:55,717 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 26440 > 2020-07-07 22:53:55,717 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 13725 > 2020-07-07 22:53:55,717 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 13639 > 2020-07-07 22:53:55,717 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 70989 > 2020-07-07 22:53:55,718 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 71111 > 2020-07-07 22:53:55,718 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 71030 > 2020-07-07 22:53:55,718 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 9801 > 2020-07-07 22:53:55,718 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 109694 > 2020-07-07 22:53:55,719 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 15166 > 2020-07-07 22:53:55,720 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 79205 > 2020-07-07 22:53:55,720 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 78877 > 2020-07-07 22:53:55,721 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 102541 > 2020-07-07 22:53:55,722 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 94557 > 2020-07-07 22:53:55,723 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 87951 > 2020-07-07 22:53:55,724 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 87865 > 2020-07-07 22:53:55,724 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 87752 > 2020-07-07 22:53:55,724 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 87578 > 2020-07-07 22:53:55,724 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 87935 > 2020-07-07 22:53:55,724 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 87870 > 2020-07-07 22:53:55,724 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 55222 > 2020-07-07 22:53:55,725 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 70266 > 2020-07-07 22:53:55,725 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 55148 > 2020-07-07 22:53:55,725 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 70472 > 2020-07-07 22:53:55,725 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 70291 > 2020-07-07 22:53:55,725 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 32741 > 2020-07-07 22:53:55,726 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 32490 > 2020-07-07 22:53:55,726 [Thread-5] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 32762 > 2020-07-07 22:53:55,727 [Thread-13] ERROR > org.apache.hadoop.ozone.container.ozoneimpl.ContainerReader: Missing > .container file for ContainerID: 20787 -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org