On occasion, I've deleted a few TB of stuff in DFS at once. I've noticed that when I do this, datanodes start taking a really long time to check in and ultimately get marked dead. Some time later, they'll get done deleting stuff and come back and get unmarked.

I'm wondering, why do deletions get more priority than checking in? Ideally we would never see "dead" datanodes from doing deletes.

-Bryan

Reply via email to