[GitHub] [incubator-druid] himanshug commented on issue #7736: Druid keep using segment from the segment-cache the one not exists on deep storage anymore
himanshug commented on issue #7736: Druid keep using segment from the segment-cache the one not exists on deep storage anymore URL: https://github.com/apache/incubator-druid/issues/7736#issuecomment-497840108 > If you try to reproduce the case above you will see that. At least I hope for that. I trust you on that and agree that will happen. This is the expected/current behavior in Druid and AFAIK it would not be possible to change that and guarantee that queries/consoles would immediately stop recognizing deleted segments. on this, you probably would need to adjust your use case such that above guarantee is not necessary. I can try to offer workarounds if you describe your use case or business problem. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
[GitHub] [incubator-druid] himanshug commented on issue #7736: Druid keep using segment from the segment-cache the one not exists on deep storage anymore
himanshug commented on issue #7736: Druid keep using segment from the segment-cache the one not exists on deep storage anymore URL: https://github.com/apache/incubator-druid/issues/7736#issuecomment-495734214 yes, you can see the coordinator logs printed for corresponding segment name , as coordinator does stuff they would show up there. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
[GitHub] [incubator-druid] himanshug commented on issue #7736: Druid keep using segment from the segment-cache the one not exists on deep storage anymore
himanshug commented on issue #7736: Druid keep using segment from the segment-cache the one not exists on deep storage anymore URL: https://github.com/apache/incubator-druid/issues/7736#issuecomment-495353746 sounds like expected behavior: it takes time for coordinator to notice removal of a segment in metadataStore and then asking the historical node to drop a segment, it should go away after a while. if it never goes away then there is something fishy going on. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
