Re: GDPR compliance

2023-11-29 Thread Ilan Ginzburg
the policy but I think something like "I need my >>> data to be gone in next 2 second" is unreasonable. >>> >>> Tony X >>> >>> -- >>> *From:* Robert Muir >>> *Sent:* Tuesday, November 28, 2023 11:52 AM >>> *To:* dev@lu

Re: GDPR compliance

2023-11-29 Thread Michael Sokolov
>> data to be gone in next 2 second" is unreasonable. >> >> Tony X >> >> -- >> *From:* Robert Muir >> *Sent:* Tuesday, November 28, 2023 11:52 AM >> *To:* dev@lucene.apache.org >> *Subject:* Re: GDPR compliance >> >> I don&#x

Re: GDPR compliance

2023-11-28 Thread Patrick Zhai
st to take > place? > > I'm not expert about the policy but I think something like "I need my data > to be gone in next 2 second" is unreasonable. > > Tony X > > -- > *From:* Robert Muir > *Sent:* Tuesday, November 28, 2023 11:52 AM

Re: GDPR compliance

2023-11-28 Thread Patrick Zhai
Thanks Robert and Dawid, I think what you said is reasonable to me, I can keep the MP private then I guess(and it's not hard to code it out anyway so I guess people can still figure it out easily if they're facing a similar situation). For our case I think we do have some other constraints so we ha

Re: GDPR compliance

2023-11-28 Thread Robert Muir
and if you delete those segments, will that data ever be actually removed from the underlying physical storage? equally uncertain. deleting a file from the filesystem is similar to what lucene is doing, it doesn't really delete anything from the disk, just allows it to be overwritten by future wri

Re: GDPR compliance

2023-11-28 Thread Dongyu Xu
ber 28, 2023 11:52 AM To: dev@lucene.apache.org Subject: Re: GDPR compliance I don't think there's any problem with GDPR, and I don't think users should be running unnecessary "optimize". GDRP just says data should be erased without "undue" delay. waiting for a m

Re: GDPR compliance

2023-11-28 Thread Ilan Ginzburg
Are larger and older segments even certain to ever be merged in practice? I was assuming that if there is not a lot of new indexed content and not a lot of older documents being deleted, large older segment might never have to be merged. On Tue 28 Nov 2023 at 20:53, Robert Muir wrote: > I don't

Re: GDPR compliance

2023-11-28 Thread Robert Muir
I don't think there's any problem with GDPR, and I don't think users should be running unnecessary "optimize". GDRP just says data should be erased without "undue" delay. waiting for a merge to nuke the deleted docs isn't "undue", there is a good reason for it. On Tue, Nov 28, 2023 at 2:40 PM Patr

GDPR compliance

2023-11-28 Thread Patrick Zhai
Hi Folks, In LinkedIn we need to comply with GDPR for a large part of our data, and an important part of it is that we need to be sure we have completely deleted the data the user requested to delete within a certain period of time. The way we have come up with so far is to: 1. Record the segment c