[ceph-users] Re: [Suspicious newsletter] Re: Rbd pool shows 458GB USED but the image is empty

2021-01-28 Thread Eugen Block 

Ah, in that case you might want to sparsify the image:

rbd sparsify /


Zitat von "Szabo, Istvan (Agoda)" :


I mean the image hasn’t been deleted, but the content from the image.

Istvan Szabo
Senior Infrastructure Engineer
---
Agoda Services Co., Ltd.
e: istvan.sz...@agoda.com
---

On 2021. Jan 28., at 18:21, Eugen Block  wrote:

Email received from outside the company. If in doubt don't click  
links nor open attachments!



The image is probably still in the trash, I assume.

rbd -p  trash ls

Zitat von "Szabo, Istvan (Agoda)" :

Hi,

We have a pool where the user has 2 image.
They cleaned up the images, no snaphot in it, but when I see ceph df
detail it still shows 458GB in the first column.
Why?

Thanks


This message is confidential and is for the sole use of the intended
recipient(s). It may also be privileged or otherwise protected by
copyright or other legal rules. If you have received it by mistake
please let us know by reply email and delete it from your system. It
is prohibited to copy this message or disclose its content to
anyone. Any confidentiality or privilege is not waived or lost by
any mistaken delivery or unauthorized disclosure of the message. All
messages sent to and from Agoda may be monitored to ensure
compliance with company policies, to protect the company's interests
and to remove potential malware. Electronic messages may be
intercepted, amended, lost or deleted, or contain viruses.
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


This message is confidential and is for the sole use of the intended  
recipient(s). It may also be privileged or otherwise protected by  
copyright or other legal rules. If you have received it by mistake  
please let us know by reply email and delete it from your system. It  
is prohibited to copy this message or disclose its content to  
anyone. Any confidentiality or privilege is not waived or lost by  
any mistaken delivery or unauthorized disclosure of the message. All  
messages sent to and from Agoda may be monitored to ensure  
compliance with company policies, to protect the company's interests  
and to remove potential malware. Electronic messages may be  
intercepted, amended, lost or deleted, or contain viruses.



___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: [Suspicious newsletter] Re: Rbd pool shows 458GB USED but the image is empty

2021-01-28 Thread Burkhard Linke 

Hi,

On 28.01.21 13:21, Szabo, Istvan (Agoda) wrote:

I mean the image hasn’t been deleted, but the content from the image.



RBD is (as the name implies) is a block device layer. Block devices do 
not have a concept of content, file, directories or even allocated or 
unallocated space. They are just continuous byte streams with a certain 
size.



The _filesystem_ on top of the block device implements these concepts, 
and also tracks free / unallocated space. And a filesystem is able to 
inform the block layer about allocations using TRIM and DISCARD calls 
(e.g. tools like fstrim or corresponding mount options). RBD usually 
supports trim operation in recent kernels (krbd) or with certain 
configuration options (librbd)



Regards,

Burkhard

___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: [Suspicious newsletter] Re: Rbd pool shows 458GB USED but the image is empty

2021-01-28 Thread Szabo, Istvan (Agoda) 
I mean the image hasn’t been deleted, but the content from the image.

Istvan Szabo
Senior Infrastructure Engineer
---
Agoda Services Co., Ltd.
e: istvan.sz...@agoda.com
---

On 2021. Jan 28., at 18:21, Eugen Block  wrote:

Email received from outside the company. If in doubt don't click links nor 
open attachments!


The image is probably still in the trash, I assume.

rbd -p  trash ls

Zitat von "Szabo, Istvan (Agoda)" :

Hi,

We have a pool where the user has 2 image.
They cleaned up the images, no snaphot in it, but when I see ceph df
detail it still shows 458GB in the first column.
Why?

Thanks


This message is confidential and is for the sole use of the intended
recipient(s). It may also be privileged or otherwise protected by
copyright or other legal rules. If you have received it by mistake
please let us know by reply email and delete it from your system. It
is prohibited to copy this message or disclose its content to
anyone. Any confidentiality or privilege is not waived or lost by
any mistaken delivery or unauthorized disclosure of the message. All
messages sent to and from Agoda may be monitored to ensure
compliance with company policies, to protect the company's interests
and to remove potential malware. Electronic messages may be
intercepted, amended, lost or deleted, or contain viruses.
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


This message is confidential and is for the sole use of the intended 
recipient(s). It may also be privileged or otherwise protected by copyright or 
other legal rules. If you have received it by mistake please let us know by 
reply email and delete it from your system. It is prohibited to copy this 
message or disclose its content to anyone. Any confidentiality or privilege is 
not waived or lost by any mistaken delivery or unauthorized disclosure of the 
message. All messages sent to and from Agoda may be monitored to ensure 
compliance with company policies, to protect the company's interests and to 
remove potential malware. Electronic messages may be intercepted, amended, lost 
or deleted, or contain viruses.
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: [Suspicious newsletter] Re: Rbd pool shows 458GB USED but the image is empty

2021-01-28 Thread Szabo, Istvan (Agoda) 
Does this mean the space is allocated, but actually empty so can let’s say 
overwrite?

Istvan Szabo
Senior Infrastructure Engineer
---
Agoda Services Co., Ltd.
e: istvan.sz...@agoda.com
---

On 2021. Jan 28., at 19:51, Burkhard Linke 
 wrote:

Email received from outside the company. If in doubt don't click links nor 
open attachments!


Hi,

On 28.01.21 13:21, Szabo, Istvan (Agoda) wrote:
I mean the image hasn’t been deleted, but the content from the image.


RBD is (as the name implies) is a block device layer. Block devices do
not have a concept of content, file, directories or even allocated or
unallocated space. They are just continuous byte streams with a certain
size.


The _filesystem_ on top of the block device implements these concepts,
and also tracks free / unallocated space. And a filesystem is able to
inform the block layer about allocations using TRIM and DISCARD calls
(e.g. tools like fstrim or corresponding mount options). RBD usually
supports trim operation in recent kernels (krbd) or with certain
configuration options (librbd)


Regards,

Burkhard

___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io


This message is confidential and is for the sole use of the intended 
recipient(s). It may also be privileged or otherwise protected by copyright or 
other legal rules. If you have received it by mistake please let us know by 
reply email and delete it from your system. It is prohibited to copy this 
message or disclose its content to anyone. Any confidentiality or privilege is 
not waived or lost by any mistaken delivery or unauthorized disclosure of the 
message. All messages sent to and from Agoda may be monitored to ensure 
compliance with company policies, to protect the company's interests and to 
remove potential malware. Electronic messages may be intercepted, amended, lost 
or deleted, or contain viruses.
___
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io