Re: Monitoring HDFS filesystem changes

2023-02-15 Thread phiroc 
Many thanks, Wei-Chiu.

- Mail original -
De: "Wei-Chiu Chuang" 
À: phi...@free.fr
Cc: user@hadoop.apache.org
Envoyé: Mercredi 15 Février 2023 16:50:44
Objet: Re: Monitoring HDFS filesystem changes


Use the inotify api 


https://dev-listener.medium.com/watch-for-changes-in-hdfs-800c6fb5481f 

https://github.com/onefoursix/hdfs-inotify-example/blob/master/src/main/java/com/onefoursix/HdfsINotifyExample.java
 





On Wed, Feb 15, 2023 at 1:12 AM < phi...@free.fr > wrote: 


Hello, 
is there an efficient way to monitoring the HDFS Filesystem for owner-right 
changes? 
For instance, let's say the /a/b/c/d HDFS Directory's owner is called user1. 
However, overnight, the owner changed for some unknown reason. 
How can I monitor the /a/b/c/d directory and determine what caused the owner to 
change? 
Many thanks. 
Best regards, 
Philippe 


- 
To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org 
For additional commands, e-mail: user-h...@hadoop.apache.org 


-
To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org
For additional commands, e-mail: user-h...@hadoop.apache.org

Re: Monitoring HDFS filesystem changes

2023-02-15 Thread Wei-Chiu Chuang 
Use the inotify api

https://dev-listener.medium.com/watch-for-changes-in-hdfs-800c6fb5481f
https://github.com/onefoursix/hdfs-inotify-example/blob/master/src/main/java/com/onefoursix/HdfsINotifyExample.java


On Wed, Feb 15, 2023 at 1:12 AM  wrote:

> Hello,
> is there an efficient way to monitoring the HDFS Filesystem for
> owner-right changes?
> For instance, let's say the /a/b/c/d HDFS Directory's owner is called
> user1.
> However, overnight, the owner changed for some unknown reason.
> How can I monitor the /a/b/c/d directory and determine what caused the
> owner to change?
> Many thanks.
> Best regards,
> Philippe
>
>
> -
> To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: user-h...@hadoop.apache.org
>
>

Re: Monitoring HDFS filesystem changes

2023-02-15 Thread Ayush Saxena 
Hey,
The best I know you can check in the HDFS Audit logs. Just copying a sample
entry,

2023-02-15 14:47:30,679 [IPC Server handler 1 on default port 59514] INFO
 FSNamesystem.audit (FSNamesystem.java:logAuditMessage(8852)) -
allowed=true ugi=ayushsaxena (auth:SIMPLE) ip=localhost/127.0.0.1
cmd=setOwner src=/test dst=null perm=Ayush:Hadoop:rwxr-xr-x proto=rpc

This is what you can get from there
-Ayush

On Wed, 15 Feb 2023 at 14:42,  wrote:

> Hello,
> is there an efficient way to monitoring the HDFS Filesystem for
> owner-right changes?
> For instance, let's say the /a/b/c/d HDFS Directory's owner is called
> user1.
> However, overnight, the owner changed for some unknown reason.
> How can I monitor the /a/b/c/d directory and determine what caused the
> owner to change?
> Many thanks.
> Best regards,
> Philippe
>
>
> -
> To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: user-h...@hadoop.apache.org
>
>