[GitHub] [hudi] nylqd commented on issue #9162: [SUPPORT] Permission denied access ckp_meta while start flink job

2023-07-11 Thread via GitHub 


nylqd commented on issue #9162:
URL: https://github.com/apache/hudi/issues/9162#issuecomment-1631793719

   > @nylqd Can you please share the permissions for all directories under:
   > 
   > 
   > 
   > ```
   > 
   > /path_to_hudi_table/.hoodie/.aux/ckp_meta/.
   > 
   > ```
   > 
   > 
   > 
   > When restarting a job, under normal conditions, the `ckp_meta` is deleted 
and recreated again. 
   > 
   > 
   > 
   > The code (from master branch, iiuc, the code for this section hasn't 
changed that much since 0.11) for it is shown below:
   > 
   > 
   > 
   > https://github.com/apache/hudi/assets/6312314/bbf1884c-7daa-45e7-9624-e292c529c9e9;>
   > 
   > 
   > 
   > This is how mkdirs is implemented
   > 
   > 
   > 
   > https://github.com/apache/hudi/assets/6312314/20772086-7a6c-40b5-a812-bd1d7d4fa1be;>
   > 
   > 
   > 
   > Of which the default permissions of 777 is used
   > 
   > https://github.com/apache/hudi/assets/6312314/c4204d06-1ca6-4c86-b9b8-7419f87d8968;>
   
   this aux dir while job is running
   
   
![image](https://github.com/apache/hudi/assets/3632490/63108195-e046-4a69-828a-6588aa862095)
   
   after stop the job
   
   
![image](https://github.com/apache/hudi/assets/3632490/2ec6321d-5cf3-4141-8c48-ddf34995e79a)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [hudi] nylqd commented on issue #9162: [SUPPORT] Permission denied access ckp_meta while start flink job

2023-07-10 Thread via GitHub 


nylqd commented on issue #9162:
URL: https://github.com/apache/hudi/issues/9162#issuecomment-1630060302

   > Are you restarting the job with the hadoop user that you initially created 
the table with? If not, possible to ensure that the job is started with the 
same hadoop user as the one that you created the table with?
   
   we do steps as follow:
   
   1. submit flink job w/ hadoop user A
   2. cancel with savepoints use rest api
   3. start job with savepoint from step 1 (same hadoop user A)
   
   then we got permission problem, `AccessControlException: Permission denied: 
user=A, 
access=ALL,inode="/path_to_hudi_table/.hoodie/.aux/ckp_meta":A:hadoop:drw---`
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org