[GitHub] [hudi] gudladona opened a new issue, #6474: [SUPPORT] Hudi Deltastreamer fails to acquire lock with DynamoDB Lock Provider.

[GitBox]

gudladona opened a new issue, #6474:
URL: https://github.com/apache/hudi/issues/6474

   **Describe the problem you faced**
   
   Hudi Delta streamer (continuous mode) when when restarted after a failure 
fails to ACQUIRE lock. 
   
   Steps to reproduce the behavior:
   
   1. A timeline in the following sequence of operations seems to reproduce 
this behavior
   2. 
   <img width="1456" alt="image" 
src="https://user-images.githubusercontent.com/7864088/186037285-ff85d82b-4cb9-4212-b4b5-cc8ff239dab0.png";>
   
   **Expected behavior**
   
   No lock contention with the lock provider expected.
   
   **Environment Description**
   
   * Hudi version : 0.11.1
   
   * Spark version : 3.1.2
   
   * Storage (HDFS/S3/GCS..) : S3
   
   * Running on Docker? (yes/no) : no
   
   * Async Operations? : CLEAN Auto Clean and incremental cleaning 
enabled(default). 
   
   * Compaction: Disabled (workloads is INSERT only) 
   
   
   **Additional context**
   
   Add any other context about the problem here.
   
   **Stacktrace**
   
   contents of the rollback 
   
   ```
   ❯ java -jar avro-tools-1.7.4.jar tojson 20220822020416059.rollback | jq
   22/08/22 09:34:03 WARN util.NativeCodeLoader: Unable to load native-hadoop 
library for your platform... using builtin-java classes where applicable
   {
     "startRollbackTime": "20220822020416059",
     "timeTakenInMillis": 2,
     "totalFilesDeleted": 0,
     "commitsRollback": [
       "20220822020204383"
     ],
     "partitionMetadata": {},
     "version": {
       "int": 1
     },
     "instantsRollback": [
       {
         "commitTime": "20220822020204383",
         "action": "deltacommit"
       }
     ]
   }```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org