[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1305303946 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/LSMTimeline.java: ## @@ -0,0 +1,285 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1305300170 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/LSMTimeline.java: ## @@ -0,0 +1,285 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1305108862 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java: ## @@ -424,9 +159,7 @@ private Stream getCommitInstantsToArchive()

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1305083315 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ActiveAction.java: ## @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1305073510 ## hudi-common/src/main/avro/HoodieLSMTimelineInstant.avsc: ## @@ -0,0 +1,49 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288283343 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,127 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288178605 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288171581 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288170683 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288167338 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288155900 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288155900 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288154950 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288147702 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288140061 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288119597 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288113616 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ArchivedTimelineWriter.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288095424 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/LegacyArchivedMetaEntryReader.java: ## @@ -0,0 +1,258 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1288092558 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -184,203 +222,327 @@ public HoodieArchivedTimeline reload() {

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287896192 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/LegacyArchivedMetaEntryReader.java: ## @@ -0,0 +1,258 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287895034 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/LegacyArchivedMetaEntryReader.java: ## @@ -0,0 +1,258 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287894094 ## hudi-common/src/test/java/org/apache/hudi/common/testutils/FileCreateUtils.java: ## @@ -278,29 +278,16 @@ public static void createRestoreFile(String basePath,

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287892832 ## hudi-common/src/main/java/org/apache/hudi/common/util/ArchivedInstantReadSchemas.java: ## @@ -0,0 +1,105 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287878544 ## hudi-common/src/main/java/org/apache/hudi/common/model/HoodieArchivedManifest.java: ## @@ -0,0 +1,132 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287876922 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/LegacyArchivedMetaEntryReader.java: ## @@ -0,0 +1,258 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287874876 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java: ## @@ -603,53 +327,4 @@ private boolean deleteArchivedInstants(List

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287874128 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java: ## @@ -493,17 +224,18 @@ private Stream

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287870522 ## hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java: ## @@ -846,6 +846,50 @@ public static List getFileStatusAtLevel( return result; } + /**

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287865885 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287854438 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ActiveInstant.java: ## @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287850688 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java: ## @@ -164,230 +100,27 @@ public boolean

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1287849911 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/execution/benchmark/ArchivedTimelineReadBenchmark.scala: ## @@ -0,0 +1,97 @@ +/* + * Licensed to

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1280276081 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1280276081 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1280271723 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1280269996 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1280268703 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1280262854 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1278789233 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ActiveInstant.java: ## @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1278797024 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1278794293 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1278793361 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1278791765 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1278790941 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1278790424 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieArchivedTimeline.java: ## @@ -18,75 +18,125 @@ package

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1278789233 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ActiveInstant.java: ## @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] danny0405 commented on a diff in pull request #9209: [HUDI-6539] New LSM tree style archived timeline

danny0405 commented on code in PR #9209: URL: https://github.com/apache/hudi/pull/9209#discussion_r1278788392 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/ActiveInstant.java: ## @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache Software Foundation