[jira] [Work logged] (GOBBLIN-1697) Have a separate resource handler to rely on CDC stream to do message forwarding

[ https://issues.apache.org/jira/browse/GOBBLIN-1697?focusedWorklogId=810996&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810996 ] ASF GitHub Bot logged work on GOBBLIN-1697: --- Author: ASF GitHub B

[GitHub] [gobblin] ZihanLi58 merged pull request #3549: [GOBBLIN-1697]Have a separate resource handler to rely on CDC stream to do message forwarding

ZihanLi58 merged PR #3549: URL: https://github.com/apache/gobblin/pull/3549 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@gobblin.apac

[GitHub] [gobblin] ZihanLi58 commented on a diff in pull request #3564: Add `IcebergTableTest` unit test

ZihanLi58 commented on code in PR #3564: URL: https://github.com/apache/gobblin/pull/3564#discussion_r977137351 ## gobblin-data-management/src/test/java/org/apache/gobblin/data/management/copy/iceberg/IcebergTableTest.java: ## @@ -0,0 +1,217 @@ +/* + * Licensed to the Apache Sof

[jira] [Work logged] (GOBBLIN-1705) New Consumer service that processes changes to Flow Spec Store

[ https://issues.apache.org/jira/browse/GOBBLIN-1705?focusedWorklogId=810991&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810991 ] ASF GitHub Bot logged work on GOBBLIN-1705: --- Author: ASF GitHub B

[GitHub] [gobblin] ZihanLi58 commented on a diff in pull request #3557: [GOBBLIN-1705] New consumer service to monitor changes to FlowSpecStore

ZihanLi58 commented on code in PR #3557: URL: https://github.com/apache/gobblin/pull/3557#discussion_r977082376 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/SpecStoreChangeMonitor.java: ## @@ -0,0 +1,158 @@ +/* + * Licensed to the Apache Software Founda

[jira] [Work logged] (GOBBLIN-1709) Create work units for Hive Catalog based Iceberg Datasets to support Distcp for Iceberg

[ https://issues.apache.org/jira/browse/GOBBLIN-1709?focusedWorklogId=810965&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810965 ] ASF GitHub Bot logged work on GOBBLIN-1709: --- Author: ASF GitHub B

[jira] [Work logged] (GOBBLIN-1709) Create work units for Hive Catalog based Iceberg Datasets to support Distcp for Iceberg

[ https://issues.apache.org/jira/browse/GOBBLIN-1709?focusedWorklogId=810966&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810966 ] ASF GitHub Bot logged work on GOBBLIN-1709: --- Author: ASF GitHub B

[GitHub] [gobblin] meethngala commented on a diff in pull request #3560: [GOBBLIN-1709] Create Iceberg Datasets Finder, Iceberg Dataset and FileSet to generate Copy Entities to support Distcp for Iceb

meethngala commented on code in PR #3560: URL: https://github.com/apache/gobblin/pull/3560#discussion_r977068518 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergDataset.java: ## @@ -185,31 +185,28 @@ protected Map getFilePathsToFi

[GitHub] [gobblin] meethngala commented on a diff in pull request #3560: [GOBBLIN-1709] Create Iceberg Datasets Finder, Iceberg Dataset and FileSet to generate Copy Entities to support Distcp for Iceb

meethngala commented on code in PR #3560: URL: https://github.com/apache/gobblin/pull/3560#discussion_r977068365 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergDatasetFinder.java: ## @@ -40,18 +39,20 @@ * and creates a {@link Ic

[jira] [Work logged] (GOBBLIN-1709) Create work units for Hive Catalog based Iceberg Datasets to support Distcp for Iceberg

[ https://issues.apache.org/jira/browse/GOBBLIN-1709?focusedWorklogId=810964&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810964 ] ASF GitHub Bot logged work on GOBBLIN-1709: --- Author: ASF GitHub B

[GitHub] [gobblin] meethngala commented on a diff in pull request #3560: [GOBBLIN-1709] Create Iceberg Datasets Finder, Iceberg Dataset and FileSet to generate Copy Entities to support Distcp for Iceb

meethngala commented on code in PR #3560: URL: https://github.com/apache/gobblin/pull/3560#discussion_r977068142 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergDataset.java: ## @@ -202,14 +202,11 @@ DatasetDescriptor getDestinatio

[jira] [Work logged] (GOBBLIN-1709) Create work units for Hive Catalog based Iceberg Datasets to support Distcp for Iceberg

[ https://issues.apache.org/jira/browse/GOBBLIN-1709?focusedWorklogId=810963&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810963 ] ASF GitHub Bot logged work on GOBBLIN-1709: --- Author: ASF GitHub B

[GitHub] [gobblin] phet commented on a diff in pull request #3560: [GOBBLIN-1709] Create Iceberg Datasets Finder, Iceberg Dataset and FileSet to generate Copy Entities to support Distcp for Iceberg

phet commented on code in PR #3560: URL: https://github.com/apache/gobblin/pull/3560#discussion_r977062551 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergDatasetFinder.java: ## @@ -40,18 +39,20 @@ * and creates a {@link IcebergD

[jira] [Work logged] (GOBBLIN-1696) Build a file-based flowgraph that watches for changes and updates

[ https://issues.apache.org/jira/browse/GOBBLIN-1696?focusedWorklogId=810962&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810962 ] ASF GitHub Bot logged work on GOBBLIN-1696: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3548: [GOBBLIN-1696] Implement file based flowgraph that detects changes to the underlying…

Will-Lo commented on code in PR #3548: URL: https://github.com/apache/gobblin/pull/3548#discussion_r977047491 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/FsFlowGraphMonitor.java: ## @@ -0,0 +1,134 @@ +/* + * Licensed to the Apache Software Foundation (

[jira] [Work logged] (GOBBLIN-1696) Build a file-based flowgraph that watches for changes and updates

[ https://issues.apache.org/jira/browse/GOBBLIN-1696?focusedWorklogId=810961&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810961 ] ASF GitHub Bot logged work on GOBBLIN-1696: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3548: [GOBBLIN-1696] Implement file based flowgraph that detects changes to the underlying…

Will-Lo commented on code in PR #3548: URL: https://github.com/apache/gobblin/pull/3548#discussion_r977047298 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/FsFlowGraphMonitor.java: ## @@ -0,0 +1,134 @@ +/* + * Licensed to the Apache Software Foundation (

[jira] [Work logged] (GOBBLIN-1696) Build a file-based flowgraph that watches for changes and updates

[ https://issues.apache.org/jira/browse/GOBBLIN-1696?focusedWorklogId=810959&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810959 ] ASF GitHub Bot logged work on GOBBLIN-1696: --- Author: ASF GitHub B

[jira] [Work logged] (GOBBLIN-1696) Build a file-based flowgraph that watches for changes and updates

[ https://issues.apache.org/jira/browse/GOBBLIN-1696?focusedWorklogId=810960&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810960 ] ASF GitHub Bot logged work on GOBBLIN-1696: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3548: [GOBBLIN-1696] Implement file based flowgraph that detects changes to the underlying…

Will-Lo commented on code in PR #3548: URL: https://github.com/apache/gobblin/pull/3548#discussion_r977046288 ## gobblin-utility/src/main/java/org/apache/gobblin/util/filesystem/ExceptionCatchingPathAlterationListenerDecorator.java: ## @@ -42,73 +45,83 @@ public Object getDecora

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3548: [GOBBLIN-1696] Implement file based flowgraph that detects changes to the underlying…

Will-Lo commented on code in PR #3548: URL: https://github.com/apache/gobblin/pull/3548#discussion_r977046165 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/FsFlowGraphMonitor.java: ## @@ -0,0 +1,134 @@ +/* + * Licensed to the Apache Software Foundation (

[jira] [Work logged] (GOBBLIN-1705) New Consumer service that processes changes to Flow Spec Store

[ https://issues.apache.org/jira/browse/GOBBLIN-1705?focusedWorklogId=810954&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810954 ] ASF GitHub Bot logged work on GOBBLIN-1705: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3557: [GOBBLIN-1705] New consumer service to monitor changes to FlowSpecStore

Will-Lo commented on code in PR #3557: URL: https://github.com/apache/gobblin/pull/3557#discussion_r977013672 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/SpecStoreChangeMonitor.java: ## @@ -0,0 +1,159 @@ +/* + * Licensed to the Apache Software Foundati

[jira] [Work logged] (GOBBLIN-1704) Purge offline helix instances during startup

[ https://issues.apache.org/jira/browse/GOBBLIN-1704?focusedWorklogId=810912&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810912 ] ASF GitHub Bot logged work on GOBBLIN-1704: --- Author: ASF GitHub B

[GitHub] [gobblin] homatthew commented on a diff in pull request #3561: [GOBBLIN-1704] Purge offline helix instances during startup

homatthew commented on code in PR #3561: URL: https://github.com/apache/gobblin/pull/3561#discussion_r976834480 ## gobblin-yarn/src/main/java/org/apache/gobblin/yarn/HelixInstancePurgerWithMetrics.java: ## @@ -0,0 +1,140 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[jira] [Work logged] (GOBBLIN-1704) Purge offline helix instances during startup

[ https://issues.apache.org/jira/browse/GOBBLIN-1704?focusedWorklogId=810911&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810911 ] ASF GitHub Bot logged work on GOBBLIN-1704: --- Author: ASF GitHub B

[GitHub] [gobblin] umustafi commented on a diff in pull request #3561: [GOBBLIN-1704] Purge offline helix instances during startup

umustafi commented on code in PR #3561: URL: https://github.com/apache/gobblin/pull/3561#discussion_r976824839 ## gobblin-yarn/src/main/java/org/apache/gobblin/yarn/HelixInstancePurgerWithMetrics.java: ## @@ -0,0 +1,140 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Work logged] (GOBBLIN-1705) New Consumer service that processes changes to Flow Spec Store

[ https://issues.apache.org/jira/browse/GOBBLIN-1705?focusedWorklogId=810908&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810908 ] ASF GitHub Bot logged work on GOBBLIN-1705: --- Author: ASF GitHub B

[GitHub] [gobblin] umustafi commented on a diff in pull request #3557: [GOBBLIN-1705] New consumer service to monitor changes to FlowSpecStore

umustafi commented on code in PR #3557: URL: https://github.com/apache/gobblin/pull/3557#discussion_r976814946 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/SpecStoreChangeMonitor.java: ## @@ -0,0 +1,159 @@ +/* + * Licensed to the Apache Software Foundat

[jira] [Work logged] (GOBBLIN-1705) New Consumer service that processes changes to Flow Spec Store

[ https://issues.apache.org/jira/browse/GOBBLIN-1705?focusedWorklogId=810907&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810907 ] ASF GitHub Bot logged work on GOBBLIN-1705: --- Author: ASF GitHub B

[GitHub] [gobblin] umustafi commented on a diff in pull request #3557: [GOBBLIN-1705] New consumer service to monitor changes to FlowSpecStore

umustafi commented on code in PR #3557: URL: https://github.com/apache/gobblin/pull/3557#discussion_r976813045 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/SpecStoreChangeMonitor.java: ## @@ -0,0 +1,159 @@ +/* + * Licensed to the Apache Software Foundat