[jira] [Work logged] (GOBBLIN-1697) Have a separate resource handler to rely on CDC stream to do message forwarding

[ https://issues.apache.org/jira/browse/GOBBLIN-1697?focusedWorklogId=810593&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810593 ] ASF GitHub Bot logged work on GOBBLIN-1697: --- Author: ASF GitHub B

[GitHub] [gobblin] ZihanLi58 commented on pull request #3549: [GOBBLIN-1697]Have a separate resource handler to rely on CDC stream to do message forwarding

ZihanLi58 commented on PR #3549: URL: https://github.com/apache/gobblin/pull/3549#issuecomment-1253149496 > @arjun4084346 I don't think that will break anything, but it will require some refractor on the old API and I do see we had assumption in a lot places that update is same as

[jira] [Work logged] (GOBBLIN-1706) Add DagActionStore to store the action to kill/resume one flow execution

[ https://issues.apache.org/jira/browse/GOBBLIN-1706?focusedWorklogId=810583&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810583 ] ASF GitHub Bot logged work on GOBBLIN-1706: --- Author: ASF GitHub B

[GitHub] [gobblin] arjun4084346 commented on a diff in pull request #3558: [GOBBLIN-1706] Add DagActionStore to store the action to kill/resume one flow execution

arjun4084346 commented on code in PR #3558: URL: https://github.com/apache/gobblin/pull/3558#discussion_r975977642 ## gobblin-runtime/src/main/java/org/apache/gobblin/runtime/dag_action_store/MysqlDagActionStore.java: ## @@ -0,0 +1,173 @@ +/* + * Licensed to the Apache Software

[jira] [Work logged] (GOBBLIN-1697) Have a separate resource handler to rely on CDC stream to do message forwarding

[ https://issues.apache.org/jira/browse/GOBBLIN-1697?focusedWorklogId=810577&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810577 ] ASF GitHub Bot logged work on GOBBLIN-1697: --- Author: ASF GitHub B

[GitHub] [gobblin] arjun4084346 commented on pull request #3549: [GOBBLIN-1697]Have a separate resource handler to rely on CDC stream to do message forwarding

arjun4084346 commented on PR #3549: URL: https://github.com/apache/gobblin/pull/3549#issuecomment-1253117667 If the MysqlSpecStore is changed to act like a MysqlSpecStoreWithUpdate , will it break anything? -- This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Work logged] (GOBBLIN-1705) New Consumer service that processes changes to Flow Spec Store

[ https://issues.apache.org/jira/browse/GOBBLIN-1705?focusedWorklogId=810572&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810572 ] ASF GitHub Bot logged work on GOBBLIN-1705: --- Author: ASF GitHub B

[GitHub] [gobblin] arjun4084346 commented on a diff in pull request #3557: [GOBBLIN-1705] New consumer service to monitor changes to FlowSpecStore

arjun4084346 commented on code in PR #3557: URL: https://github.com/apache/gobblin/pull/3557#discussion_r975964071 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/SpecStoreChangeMonitor.java: ## @@ -0,0 +1,159 @@ +/* + * Licensed to the Apache Software Fou

[jira] [Work logged] (GOBBLIN-1705) New Consumer service that processes changes to Flow Spec Store

[ https://issues.apache.org/jira/browse/GOBBLIN-1705?focusedWorklogId=810568&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810568 ] ASF GitHub Bot logged work on GOBBLIN-1705: --- Author: ASF GitHub B

[GitHub] [gobblin] arjun4084346 commented on a diff in pull request #3557: [GOBBLIN-1705] New consumer service to monitor changes to FlowSpecStore

arjun4084346 commented on code in PR #3557: URL: https://github.com/apache/gobblin/pull/3557#discussion_r975936078 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/SpecStoreChangeMonitor.java: ## @@ -0,0 +1,159 @@ +/* + * Licensed to the Apache Software Fou

[jira] [Work logged] (GOBBLIN-1705) New Consumer service that processes changes to Flow Spec Store

[ https://issues.apache.org/jira/browse/GOBBLIN-1705?focusedWorklogId=810567&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810567 ] ASF GitHub Bot logged work on GOBBLIN-1705: --- Author: ASF GitHub B

[GitHub] [gobblin] arjun4084346 commented on a diff in pull request #3557: [GOBBLIN-1705] New consumer service to monitor changes to FlowSpecStore

arjun4084346 commented on code in PR #3557: URL: https://github.com/apache/gobblin/pull/3557#discussion_r975932464 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/SpecStoreChangeMonitor.java: ## @@ -0,0 +1,159 @@ +/* + * Licensed to the Apache Software Fou

[jira] [Work logged] (GOBBLIN-1696) Build a file-based flowgraph that watches for changes and updates

[ https://issues.apache.org/jira/browse/GOBBLIN-1696?focusedWorklogId=810544&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810544 ] ASF GitHub Bot logged work on GOBBLIN-1696: --- Author: ASF GitHub B

[GitHub] [gobblin] AndyJiang99 commented on a diff in pull request #3548: [GOBBLIN-1696] Implement file based flowgraph that detects changes to the underlying…

AndyJiang99 commented on code in PR #3548: URL: https://github.com/apache/gobblin/pull/3548#discussion_r975881365 ## gobblin-utility/src/main/java/org/apache/gobblin/util/filesystem/ExceptionCatchingPathAlterationListenerDecorator.java: ## @@ -42,73 +45,83 @@ public Object getDe

[GitHub] [gobblin] umustafi opened a new pull request, #3567: Add missing sql source validation

umustafi opened a new pull request, #3567: URL: https://github.com/apache/gobblin/pull/3567 Dear Gobblin maintainers, Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below! ### JIRA - [X] My PR addresses the followi

[jira] [Created] (GOBBLIN-1713) Add validation check for mysql connection

Urmi Mustafi created GOBBLIN-1713: - Summary: Add validation check for mysql connection Key: GOBBLIN-1713 URL: https://issues.apache.org/jira/browse/GOBBLIN-1713 Project: Apache Gobblin Issue

[jira] [Work logged] (GOBBLIN-1696) Build a file-based flowgraph that watches for changes and updates

[ https://issues.apache.org/jira/browse/GOBBLIN-1696?focusedWorklogId=810519&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810519 ] ASF GitHub Bot logged work on GOBBLIN-1696: --- Author: ASF GitHub B

[GitHub] [gobblin] AndyJiang99 commented on a diff in pull request #3548: [GOBBLIN-1696] Implement file based flowgraph that detects changes to the underlying…

AndyJiang99 commented on code in PR #3548: URL: https://github.com/apache/gobblin/pull/3548#discussion_r975812541 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/GitFlowGraphMonitor.java: ## @@ -128,10 +131,11 @@ void processGitConfigChanges() throws GitAP

[jira] [Work logged] (GOBBLIN-1696) Build a file-based flowgraph that watches for changes and updates

[ https://issues.apache.org/jira/browse/GOBBLIN-1696?focusedWorklogId=810518&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810518 ] ASF GitHub Bot logged work on GOBBLIN-1696: --- Author: ASF GitHub B

[GitHub] [gobblin] AndyJiang99 commented on a diff in pull request #3548: [GOBBLIN-1696] Implement file based flowgraph that detects changes to the underlying…

AndyJiang99 commented on code in PR #3548: URL: https://github.com/apache/gobblin/pull/3548#discussion_r975809338 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/FsFlowGraphMonitor.java: ## @@ -0,0 +1,134 @@ +/* + * Licensed to the Apache Software Foundati

[jira] [Work logged] (GOBBLIN-1696) Build a file-based flowgraph that watches for changes and updates

[ https://issues.apache.org/jira/browse/GOBBLIN-1696?focusedWorklogId=810484&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810484 ] ASF GitHub Bot logged work on GOBBLIN-1696: --- Author: ASF GitHub B

[GitHub] [gobblin] AndyJiang99 commented on a diff in pull request #3548: [GOBBLIN-1696] Implement file based flowgraph that detects changes to the underlying…

AndyJiang99 commented on code in PR #3548: URL: https://github.com/apache/gobblin/pull/3548#discussion_r975719456 ## gobblin-service/src/main/java/org/apache/gobblin/service/modules/flowgraph/BaseFlowGraphHelper.java: ## @@ -84,26 +84,27 @@ public BaseFlowGraphListener(Optional

[jira] [Work logged] (GOBBLIN-1696) Build a file-based flowgraph that watches for changes and updates

[ https://issues.apache.org/jira/browse/GOBBLIN-1696?focusedWorklogId=810481&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810481 ] ASF GitHub Bot logged work on GOBBLIN-1696: --- Author: ASF GitHub B

[GitHub] [gobblin] AndyJiang99 commented on a diff in pull request #3548: [GOBBLIN-1696] Implement file based flowgraph that detects changes to the underlying…

AndyJiang99 commented on code in PR #3548: URL: https://github.com/apache/gobblin/pull/3548#discussion_r975719456 ## gobblin-service/src/main/java/org/apache/gobblin/service/modules/flowgraph/BaseFlowGraphHelper.java: ## @@ -84,26 +84,27 @@ public BaseFlowGraphListener(Optional

[jira] [Work logged] (GOBBLIN-1696) Build a file-based flowgraph that watches for changes and updates

[ https://issues.apache.org/jira/browse/GOBBLIN-1696?focusedWorklogId=810474&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810474 ] ASF GitHub Bot logged work on GOBBLIN-1696: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3548: [GOBBLIN-1696] Implement file based flowgraph that detects changes to the underlying…

Will-Lo commented on code in PR #3548: URL: https://github.com/apache/gobblin/pull/3548#discussion_r975690002 ## gobblin-service/src/main/java/org/apache/gobblin/service/modules/flowgraph/BaseFlowGraphHelper.java: ## @@ -197,10 +200,9 @@ private boolean checkFilePath(String file

[jira] [Work logged] (GOBBLIN-1709) Create work units for Hive Catalog based Iceberg Datasets to support Distcp for Iceberg

[ https://issues.apache.org/jira/browse/GOBBLIN-1709?focusedWorklogId=810470&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810470 ] ASF GitHub Bot logged work on GOBBLIN-1709: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3560: [GOBBLIN-1709] Create Iceberg Datasets Finder, Iceberg Dataset and FileSet to generate Copy Entities to support Distcp for Iceberg

Will-Lo commented on code in PR #3560: URL: https://github.com/apache/gobblin/pull/3560#discussion_r975677535 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergDataset.java: ## @@ -202,14 +202,11 @@ DatasetDescriptor getDestinationDa

[jira] [Work logged] (GOBBLIN-1711) Remove Jcenter from Gobblin OSS

[ https://issues.apache.org/jira/browse/GOBBLIN-1711?focusedWorklogId=810465&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810465 ] ASF GitHub Bot logged work on GOBBLIN-1711: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo merged pull request #3566: [GOBBLIN-1711] Replace Jcenter with maven central

Will-Lo merged PR #3566: URL: https://github.com/apache/gobblin/pull/3566 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@gobblin.apache

[jira] [Work logged] (GOBBLIN-1709) Create work units for Hive Catalog based Iceberg Datasets to support Distcp for Iceberg

[ https://issues.apache.org/jira/browse/GOBBLIN-1709?focusedWorklogId=810437&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810437 ] ASF GitHub Bot logged work on GOBBLIN-1709: --- Author: ASF GitHub B

[jira] [Work logged] (GOBBLIN-1709) Create work units for Hive Catalog based Iceberg Datasets to support Distcp for Iceberg

[ https://issues.apache.org/jira/browse/GOBBLIN-1709?focusedWorklogId=810438&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810438 ] ASF GitHub Bot logged work on GOBBLIN-1709: --- Author: ASF GitHub B

[GitHub] [gobblin] meethngala commented on a diff in pull request #3560: [GOBBLIN-1709] Create Iceberg Datasets Finder, Iceberg Dataset and FileSet to generate Copy Entities to support Distcp for Iceb

meethngala commented on code in PR #3560: URL: https://github.com/apache/gobblin/pull/3560#discussion_r975582599 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergDatasetFinder.java: ## @@ -0,0 +1,99 @@ +/* + * Licensed to the Apache

[GitHub] [gobblin] meethngala commented on a diff in pull request #3560: [GOBBLIN-1709] Create Iceberg Datasets Finder, Iceberg Dataset and FileSet to generate Copy Entities to support Distcp for Iceb

meethngala commented on code in PR #3560: URL: https://github.com/apache/gobblin/pull/3560#discussion_r975582202 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergDataset.java: ## @@ -0,0 +1,215 @@ +/* + * Licensed to the Apache Soft

[jira] [Work logged] (GOBBLIN-1709) Create work units for Hive Catalog based Iceberg Datasets to support Distcp for Iceberg

[ https://issues.apache.org/jira/browse/GOBBLIN-1709?focusedWorklogId=810436&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810436 ] ASF GitHub Bot logged work on GOBBLIN-1709: --- Author: ASF GitHub B

[GitHub] [gobblin] meethngala commented on a diff in pull request #3560: [GOBBLIN-1709] Create Iceberg Datasets Finder, Iceberg Dataset and FileSet to generate Copy Entities to support Distcp for Iceb

meethngala commented on code in PR #3560: URL: https://github.com/apache/gobblin/pull/3560#discussion_r975581617 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergDataset.java: ## @@ -0,0 +1,215 @@ +/* + * Licensed to the Apache Soft

[jira] [Work logged] (GOBBLIN-1709) Create work units for Hive Catalog based Iceberg Datasets to support Distcp for Iceberg

[ https://issues.apache.org/jira/browse/GOBBLIN-1709?focusedWorklogId=810425&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-810425 ] ASF GitHub Bot logged work on GOBBLIN-1709: --- Author: ASF GitHub B

[GitHub] [gobblin] phet commented on a diff in pull request #3560: [GOBBLIN-1709] Create Iceberg Datasets Finder, Iceberg Dataset and FileSet to generate Copy Entities to support Distcp for Iceberg

phet commented on code in PR #3560: URL: https://github.com/apache/gobblin/pull/3560#discussion_r975553754 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergDataset.java: ## @@ -0,0 +1,215 @@ +/* + * Licensed to the Apache Software F