[jira] [Work logged] (GOBBLIN-1766) Define metric to measure lag from producing to consume change stream events

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1766?focusedWorklogId=840139&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840139 ] ASF GitHub Bot logged work on GOBBLIN-1766: --- Author: ASF GitHub B

[GitHub] [gobblin] umustafi commented on a diff in pull request #3625: [GOBBLIN-1766] Define metric to measure lag from producing to consume…

2023-01-18 Thread GitBox
umustafi commented on code in PR #3625: URL: https://github.com/apache/gobblin/pull/3625#discussion_r1080737848 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/DagActionStoreChangeMonitor.java: ## @@ -98,18 +102,20 @@ protected void processMessage(Decodeab

[jira] [Work logged] (GOBBLIN-1764) Emit GaaSObservabilityEvent

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1764?focusedWorklogId=840133&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840133 ] ASF GitHub Bot logged work on GOBBLIN-1764: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3623: [GOBBLIN-1764] Emit observability event

2023-01-18 Thread GitBox
Will-Lo commented on code in PR #3623: URL: https://github.com/apache/gobblin/pull/3623#discussion_r1080707760 ## gobblin-modules/gobblin-kafka-09/src/test/java/org/apache/gobblin/runtime/KafkaAvroJobStatusMonitorTest.java: ## @@ -527,13 +637,14 @@ private GobblinTrackingEvent c

[jira] [Work logged] (GOBBLIN-1764) Emit GaaSObservabilityEvent

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1764?focusedWorklogId=840132&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840132 ] ASF GitHub Bot logged work on GOBBLIN-1764: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3623: [GOBBLIN-1764] Emit observability event

2023-01-18 Thread GitBox
Will-Lo commented on code in PR #3623: URL: https://github.com/apache/gobblin/pull/3623#discussion_r1080707399 ## gobblin-service/src/test/java/org/apache/gobblin/service/monitoring/GaaSObservabilityProducerTest.java: ## @@ -0,0 +1,117 @@ +/* + * Licensed to the Apache Software

[jira] [Work logged] (GOBBLIN-1765) Add support to sync metadata for dir in manifest based copy

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1765?focusedWorklogId=840121&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840121 ] ASF GitHub Bot logged work on GOBBLIN-1765: --- Author: ASF GitHub B

[GitHub] [gobblin] phet commented on a diff in pull request #3624: [GOBBLIN-1765] Add support to sync metadata for dir in manifest based copy

2023-01-18 Thread GitBox
phet commented on code in PR #3624: URL: https://github.com/apache/gobblin/pull/3624#discussion_r1080643334 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/CopyableFile.java: ## @@ -316,23 +316,33 @@ private List replicateAncestorsOwnerAndPermis

[jira] [Work logged] (GOBBLIN-1765) Add support to sync metadata for dir in manifest based copy

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1765?focusedWorklogId=840120&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840120 ] ASF GitHub Bot logged work on GOBBLIN-1765: --- Author: ASF GitHub B

[GitHub] [gobblin] phet commented on a diff in pull request #3624: [GOBBLIN-1765] Add support to sync metadata for dir in manifest based copy

2023-01-18 Thread GitBox
phet commented on code in PR #3624: URL: https://github.com/apache/gobblin/pull/3624#discussion_r1080640043 ## gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/ManifestBasedDataset.java: ## @@ -125,9 +123,31 @@ public Iterator> getFileSetIterator(Fi

[jira] [Work logged] (GOBBLIN-1764) Emit GaaSObservabilityEvent

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1764?focusedWorklogId=840115&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840115 ] ASF GitHub Bot logged work on GOBBLIN-1764: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3623: [GOBBLIN-1764] Emit observability event

2023-01-18 Thread GitBox
Will-Lo commented on code in PR #3623: URL: https://github.com/apache/gobblin/pull/3623#discussion_r1080655252 ## gobblin-modules/gobblin-kafka-09/src/test/java/org/apache/gobblin/runtime/KafkaAvroJobStatusMonitorTest.java: ## @@ -387,62 +460,95 @@ public void testProcessProgre

[jira] [Work logged] (GOBBLIN-1764) Emit GaaSObservabilityEvent

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1764?focusedWorklogId=840114&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840114 ] ASF GitHub Bot logged work on GOBBLIN-1764: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3623: [GOBBLIN-1764] Emit observability event

2023-01-18 Thread GitBox
Will-Lo commented on code in PR #3623: URL: https://github.com/apache/gobblin/pull/3623#discussion_r1080652649 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/GaaSObservabilityEventProducer.java: ## @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache Software

[jira] [Work logged] (GOBBLIN-1764) Emit GaaSObservabilityEvent

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1764?focusedWorklogId=840109&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840109 ] ASF GitHub Bot logged work on GOBBLIN-1764: --- Author: ASF GitHub B

[GitHub] [gobblin] ZihanLi58 commented on a diff in pull request #3623: [GOBBLIN-1764] Emit observability event

2023-01-18 Thread GitBox
ZihanLi58 commented on code in PR #3623: URL: https://github.com/apache/gobblin/pull/3623#discussion_r1080626419 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/KafkaJobStatusMonitor.java: ## @@ -288,6 +303,15 @@ private static void modifyStateIfRetryRequ

[jira] [Work logged] (GOBBLIN-1766) Define metric to measure lag from producing to consume change stream events

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1766?focusedWorklogId=840105&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840105 ] ASF GitHub Bot logged work on GOBBLIN-1766: --- Author: ASF GitHub B

[GitHub] [gobblin] umustafi commented on a diff in pull request #3625: [GOBBLIN-1766] Define metric to measure lag from producing to consume…

2023-01-18 Thread GitBox
umustafi commented on code in PR #3625: URL: https://github.com/apache/gobblin/pull/3625#discussion_r1080610719 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/SpecStoreChangeMonitor.java: ## @@ -171,5 +178,6 @@ protected void createMetrics() { this.d

[jira] [Work logged] (GOBBLIN-1766) Define metric to measure lag from producing to consume change stream events

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1766?focusedWorklogId=840102&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840102 ] ASF GitHub Bot logged work on GOBBLIN-1766: --- Author: ASF GitHub B

[GitHub] [gobblin] umustafi commented on a diff in pull request #3625: [GOBBLIN-1766] Define metric to measure lag from producing to consume…

2023-01-18 Thread GitBox
umustafi commented on code in PR #3625: URL: https://github.com/apache/gobblin/pull/3625#discussion_r1080604384 ## gobblin-metrics-libs/gobblin-metrics-base/src/main/avro/GenericStoreChangeEvent.avsc: ## @@ -9,9 +9,14 @@ "doc" : "Primary key for the store", "compliance

[jira] [Work logged] (GOBBLIN-1766) Define metric to measure lag from producing to consume change stream events

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1766?focusedWorklogId=840101&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840101 ] ASF GitHub Bot logged work on GOBBLIN-1766: --- Author: ASF GitHub B

[GitHub] [gobblin] umustafi commented on a diff in pull request #3625: [GOBBLIN-1766] Define metric to measure lag from producing to consume…

2023-01-18 Thread GitBox
umustafi commented on code in PR #3625: URL: https://github.com/apache/gobblin/pull/3625#discussion_r1080602171 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/DagActionStoreChangeMonitor.java: ## @@ -98,18 +102,20 @@ protected void processMessage(Decodeab

[jira] [Work logged] (GOBBLIN-1764) Emit GaaSObservabilityEvent

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1764?focusedWorklogId=840098&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840098 ] ASF GitHub Bot logged work on GOBBLIN-1764: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3623: [GOBBLIN-1764] Emit observability event

2023-01-18 Thread GitBox
Will-Lo commented on code in PR #3623: URL: https://github.com/apache/gobblin/pull/3623#discussion_r1080592247 ## gobblin-modules/gobblin-kafka-09/src/test/java/org/apache/gobblin/runtime/KafkaAvroJobStatusMonitorTest.java: ## @@ -358,6 +370,66 @@ public void testProcessingRetr

[jira] [Work logged] (GOBBLIN-1764) Emit GaaSObservabilityEvent

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1764?focusedWorklogId=840097&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840097 ] ASF GitHub Bot logged work on GOBBLIN-1764: --- Author: ASF GitHub B

[GitHub] [gobblin] phet commented on a diff in pull request #3623: [GOBBLIN-1764] Emit observability event

2023-01-18 Thread GitBox
phet commented on code in PR #3623: URL: https://github.com/apache/gobblin/pull/3623#discussion_r1080573520 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/GaaSObservabilityEventProducer.java: ## @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache Software Fo

[jira] [Work logged] (GOBBLIN-1764) Emit GaaSObservabilityEvent

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1764?focusedWorklogId=840096&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840096 ] ASF GitHub Bot logged work on GOBBLIN-1764: --- Author: ASF GitHub B

[GitHub] [gobblin] phet commented on a diff in pull request #3623: [GOBBLIN-1764] Emit observability event

2023-01-18 Thread GitBox
phet commented on code in PR #3623: URL: https://github.com/apache/gobblin/pull/3623#discussion_r1080567642 ## gobblin-modules/gobblin-kafka-09/src/test/java/org/apache/gobblin/runtime/KafkaAvroJobStatusMonitorTest.java: ## @@ -387,62 +460,95 @@ public void testProcessProgressi

[jira] [Work logged] (GOBBLIN-1766) Define metric to measure lag from producing to consume change stream events

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1766?focusedWorklogId=840095&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840095 ] ASF GitHub Bot logged work on GOBBLIN-1766: --- Author: ASF GitHub B

[GitHub] [gobblin] umustafi commented on a diff in pull request #3625: [GOBBLIN-1766] Define metric to measure lag from producing to consume…

2023-01-18 Thread GitBox
umustafi commented on code in PR #3625: URL: https://github.com/apache/gobblin/pull/3625#discussion_r1080587369 ## gobblin-metrics-libs/gobblin-metrics-base/src/main/avro/GenericStoreChangeEvent.avsc: ## @@ -9,9 +9,14 @@ "doc" : "Primary key for the store", "compliance

[jira] [Work logged] (GOBBLIN-1759) More robust logging when attempting to resolve a flow config

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1759?focusedWorklogId=840094&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840094 ] ASF GitHub Bot logged work on GOBBLIN-1759: --- Author: ASF GitHub B

[GitHub] [gobblin] AndyJiang99 commented on a diff in pull request #3614: [GOBBLIN-1759] Add error reporting when attempting to resolve flow configs

2023-01-18 Thread GitBox
AndyJiang99 commented on code in PR #3614: URL: https://github.com/apache/gobblin/pull/3614#discussion_r1080581336 ## gobblin-service/src/main/java/org/apache/gobblin/service/modules/dataset/FSVolumeDatasetDescriptor.java: ## @@ -19,38 +19,41 @@ import com.typesafe.config.Con

[jira] [Work logged] (GOBBLIN-1759) More robust logging when attempting to resolve a flow config

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1759?focusedWorklogId=840092&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840092 ] ASF GitHub Bot logged work on GOBBLIN-1759: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3614: [GOBBLIN-1759] Add error reporting when attempting to resolve flow configs

2023-01-18 Thread GitBox
Will-Lo commented on code in PR #3614: URL: https://github.com/apache/gobblin/pull/3614#discussion_r1080575218 ## gobblin-service/src/main/java/org/apache/gobblin/service/modules/dataset/FSVolumeDatasetDescriptor.java: ## @@ -19,38 +19,41 @@ import com.typesafe.config.Config;

[jira] [Work logged] (GOBBLIN-1767) Update Mysql driver class name to `com.mysql.cj.jdbc.Driver`

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1767?focusedWorklogId=840090&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840090 ] ASF GitHub Bot logged work on GOBBLIN-1767: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo merged pull request #3626: [GOBBLIN-1767] Update references to deprecated Mysql connector/j driver to new name

2023-01-18 Thread GitBox
Will-Lo merged PR #3626: URL: https://github.com/apache/gobblin/pull/3626 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@gobblin.apache

[jira] [Work logged] (GOBBLIN-1764) Emit GaaSObservabilityEvent

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1764?focusedWorklogId=840033&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-840033 ] ASF GitHub Bot logged work on GOBBLIN-1764: --- Author: ASF GitHub B

[GitHub] [gobblin] Will-Lo commented on a diff in pull request #3623: [GOBBLIN-1764] Emit observability event

2023-01-18 Thread GitBox
Will-Lo commented on code in PR #3623: URL: https://github.com/apache/gobblin/pull/3623#discussion_r1073873739 ## gobblin-service/src/main/java/org/apache/gobblin/service/monitoring/GaaSObservabilityEventProducer.java: ## @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software

[jira] [Work logged] (GOBBLIN-1767) Update Mysql driver class name to `com.mysql.cj.jdbc.Driver`

2023-01-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1767?focusedWorklogId=839847&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-839847 ] ASF GitHub Bot logged work on GOBBLIN-1767: --- Author: ASF GitHub B

[GitHub] [gobblin] codecov-commenter commented on pull request #3626: [GOBBLIN-1767] Update references to deprecated Mysql connector/j driver to new name

2023-01-18 Thread GitBox
codecov-commenter commented on PR #3626: URL: https://github.com/apache/gobblin/pull/3626#issuecomment-1386640426 # [Codecov](https://codecov.io/gh/apache/gobblin/pull/3626?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Sof