[
https://issues.apache.org/jira/browse/GOBBLIN-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li updated GOBBLIN-1490:
------------------------------
Description: In some use case, we may run data pipeline on different
clusters but those clusters share the same file system. And in those case, we
will want the metadata pipeline to be able to consume all the records even they
are running on different clusters. (was: In some use case, we may run data
pipeline on different clusters but those clusters share the same file system.
And in those case, we will want the metadata pipeline to able to consume all
the records even they are running on different clusters.)
> Make metadata pipeline to support consume GMCE emitted from different cluster
> -----------------------------------------------------------------------------
>
> Key: GOBBLIN-1490
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1490
> Project: Apache Gobblin
> Issue Type: New Feature
> Reporter: Zihan Li
> Priority: Major
>
> In some use case, we may run data pipeline on different clusters but those
> clusters share the same file system. And in those case, we will want the
> metadata pipeline to be able to consume all the records even they are running
> on different clusters.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
