[
https://issues.apache.org/jira/browse/GOBBLIN-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zihan Li updated GOBBLIN-1484:
------------------------------
Description: Sometime we need the avro schema in place even for ORC tables,
we have that information in ingestion job but not for compaction job. And it's
hard to get the avro schema from orc file itself, so we want to support schema
source db, so that we can fetch the schema from source db where ingestion job
registers to. (was: Sometime we need the avro schema in place even for ORC
tables, we have that information in ingestion job but not for compaction job.
Anf it's hard to get the avro schema from orc file itself, so we want to
support schema source db, so that we can fetch the schema from source db where
ingestion job registers to.)
> Make Gobblin metadata writer be able to support schema source DB
> ----------------------------------------------------------------
>
> Key: GOBBLIN-1484
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1484
> Project: Apache Gobblin
> Issue Type: New Feature
> Reporter: Zihan Li
> Priority: Major
>
> Sometime we need the avro schema in place even for ORC tables, we have that
> information in ingestion job but not for compaction job. And it's hard to get
> the avro schema from orc file itself, so we want to support schema source db,
> so that we can fetch the schema from source db where ingestion job registers
> to.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
