[
https://issues.apache.org/jira/browse/BEAM-7450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anonymous updated BEAM-7450:
----------------------------
Status: Triage Needed (was: Resolved)
> Support unbounded reads with HCatalogIO
> ---------------------------------------
>
> Key: BEAM-7450
> URL: https://issues.apache.org/jira/browse/BEAM-7450
> Project: Beam
> Issue Type: New Feature
> Components: io-java-hcatalog
> Reporter: Ankit Jhalaria
> Assignee: Ankit Jhalaria
> Priority: P3
> Fix For: 2.14.0
>
> Time Spent: 12h 40m
> Remaining Estimate: 0h
>
> # Current version of HcatalogIO is a bounded source.
> # While migrating our jobs to aws, we realized that it would be helpful to
> have an unbounded hcat reader that can behave as an unbounded source and
> polls for new partitions as and when they become available.
> # I have used splittable pardo(s) to do this. There is a flag that can be
> set to treat this as a bounded source which will terminate if that flag is
> set.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
