Robert Farr created CRUNCH-689:
----------------------------------
Summary: Allow override of of partitions for
writeToHFilesForIncrementalLoad
Key: CRUNCH-689
URL: https://issues.apache.org/jira/browse/CRUNCH-689
Project: Crunch
Issue Type: Improvement
Components: Core
Affects Versions: 0.14.0
Reporter: Robert Farr
Assignee: Josh Wills
writeToHFilesForIncrementLoad supports an option to limit the partitions to
affected regions currently by inspecting the input to determine the impacted
partitions. While this works in some cases there is overhead in this approach.
There are other use cases where the affected regions are known or predictable
ahead of time. This enhancement request is to add support for a new
writeToHFilesForIncrementLoad() that accepts a boolean filter function to allow
the consumer to determine which regions are affected and determine the
partitions from those.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
