[
https://issues.apache.org/jira/browse/APEXMALHAR-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15516047#comment-15516047
]
ASF GitHub Bot commented on APEXMALHAR-2237:
--------------------------------------------
GitHub user yogidevendra opened a pull request:
https://github.com/apache/apex-malhar/pull/428
APEXMALHAR-2237 : Changes in FSInputModule to support Dynamic partitioning.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yogidevendra/apex-malhar
APEXMALHAR-2237-fsinput-dynamic
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/apex-malhar/pull/428.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #428
----
commit 4163cd5b0dfd11f17a96995510d03a9a8097694e
Author: yogidevendra <[email protected]>
Date: 2016-09-21T06:59:06Z
Changes in FSInputModule to support Dynamic partitioning.
----
> Dynamic partitioning support for FSInputModule
> ----------------------------------------------
>
> Key: APEXMALHAR-2237
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2237
> Project: Apache Apex Malhar
> Issue Type: Improvement
> Reporter: Yogi Devendra
> Assignee: Yogi Devendra
>
> Currently, FSInputModule exposes readersCount property which is used for
> static partitioning of BlockReader.
> To support dynamic partitioning, following additional properties will be
> exposed.
> 1. minReaders = minimum number of readers for dynamic partitioning.
> 2. maxReaders = maximum number of readers for dynamic partitioning.
> 3. repartitionCheckInterval = time in seconds for checking if repartition is
> required.
> minReaders, maxReaders will set respective property on BlockReader.
> repartitionCheckInterval will set intervalMillis property on BlockReader
> after converting from seconds to milliseconds.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
