[
https://issues.apache.org/jira/browse/FLUME-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407385#comment-15407385
]
ASF GitHub Bot commented on FLUME-2911:
---------------------------------------
GitHub user andrearota opened a pull request:
https://github.com/apache/flume/pull/60
FLUME-2911. Added include pattern option in SpoolDir source
Current implementation of `SpoolDirectorySource` does not allow users to
specify a regex pattern to select which files should be monitored. Instead, the
current implementation allows users to specify which should not monitored, via
the `ignorePattern` parameter.
We implemented the feature, allowing users to specify the include pattern
as `a1.sources.src-1.includePattern=^foo.*$` (includes all the files that
starts in "foo").
By default, the `includePattern` regex is set to `^.*$` (all files).
Include and exclude patterns can be used at same time and the results are
combined.
We also opened this JIRA issue:
https://issues.apache.org/jira/browse/FLUME-2911
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tenaris/flume FLUME-2911
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flume/pull/60.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #60
----
commit 39eb89d8d86abe9a4111e44e8fff6bf3bb80fa65
Author: Andrea Rota <[email protected]>
Date: 2016-08-04T08:09:16Z
FLUME-2911. Added include pattern option in SpoolDir source
----
> Add includePattern option in SpoolDirectorySource configuration
> ---------------------------------------------------------------
>
> Key: FLUME-2911
> URL: https://issues.apache.org/jira/browse/FLUME-2911
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: notrack, v1.6.0, v1.7.0
> Reporter: Andrea Rota
> Labels: features
> Attachments: FLUME-2911.patch
>
>
> Current implementation of SpoolDirectorySource does not allow users to
> specify a regex pattern to select which files should be monitored. Instead,
> the current implementation allows users to specify which should *not*
> monitored, via the ignorePattern parameter.
> I implemented the feature, allowing users to specify the include pattern as
> {{a1.sources.src-1.includePattern=^foo.*$}} (includes all the files that
> starts in "foo").
> By default, the includePattern regex is set to {{^.*$}} (all files). Include
> and exclude patterns can be used at same time and the results are combined.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
