[ 
https://issues.apache.org/jira/browse/FLUME-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425528#comment-15425528
 ] 

Andrea Rota commented on FLUME-2911:
------------------------------------

Hello [~bessbd], with commit 
[ce36ceca|https://github.com/tenaris/flume/commit/ce36cecaf564b4c5b7d14324accb6f1df5ff2f0a]
 you will find two additional tests. Tests use a 
ReliableSpoolingFileEventReader with ignorePattern and includePattern 
configured at the same time. The former will test situations when the two 
options are not in conflict (i.e. apply on different files), the latter will 
test what happen when both apply on the same file.

Let me know if you need more information.

Andrea

> Add includePattern option in SpoolDirectorySource configuration
> ---------------------------------------------------------------
>
>                 Key: FLUME-2911
>                 URL: https://issues.apache.org/jira/browse/FLUME-2911
>             Project: Flume
>          Issue Type: Improvement
>          Components: Sinks+Sources
>    Affects Versions: notrack, v1.6.0, v1.7.0
>            Reporter: Andrea Rota
>              Labels: features
>         Attachments: FLUME-2911.patch
>
>
> Current implementation of SpoolDirectorySource does not allow users to 
> specify a regex pattern to select which files should be monitored. Instead, 
> the current implementation allows users to specify which should *not* 
> monitored, via the ignorePattern parameter.
> I implemented the feature, allowing users to specify the include pattern as 
> {{a1.sources.src-1.includePattern=^foo.*$}} (includes all the files that 
> starts in "foo").
> By default, the includePattern regex is set to {{^.*$}} (all files). Include 
> and exclude patterns can be used at same time and the results are combined.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to