[ https://issues.apache.org/jira/browse/MINIFI-95?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15445055#comment-15445055 ]
Randy Gelhausen commented on MINIFI-95: --------------------------------------- I added logging statements to GetFile::performListing. It seems that subdirectories are not recognized as directories, but instead possibly as type "DT_UNKNOWN", and assumed to be regular files. This is on CentOS 7: cat /etc/redhat-release -> CentOS Linux release 7.2.1511 (Core) I created /test/a/test.txt and ran a GetFile processor with recursion true on /test: [2016-08-29 07:01:45.451] [minifi log] [info] MiNiFi started [2016-08-29 07:01:45.451] [minifi log] [info] Checking: /test/. [2016-08-29 07:01:45.451] [minifi log] [info] /test/.: entry->d_type: 4 [2016-08-29 07:01:45.451] [minifi log] [info] entry->d_type & DT_DIR == true [2016-08-29 07:01:45.451] [minifi log] [info] Checking: /test/.. [2016-08-29 07:01:45.451] [minifi log] [info] /test/..: entry->d_type: 4 [2016-08-29 07:01:45.451] [minifi log] [info] entry->d_type & DT_DIR == true [2016-08-29 07:01:45.451] [minifi log] [info] Checking: /test/a [2016-08-29 07:01:45.451] [minifi log] [info] /test/a: entry->d_type: 0 Since d_type is not DT_DIR, minifi is never attempting to list files in /test/a > MiNiFi-cpp GetFile processor sends directories as files > ------------------------------------------------------- > > Key: MINIFI-95 > URL: https://issues.apache.org/jira/browse/MINIFI-95 > Project: Apache NiFi MiNiFi > Issue Type: Bug > Components: C++, Core Framework > Reporter: Randy Gelhausen > Labels: c++, cpp, minifi-cpp > > When recurse subdirectories is true (in below example, it is blank, which > should default to true), MiNiFi-cpp sends a flowfile for each file in each > subdirectory, but _also_ sends a flowfile for each subdirectory folder. > Feel free to close if this is expected behavior, but I assumed GetFile would > send only files, not directories. > Processors: > - name: GetNMon > class: org.apache.nifi.processors.standard.GetFile > max concurrent tasks: 1 > scheduling strategy: TIMER_DRIVEN > scheduling period: 0 sec > penalization period: 30 sec > yield period: 1 sec > run duration nanos: 0 > auto-terminated relationships list: [] > Properties: > Batch Size: > File Filter: > Ignore Hidden Files: > Input Directory: /host-data/metrics/nmon/HOSTNAME > Keep Source File: > Maximum File Age: > Maximum File Size: > Minimum File Age: 10 sec > Minimum File Size: > Path Filter: > Polling Interval: > Recurse Subdirectories: -- This message was sent by Atlassian JIRA (v6.3.4#6332)