AFAIK, it doesn't work recursively. It would pick files only from specified directory.
Here is the patch you can try https://issues.apache.org/jira/browse/FLUME-1899 HTH ! On Tue, Nov 18, 2014 at 11:21 AM, mahendran m <[email protected]> wrote: > Hi All, > > I was working on moving the IIS logs into HDFS using flume spooling > directory source > i was running the 3 website in IIS server , so my logging directory will > looks like below > > LogFiles > > | > |-- W3SVC1 > > | | > > | `--website1.log > > | > > |-- W3SVC1 > > | | > > | `--website2.log > > | > > `-- W3SCV3 > | > `-- website3.log > > > > Now my use case is that i want to move the log of website 3 that is > website3.log file to HDFS. So i have configured the CONF file as below > > > > agent1.sources.spool.spoolDir =C:\\inetpub\\logs\\LogFiles\\W3SVC3 > > > and it is works perfectly . now My use case is changed that i want move all > the log files under the folder LogFiles , now i changed the CONF as below > > > agent1.sources.spool.spoolDir =C:\\inetpub\\logs\\LogFiles > > > but it does not working . not moving any files from LogFiles directory. How > can i achieve my use case ? > > > Thanks, > > Mahendran > > -- thanks ashish Blog: http://www.ashishpaliwal.com/blog My Photo Galleries: http://www.pbase.com/ashishpaliwal
