I see two options, either run a Flume agent on windows that spools the local dir and either has access to hdfs or talks to other Flume agents which do Or you can have a small script scheduled on a regular basis to get logs and post them to Flume.
Regards, Gonzalo On 19 November 2015 at 09:07, chandra sekar <[email protected]> wrote: > Dear all, > > I am new to Apache Flume. I have 5 Cluster Hadoop (YARN) node running on > Linux machine. I would like to stream IIS webserver logs located at same > subnet network to HDFS via Flume. > > Do I need to run Flume-ng on the Windows Server machines which is running > web server. Can you please let me know detailed guideline and > configuration file. > > I have archived Linux Realtime syslogs streaming to HDFS in the same > cluster environment. But no idea in remote server environment. > > Regards > Shekar. > > > > >
