Hi, I need to read 5 directories with different log data and store them in 5 different directories in hdfs. I have flume script that uses spooldir and hdfs sink to do this for a single directory. For performance reasons I want to run this script using 5 agents each for a separate direcory. BUT I don;t want to duplication the script but rather pass a parameter from the command line that will be used in the script to read from the right spoolDir.
Does flume support passing command line parameters to script? Any other solution? Eran -- Eran | "You don't need eyes to see, you need vision" (Faithless)
