I think you can achive this with the Regex interceptor.
https://flume.apache.org/FlumeUserGuide.html

בתאריך יום א׳, 4 באוק׳ 2015, 21:32 מאת seekerak (JIRA) <j...@apache.org>:

> seekerak created FLUME-2807:
> -------------------------------
>
>              Summary: Add a simple split interceptor
>                  Key: FLUME-2807
>                  URL: https://issues.apache.org/jira/browse/FLUME-2807
>              Project: Flume
>           Issue Type: Improvement
>           Components: Sinks+Sources
>     Affects Versions: v1.6.0
>             Reporter: seekerak
>              Fix For: v1.6.0
>
>
> a simple split interceptor , aims to deal with the situation as follows:
>
> the source data like this:
> “
> 1,tom,boy,13
> 2,lili,girl,14
> 3,jack,boy,10
> ...
> ”
> and i hope to sink source data into two different hdfs directories named
> by boy and girl like this:
> “
> hdfs://xxxx/sink/boy/....
> hdfs://xxxx/sink/girl/....
> ”
>
> we can use this interceptor to accomplish this goal.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>
-- 
Eran | "You don't need eyes to see, you need vision" (Faithless)

Reply via email to