[ 
https://issues.apache.org/jira/browse/FLUME-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13263878#comment-13263878
 ] 

Mubarak Seyed commented on FLUME-1150:
--------------------------------------

Heard that multiplexing channel selector will solve the problem.
                
> Need a way to specify bucket in HDFSEventSink from client
> ---------------------------------------------------------
>
>                 Key: FLUME-1150
>                 URL: https://issues.apache.org/jira/browse/FLUME-1150
>             Project: Flume
>          Issue Type: Improvement
>          Components: Sinks+Sources
>            Reporter: Mubarak Seyed
>
> We need a way to specify the bucket when event is streamed from client.
> For instance, if i have 5 different log categories (like category [1-5]), if 
> i use single source->channel->hdfsSink then all the logs goes to one 
> specified directory in HDFS (/logs/<destination>) but we need something like
> /logs/category1
>      /category2
>      /category3
>      /category4
>      /category5
> I can use multiplexing (1 source, N channel, and N sinks) but i need to use a 
> multiplexing channel processor to route the events(categories) to the proper 
> sink. 
> What i am thinking is if i specify the category name in header in Event, 
> HDFSEventSink (and its helper classes) can create a bucket based on header 
> value (and then escape-sequence needs to be honored). 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to