You can setup flume to use hdfs.proxyUser https://cwiki.apache.org/confluence/display/FLUME/Flume+1.x+Secure+HDFS+Setup
On Thu, Mar 13, 2014 at 2:26 PM, Christopher Shannon <[email protected]>wrote: > What if your sinks have to write out to destinations that have different > users and different levels of authorization? How is security managed by > Flume? > On Mar 6, 2014 8:56 AM, "Simeon Zaharici" <[email protected]> > wrote: > >> Hello >> >> You do not need to run multiple flume agents, although this is possible. >> You could just define multiple sources running on different ports in the >> same flume agent, each one writing to its own Hbase sink. >> >> Regards, >> Simeon >> >> >> >> On Wednesday, March 5, 2014 11:30:56 PM, Chhaya Vishwakarma < >> [email protected]> wrote: >> Hi >> >> I have a problem statement where i need to collect data from multiple >> machines(each machine forwarding data for different format) to centralized >> storage(Hbase). >> I need to make a different table for each type of log collected. >> How can i do it using flume? Is it possible to run multiple flume agent >> on same machine ? I can assign each type to one agent which will write to >> hbase. >> >> >> Regards, >> Chhaya Vishwakarma >> >> >> ------------------------------ >> The contents of this e-mail and any attachment(s) may contain >> confidential or privileged information for the intended recipient(s). >> Unintended recipients are prohibited from taking action on the basis of >> information in this e-mail and using or disseminating the information, and >> must notify the sender and delete it from their system. L&T Infotech will >> not accept responsibility or liability for the accuracy or completeness of, >> or the presence of any virus or disabling code in this e-mail" >> >> >>
