Re: [ANNOUNCE] Change of Apache Flume PMC Chair

Congratulations Hari! Jarcec > On Oct 21, 2015, at 5:50 PM, Arvind Prabhakar wrote: > > Dear Flume Users and Developers, > > I have had the pleasure of serving as the PMC Chair of Apache Flume since its > graduation three years ago. I sincerely thank you and the Flume PMC for this > opportun

Re: [ANNOUNCE] New Flume committer - Johny Rufus

Congratulations Johny! Jarcec > On Jun 19, 2015, at 1:38 PM, Hari Shreedharan wrote: > > On behalf of the Apache Flume PMC, I am excited to welcome Johny Rufus as a > committer on the Apache Flume project. Johny has actively contributed several > patches to the Flume project, including bug fi

Re: [DISCUSS] Drop Hadoop 1 support

+1 I believe that dropping Hadoop 1 support is completely fair at this point. Hadoop 2 is stable for a long time and offers much better capabilities. People who remain on Hadoop 1 will still have ability to download older Flume releases that are Hadoop 1 compatible. Jarcec > On May 13, 2015,

30 tech skills that will get you a $110,000-plus salary

It seems that being Flume developer is a well paying job :) Jarcec

Re: [ANNOUNCE] New Flume PMC Member - Roshan Naik

Congratulations Roshan! Jarcec > On Nov 4, 2014, at 2:12 PM, Arvind Prabhakar wrote: > > On behalf of Apache Flume PMC, it is my pleasure to announce that Roshan Naik > has been elected to the Flume Project Management Committee. Roshan has been > active with the project for many years and has

Re: [ANNOUNCE] Apache Flume 1.5.0 released

Nice, thank you for driving the release Hari, great work! Jarcec On Thu, May 22, 2014 at 05:21:40AM +0530, Mohammad Tariq wrote: > +1 > > Big thanks to the entire Flume team for all their efforts :) > > > > *Warm regards,* > *Mohammad Tariq* > *cloudfront.blogspot.com

Re: Why does a Flume source need to recognize the format of the message?

Hi Praveen, I think that there is a confusion between message and payload. Whereas Flume do not need to understand the payload structure, it do need to understand the message to understand what events (what payloads) are there with what headers. To put it differently, Flume do not need to unders

Re: Flume NG MySQL sink

Hi Amit, to my best knowledge, there is no MySQL sink that would store data from Flume in MySQL. Would you mind describing your use case? I would be interesting to hear how the MySQL fits into the use case. Flume is heavy distributed system for collecting and injesting data, that can very easily

Re: [ANNOUNCE] New Flume Committer - Roshan Naik

Congratulations Roshan, well done! Jarcec On Tue, Sep 24, 2013 at 03:39:13PM -0700, Hari Shreedharan wrote: > On behalf of the Apache Flume PMC, I am excited to welcome Roshan Naik as a > committer on the Apache Flume project. Roshan has actively contributed > several patches to the Flume project

Re: [ANNOUNCE] New Flume Committer - Wolfgang Hoschek

Congratulations Wolfgang, well done! Jarcec On Tue, Sep 24, 2013 at 03:39:12PM -0700, Hari Shreedharan wrote: > On behalf of the Apache Flume PMC, I am excited to welcome Wolfgang Hoschek > as a committer on the Apache Flume project. Wolfgang contributed a new sink > with the ability to do heavyw

Re: Apache Flume meetup at Hadoop Summit

I'll definitely be there! Jarcec On Tue, Jun 25, 2013 at 01:14:01PM -0700, Mike Percy wrote: > This event is tonight! Hope to see many of you there. > > Mike > > > On Tue, Jun 25, 2013 at 12:58 PM, Hari Shreedharan < > hshreedha...@cloudera.com> wrote: > > > Hi all, > > > > I am sorry if this

Re: Fair use for the logo?

Reusing logo and documentation pictures for such usage seems fine to me. I would personally mentioned for the doc pictures where they come from. This page seems to be describing allowed usage for the logos and other Apache trademarks: http://www.apache.org/foundation/marks/#principles Jarcec

Re: [ANNOUNCE] New Apache Flume committer - Patrick Wendell

That's awesome, welcome on board Patrick! Jarcec On Mon, Nov 12, 2012 at 01:04:41PM -0800, Hari Shreedharan wrote: > On behalf of the Apache Flume PMC, I am excited to welcome Patrick Wendell > as a committer on Flume! Patrick has contributed significantly to the > project, by adding new featu

Re: flume 1.3

The release procedure has already started, so in few weeks. There is unfortunately nothing like exact day as it will depend on how many release candidates will be created, ... Jarcec On Fri, Oct 19, 2012 at 03:34:44PM +0800, Shara Shi wrote: > When flume 1.3 will be released ? > > > > Shara

Re: Cloudera Flume user guide doesn't cover HBase sinks

I believe that the reason is simple. This page seems to be documenting flume version 1.1.0, however hbase sinks were added in flume version 1.2.0. Flume version 1.2.0 (with hbase sinks) is part of CDH4.1 and CDH3u5. Jarcec On Mon, Oct 08, 2012 at 10:50:31AM +0900, Soo Kim wrote: > Hi, > > I'm

Re: About custom source

Hi Guys, could you create a JIRA for that? Jarcec On Thu, Aug 02, 2012 at 01:43:24PM +0900, バーチャル クリストファー wrote: > I noticed this as well. It's a mistake in the documentation. > > The class signature should be: > > public class BarSource extends AbstractSource implements > Configurable, Pollabl

Re: HDFS Sink writeformat / filetype / serializer

Could you report behaviour that you consider as invalid to Flume JIRA (1)? Also please do not hesitate to submit patches for user guide describing your findings so that others with the same questions do not have to go through the same exercise. Jarcec 1: https://issues.apache.org/jira/browse/

Re: Production-Level Recoverable Memory Channel

Hi Yongcheng, I'm afraid that Recoverable Memory Channel was deprecated in favour of File Channel. Thanks for the hint about outdated documentation. We'll fix it. Jarcec On Mon, Jul 30, 2012 at 05:50:16PM +, Yongcheng Li wrote: > Hi, > > > > In "Flume 1.3.0-SNAPSHOT User Guide", it stat

Re: flume non-duplication guarantees?

1.2.0. > D is using 1.1.0 (because D has an HDFS sink and I am using an old version of > hadoop). > ________ > From: Jarek Jarcec Cecho [jar...@apache.org] > Sent: Thursday, July 26, 2012 6:15 PM > To: user@flume.apache.org > Subject: Re: flume non

Re: flume non-duplication guarantees?

What version of flume were you using Mark? Based on the "end-to-end configuration" , I would say that you're using old flume (version 0.9.x). If that is true, than the duplicity is unfortunately known flow. We've significantly redesigned flume in 1.x (known as flume-ng) to avoid such issues. J

Re: flume 1.2.0 bzip2 codec problem

Hi Jagadish, I believe that flume is using hadoop framework to get list of compression codecs. Is bzip2 codec available in your hadoop environment? You might want to check configuration property io.compression.codecs for inclusion of org.apache.hadoop.io.compress.BZip2Codec. Jarcec On Jul 25,

Re: Using Interceptors

Hi sir, we've recently significantly improved User guide. You could build it from svn trunk or you can download release candidate for upcoming version 1.2.0 from following link (see docs/FlumeUserGuide.html): https://people.apache.org/~mpercy/flume/apache-flume-1.2.0-rc1/apache-flume-1.2.0-bin.t

Re: [VOTE] GIT as primary source control for Apache Flume

[ X ] +1 Accept git as the primary source control for Apache Flume. Jarcec On Jul 16, 2012, at 8:58 AM, Rajesh Koilpillai wrote: > +1 > > On Mon, Jul 16, 2012 at 12:24 PM, Raymond Ng wrote: > +1 > > > On Sun, Jul 15, 2012 at 8:22 PM, Hari Shreedharan > wrote: > This is a call for VOTE to c

Re: Hbase Sink

On Thu, Jul 12, 2012 at 11:05:47AM -0700, Mohit Anchlia wrote: > Is there also a sink available for Hbase? Yes, version 1.2.0 that is currently under vote and should be released soon do contain Hbase sink. Jarcec signature.asc Description: Digital signature

Re: flume-ng syslogtcp issue

Hi Young, we've significantly improved user guide recently - you can get updated version either in repository (trunk) or in release 1.2.0 that is currently under vote (not released yet). Example of file_roll usage is present there. Jarcec On Jul 12, 2012, at 7:38 AM, Young Kim wrote: > After s