Re: Speaker for MeetUp?

2014-08-26 Thread Dave Mangot
We usually have them every two months. I think the last one might have been in July and since I'm an architect at Salesforce, I've been lucky enough to be able to hold the MeetUp there reliably. Cheers, -Dave On Mon, Aug 25, 2014 at 8:08 PM, Arvind Prabhakar wrote: > Hi Dave, > > I will be

Re: Flume 1.4 HDFS Sink Cannot Reconnect

2014-08-26 Thread Andrew O'Neill
Per Roshan’s request, I have filed a bug for this issue. For those interested, here is the link to the issue: https://issues.apache.org/jira/browse/FLUME-2451 Hopefully this will create some visibility on this problem. Thanks, Andrew From: Roshan Naik mailto:ros...@hortonworks.com>> Reply-To:

Re: Flume 1.4 HDFS Sink Cannot Reconnect

2014-08-26 Thread Roshan Naik
Please file a bug for this with the details provided in your email. On Tue, Aug 26, 2014 at 9:44 AM, Gary Malouf wrote: > +1 I've seen this same issue. > > > On Tue, Aug 26, 2014 at 12:33 PM, Andrew O'Neill > wrote: > >> Hello all, >> >> My setup: >> - Flume 1.4 >> - CDH 4.2.2 (2.0.0-c

Re: Flume 1.4 HDFS Sink Cannot Reconnect

2014-08-26 Thread Gary Malouf
+1 I've seen this same issue. On Tue, Aug 26, 2014 at 12:33 PM, Andrew O'Neill wrote: > Hello all, > > My setup: > - Flume 1.4 > - CDH 4.2.2 (2.0.0-cdh4.2.2) > > > I am testing a simple flume setup with a Sequence Generator Source, a File > Channel, and an HDFS Sink (see my flume.conf b

Flume 1.4 HDFS Sink Cannot Reconnect

2014-08-26 Thread Andrew O'Neill
Hello all, My setup: - Flume 1.4 - CDH 4.2.2 (2.0.0-cdh4.2.2) I am testing a simple flume setup with a Sequence Generator Source, a File Channel, and an HDFS Sink (see my flume.conf below). This configuration works as expected until I reboot the cluster’s NameNode or until I restart th

Invalid UTF-32 character exception

2014-08-26 Thread Simeon Zaharici
Hi guys, I am getting invalid utf-32 character exceptions in the Elasticsearch sink. It happens on very busy flume servers and as a result the whole delivery of messages to elasticsearch grinds to a halt.  I am not sure if it is related to this issue  https://issues.apache.org/jira/browse/FLUME-

Re: Flume Avro Source and Avro C api

2014-08-26 Thread Sebastiano Di Paola
Hi, As I'm still planning how to do to transport my data, I can use Thrift as well, but how does Thrift and Avro integrates? Avro seems very interesting to serialize data and also pretty straightforward (define a schema -> transform data -> read data again using the same schema). It's not clear to