[jira] [Created] (FLUME-2544) Windows: Incorrect Path Separator used in HDFS path (HDFS Sink)

2014-11-10 Thread Roshan Naik (JIRA)
Roshan Naik created FLUME-2544: -- Summary: Windows: Incorrect Path Separator used in HDFS path (HDFS Sink) Key: FLUME-2544 URL: https://issues.apache.org/jira/browse/FLUME-2544 Project: Flume

[jira] [Updated] (FLUME-2544) Windows: Incorrect Path Separator used in HDFS path (HDFS Sink)

2014-11-10 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2544: --- Attachment: FLUME-2544.patch Uploading patch Windows: Incorrect Path Separator used in HDFS path

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
It does not look like we ever actually included the dev-support directory in the source tarball (I checked 1.3.1,1.4.0 and 1.5.0.1). If we need a re-spin for another reason, I will try to fix the release process to pull this in and remove the iml files.  Arvind - does that sound good to

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
Roshan, The Avro Source does make it configurable - https://git-wip-us.apache.org/repos/asf?p=flume.git;a=blob;f=flume-ng-core/src/main/java/org/apache/flume/source/AvroSource.java;h=59ee43a8e1b758ca3d98ba572a885ee2f01b7bed;hb=HEAD#l185 But the HTTPSource disables it completely (it is

[jira] [Commented] (FLUME-2307) Remove Log writetimeout

2014-11-10 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205212#comment-14205212 ] Hari Shreedharan commented on FLUME-2307: - Which version of Flume? OS details and

[jira] [Commented] (FLUME-2307) Remove Log writetimeout

2014-11-10 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205225#comment-14205225 ] Hari Shreedharan commented on FLUME-2307: - Your checkpoint interval is set to 27+

[jira] [Commented] (FLUME-2307) Remove Log writetimeout

2014-11-10 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205230#comment-14205230 ] Hari Shreedharan commented on FLUME-2307: - Sorry - my mistake. That is in millis.

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Roshan Naik
Looks like most major companies/products are moving away from SSLv2 3 very quickly. I am ok with disabling it completely and allowing user to add more protocols to disable list. Not a security expert not sure how much of a backward compat issue this implies. I am fine with supporting the hard

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Arvind Prabhakar
That sounds good to me. Thanks for working on this release Hari. Regards, Arvind Prabhakar On Mon, Nov 10, 2014 at 11:10 AM, Hari Shreedharan hshreedha...@cloudera.com wrote: It does not look like we ever actually included the dev-support directory in the source tarball (I checked

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
The HTTP Source does not have any config parameter in the user guide. Only for the Avro Source, is there configuration mentioned in the user guide (though for now, it is possible to use SSLv3, but we can disable that in a future release - right now we provide the option, so I guess that would

Re: Kafka Channel vs Kafka Sink?

2014-11-10 Thread Hari Shreedharan
Yes, you can. I came up with 2 use-cases where the Kafka channel is useful (in addition to the HA aspect of the channel). 1. Receive data from various sources (even Kafka itself) - and modify it using interceptors and write out to Kafka. This would be lower latency than using a channel +

Re: Using CodaHale metrics for monitoring

2014-11-10 Thread Hari Shreedharan
Is it easier to use than the current one and/or does it give better performance? You’d need to support the current metrics API (MonitoredCounterGroup, SourceCounter, SinkCounter, ChannelCounter etc). Thanks, Hari On Sat, Nov 8, 2014 at 8:21 PM, Ashish paliwalash...@gmail.com wrote: Hi,

Re: [ANNOUNCE] New Flume PMC Member - Roshan Naik

2014-11-10 Thread Mike Percy
Welcome Roshan, and congrats. Mike On Wed, Nov 5, 2014 at 5:50 PM, Gwen Shapira gshap...@cloudera.com wrote: Congrats, Roshan :) Very much deserved. On Tue, Nov 4, 2014 at 2:12 PM, Arvind Prabhakar arv...@apache.org wrote: On behalf of Apache Flume PMC, it is my pleasure to announce

Re: Kafka Channel vs Kafka Sink?

2014-11-10 Thread Ashish
Thanks! Storm Spout was more to connect Flume to Storm, rather than writing to HDFS. What I meant was, may be don't need Storm Sink anymore. On Tue, Nov 11, 2014 at 4:45 AM, Hari Shreedharan hshreedha...@cloudera.com wrote: Yes, you can. I came up with 2 use-cases where the Kafka channel is

Re: Using CodaHale metrics for monitoring

2014-11-10 Thread Ashish
Codahale does have lot more features like the rate/sec one, which is most needed metrics. It provides a lot of reporters out of box (Nagios, HTTP, Ganglia, Graphite, Console etc) so we just need to enable it, rather than writing custom components. As of now we have to hide it within

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Roshan Naik
Wouldnt we want to document in the http source section that SSL is being blocked ? -roshan On Mon, Nov 10, 2014 at 2:56 PM, Hari Shreedharan hshreedha...@cloudera.com wrote: The HTTP Source does not have any config parameter in the user guide. Only for the Avro Source, is there configuration

[jira] [Commented] (FLUME-2497) TCP and UDP syslog sources parsing the timestamp incorrectly

2014-11-10 Thread Mike Percy (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205834#comment-14205834 ] Mike Percy commented on FLUME-2497: --- +1 lgtm. I have a couple minor nits (add a couple

[jira] [Commented] (FLUME-2497) TCP and UDP syslog sources parsing the timestamp incorrectly

2014-11-10 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205864#comment-14205864 ] ASF subversion and git services commented on FLUME-2497: Commit

[jira] [Commented] (FLUME-2497) TCP and UDP syslog sources parsing the timestamp incorrectly

2014-11-10 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205865#comment-14205865 ] ASF subversion and git services commented on FLUME-2497: Commit

[jira] [Commented] (FLUME-2497) TCP and UDP syslog sources parsing the timestamp incorrectly

2014-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205890#comment-14205890 ] Hudson commented on FLUME-2497: --- SUCCESS: Integrated in flume-trunk #691 (See

[jira] [Commented] (FLUME-2385) Flume spans log file with Spooling Directory Source runner has shutdown messages at INFO level

2014-11-10 Thread Ye Xianjin (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205891#comment-14205891 ] Ye Xianjin commented on FLUME-2385: --- hi, [~scaph01], I think (according to my colleague)

[jira] [Commented] (FLUME-2497) TCP and UDP syslog sources parsing the timestamp incorrectly

2014-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205898#comment-14205898 ] Hudson commented on FLUME-2497: --- SUCCESS: Integrated in Flume-trunk-hbase-98 #48 (See

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
I will update the documentation before I post it to the website — that should be good. Thanks, Hari On Mon, Nov 10, 2014 at 6:18 PM, Roshan Naik ros...@hortonworks.com wrote: Wouldnt we want to document in the http source section that SSL is being blocked ? -roshan On Mon, Nov 10, 2014 at

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
My vote:  +1. * Verified checksums * Verified signatures * Checked NOTICE, CHANGELOG, README, RELEASE-NOTES etc. Thanks, Hari On Mon, Nov 10, 2014 at 6:18 PM, Roshan Naik ros...@hortonworks.com wrote: Wouldnt we want to document in the http source section that SSL is being blocked

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Jarek Jarcec Cecho
+1 * Verified checksums and signature files * Verified that each jar in binary tarball is in the license * Checked top level files (NOTICE, ...) * Run tests Jarcec On Nov 6, 2014, at 3:17 PM, Hari Shreedharan hshreedha...@cloudera.com wrote: This is the seventh release for Apache Flume as

[jira] [Commented] (FLUME-2385) Flume spans log file with Spooling Directory Source runner has shutdown messages at INFO level

2014-11-10 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205980#comment-14205980 ] Hari Shreedharan commented on FLUME-2385: - +1. Running tests and committing.

[jira] [Commented] (FLUME-2385) Flume spans log file with Spooling Directory Source runner has shutdown messages at INFO level

2014-11-10 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206031#comment-14206031 ] ASF subversion and git services commented on FLUME-2385: Commit

[jira] [Commented] (FLUME-2385) Flume spans log file with Spooling Directory Source runner has shutdown messages at INFO level

2014-11-10 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206030#comment-14206030 ] ASF subversion and git services commented on FLUME-2385: Commit

Re: [VOTE] Release Apache Flume 1.5.1 RC1

2014-11-10 Thread Hari Shreedharan
This vote is now closed.  This vote has passed with 4 +1 binding votes: - Arvind Prabhakar - Roshan Naik - Hari Shreedharan - Jarcec Non-binding +1 votes: - Ashish Paliwal No +0 or -1 votes were received. As a result, this RC has passed and will be promoted to the Apache Flume

Jenkins build became unstable: Flume-trunk-hbase-98 #49

2014-11-10 Thread Apache Jenkins Server
See https://builds.apache.org/job/Flume-trunk-hbase-98/49/changes

[jira] [Commented] (FLUME-2385) Flume spans log file with Spooling Directory Source runner has shutdown messages at INFO level

2014-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206087#comment-14206087 ] Hudson commented on FLUME-2385: --- UNSTABLE: Integrated in Flume-trunk-hbase-98 #49 (See