Re: New Flafka component - "kafka consumer" channel

Hari, Got some time to try out the 'parseAsFlumeEvent' option in the Kafka channel. Basically I used it as a Kafka consumer. I am seeing about *140 MB/sec* with 1 NullSunk on a VM setup. (This was on a VM ). I used 1000 byte events and Kafka broker was local. This number is indeed promisin

[jira] [Commented] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942025#comment-14942025 ] Hudson commented on FLUME-2798: --- FAILURE: Integrated in Flume-trunk-hbase-1 #128 (See [http

Build failed in Jenkins: Flume-trunk-hbase-1 #128

See Changes: [roshan] FLUME-2798. Malformed Syslog messages can lead to OutOfMemoryException -- [...truncated 2261 lines...] [INFO] [INFO] --- maven-resources-plugin:2.4.3:resources (default-

[jira] [Resolved] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik resolved FLUME-2798. Resolution: Fixed Fix Version/s: v1.7.0 > Malformed Syslog messages can lead to OutOfMemoryEx

[jira] [Commented] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941944#comment-14941944 ] Roshan Naik commented on FLUME-2798: Its committed. Thanks very much for the patch [

[jira] [Updated] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2798: --- Assignee: Phil D'Amore > Malformed Syslog messages can lead to OutOfMemoryException >

[jira] [Commented] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941940#comment-14941940 ] ASF subversion and git services commented on FLUME-2798: Commit 7d

[jira] [Commented] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941938#comment-14941938 ] ASF subversion and git services commented on FLUME-2798: Commit c8

[jira] [Commented] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941911#comment-14941911 ] Roshan Naik commented on FLUME-2798: This patch looks good to me. +1 > Malformed Sy

[jira] [Updated] (FLUME-2804) Hive sink - abort remaining transactions on shutdown

[ https://issues.apache.org/jira/browse/FLUME-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2804: --- Assignee: Sriharsha Chintalapani > Hive sink - abort remaining transactions on shutdown >

[jira] [Updated] (FLUME-2806) flume-ng.ps1 Error running script to start an agent on Windows

[ https://issues.apache.org/jira/browse/FLUME-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liam Mousseau updated FLUME-2806: - Attachment: flume-ng.ps1.txt Attaching fixed file > flume-ng.ps1 Error running script to start an

[jira] [Updated] (FLUME-2806) flume-ng.ps1 Error running script to start an agent on Windows

[ https://issues.apache.org/jira/browse/FLUME-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liam Mousseau updated FLUME-2806: - Affects Version/s: v1.6.0 > flume-ng.ps1 Error running script to start an agent on Windows > -

[jira] [Commented] (FLUME-2806) flume-ng.ps1 Error running script to start an agent on Windows

[ https://issues.apache.org/jira/browse/FLUME-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941637#comment-14941637 ] Liam Mousseau commented on FLUME-2806: -- Adding link to feature that introduced the bu

[jira] [Created] (FLUME-2806) flume-ng.ps1 Error running script to start an agent on Windows

Liam Mousseau created FLUME-2806: Summary: flume-ng.ps1 Error running script to start an agent on Windows Key: FLUME-2806 URL: https://issues.apache.org/jira/browse/FLUME-2806 Project: Flume

[jira] [Commented] (FLUME-2437) S3 Source

[ https://issues.apache.org/jira/browse/FLUME-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941465#comment-14941465 ] Ashish Paliwal commented on FLUME-2437: --- [~jrufus] The patch needs rebasing. Could y

[jira] [Commented] (FLUME-2787) org.apache.flume.sink.elasticsearch.ElasticSearchDynamicSerializer does not serialize @timestamp correctly

[ https://issues.apache.org/jira/browse/FLUME-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941281#comment-14941281 ] Tianji Li commented on FLUME-2787: -- Great point! The default serializer is ElasticSearch

[jira] [Comment Edited] (FLUME-2787) org.apache.flume.sink.elasticsearch.ElasticSearchDynamicSerializer does not serialize @timestamp correctly

[ https://issues.apache.org/jira/browse/FLUME-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941281#comment-14941281 ] Tianji Li edited comment on FLUME-2787 at 10/2/15 3:45 PM: --- Grea

[jira] [Commented] (FLUME-2792) Flume Kafka Kerberos Support

[ https://issues.apache.org/jira/browse/FLUME-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940905#comment-14940905 ] Hari Sekhon commented on FLUME-2792: I actually needed the Flume Kafka source with Ker

[jira] [Commented] (FLUME-2787) org.apache.flume.sink.elasticsearch.ElasticSearchDynamicSerializer does not serialize @timestamp correctly

[ https://issues.apache.org/jira/browse/FLUME-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940847#comment-14940847 ] Eran W commented on FLUME-2787: --- Thanks for the update. One question, How do we explain that