[jira] [Commented] (FLUME-2874) A new interceptor called Key Interceptor should be created to insert a header with key "key" which will be used in Kakfa Sink

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209874#comment-15209874 ] Ambud Sharma commented on FLUME-2874: - Can you leverage the Morphline interceptor htt

[jira] [Commented] (FLUME-2851) Flume Source IgnorePattern multiple regex

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209862#comment-15209862 ] Ambud Sharma commented on FLUME-2851: - Flume uses standard Java Regex > Flume Source

[jira] [Commented] (FLUME-2854) Parameterize jetty version in pom

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209860#comment-15209860 ] Ambud Sharma commented on FLUME-2854: - Please add details for this. > Parameterize je

[jira] [Commented] (FLUME-2859) flume Spooling Directory Source can't ingested gzip files.

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209858#comment-15209858 ] Ambud Sharma commented on FLUME-2859: - This is very simple, you can write your own cus

[jira] [Comment Edited] (FLUME-2859) flume Spooling Directory Source can't ingested gzip files.

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209858#comment-15209858 ] Ambud Sharma edited comment on FLUME-2859 at 3/24/16 6:32 AM: --

[jira] [Commented] (FLUME-2874) A new interceptor called Key Interceptor should be created to insert a header with key "key" which will be used in Kakfa Sink

2016-03-23 Thread Li Ye (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209855#comment-15209855 ] Li Ye commented on FLUME-2874: -- Please watch my another JIRA https://issues.apache.org/jira/b

[jira] [Commented] (FLUME-2870) Flume agent throw NULLPOINTEXCEPTION when use kakfa-source

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209852#comment-15209852 ] Ambud Sharma commented on FLUME-2870: - Is this apache or CDH? > Flume agent throw NUL

[jira] [Commented] (FLUME-2874) A new interceptor called Key Interceptor should be created to insert a header with key "key" which will be used in Kakfa Sink

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209846#comment-15209846 ] Ambud Sharma commented on FLUME-2874: - This would require changing the Kafka Sink and

[jira] [Commented] (FLUME-2880) how to config a custom hbase sink?

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209841#comment-15209841 ] Ambud Sharma commented on FLUME-2880: - Yes, that is the ideal way to handle it, you do

[jira] [Comment Edited] (FLUME-2880) how to config a custom hbase sink?

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209841#comment-15209841 ] Ambud Sharma edited comment on FLUME-2880 at 3/24/16 6:18 AM: --

[jira] [Commented] (FLUME-2882) Add Generic configuration provider

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209838#comment-15209838 ] Ambud Sharma commented on FLUME-2882: - Thank you, this is awesome. I started working o

[jira] [Commented] (FLUME-2885) Handle payloads larger than 2k via SyslogUDPSource

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209835#comment-15209835 ] Ambud Sharma commented on FLUME-2885: - A good idea would be to allow this as an option

[jira] [Commented] (FLUME-2887) Source fan-out and event duplication

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209832#comment-15209832 ] Ambud Sharma commented on FLUME-2887: - This is not a bug but expected behavior in my o

[jira] [Commented] (FLUME-2796) File Channel which queued more than 1TB data files got OOME when doing replay

2016-03-23 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209819#comment-15209819 ] Ambud Sharma commented on FLUME-2796: - The JVM configuration looks okay as does the fl

Re: Review Request 41702: Kafka Source support for new Consumer API FLUME-2821

2016-03-23 Thread Ashish Singh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41702/#review125122 --- flume-ng-doc/sphinx/FlumeUserGuide.rst (line 1202)

[jira] [Commented] (FLUME-2820) Support New Kafka APIs

2016-03-23 Thread Jarek Jarcec Cecho (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209030#comment-15209030 ] Jarek Jarcec Cecho commented on FLUME-2820: --- Updated channel and sink got severa

Re: Review Request 41702: Kafka Source support for new Consumer API FLUME-2821

2016-03-23 Thread Tristan Stevens
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41702/#review125060 --- Thanks for making the changes. Minor point from me but zookeeperCo

Re: Review Request 41702: Kafka Source support for new Consumer API FLUME-2821

2016-03-23 Thread Grigoriy Rozhkov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41702/ --- (Updated March 23, 2016, 4:59 p.m.) Review request for Flume, Grant Henke, Jare

Re: Review Request 41702: Kafka Source support for new Consumer API FLUME-2821

2016-03-23 Thread Grigoriy Rozhkov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41702/ --- (Updated March 23, 2016, 4:48 p.m.) Review request for Flume, Grant Henke, Jare

Re: Review Request 41702: Kafka Source support for new Consumer API FLUME-2821

2016-03-23 Thread Grigoriy Rozhkov
> On March 23, 2016, 1:35 p.m., Jeff Holoman wrote: > > flume-ng-sources/flume-kafka-source/src/main/java/org/apache/flume/source/kafka/KafkaSource.java, > > line 343 > > > > > > we are calling wakeup() here, do we

Re: Review Request 41702: Kafka Source support for new Consumer API FLUME-2821

2016-03-23 Thread Grigoriy Rozhkov
> On March 23, 2016, 1:35 p.m., Jeff Holoman wrote: > > pom.xml, line 53 > > > > > > Lets go ahead and bump this to 9.0.1 Ok, I aggree! - Grigoriy --- This

Re: Review Request 41702: Kafka Source support for new Consumer API FLUME-2821

2016-03-23 Thread Jeff Holoman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41702/#review125018 --- Looks pretty good. I agree with Tristan's comment about the transl