[jira] [Commented] (FLUME-2484) NullPointerException in Kafka Sink test

2015-03-24 Thread simonchi (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379332#comment-14379332 ] simonchi commented on FLUME-2484: - here is my kafka sink https://github.com/cwtree/flume-

[jira] [Commented] (FLUME-2650) Sinkgroup round robin load balancer hits first sink repeatedly

2015-03-24 Thread simonchi (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379319#comment-14379319 ] simonchi commented on FLUME-2650: - the load_balance sinkgroup has a pushishment mechanism,

[jira] [Updated] (FLUME-2650) Sinkgroup round robin load balancer hits first sink repeatedly

2015-03-24 Thread Tim Chng (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Chng updated FLUME-2650: Attachment: CHANGELOG This is the CHANGELOG in the install directory of the mapR flume. > Sinkgroup round r

[jira] [Commented] (FLUME-2650) Sinkgroup round robin load balancer hits first sink repeatedly

2015-03-24 Thread Tim Chng (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378796#comment-14378796 ] Tim Chng commented on FLUME-2650: - According to MapR the release notes state that it is ve

Re: hdfs.retryInterval - issues

2015-03-24 Thread Roshan Naik
My bad... Notice that setting it to 0 overrides the value to Integer.MAX_VALUE. So setting it to 0 is equivalent to Integer.MAX_VALUE (the default). So the documentation that default is 0 ... is fine. From: Roshan Naik mailto:ros...@hortonworks.com>> Date: Tuesday, March 24, 2015 2:54 PM To: "

Re: hdfs.retryInterval - issues

2015-03-24 Thread Hari Shreedharan
Can you file a jira? We should fix it in that case. Thanks, Hari On Tue, Mar 24, 2015 at 2:49 PM, Roshan Naik wrote: > hdfs.retryInterval seems to have a some issues. > * The default is not 0 as documented. > * This statement does not seem to reflect the implementation: "If set to

Re: hdfs.retryInterval - issues

2015-03-24 Thread Roshan Naik
Sorry for typo I meant to say 'hdfs.closeTries' and not 'hdfs.retryInterval' -roshan From: Roshan Naik mailto:ros...@hortonworks.com>> Date: Tuesday, March 24, 2015 2:52 PM To: "dev@flume.apache.org" mailto:dev@flume.apache.org>> Subject: hdfs.retryInterval - iss

[jira] [Commented] (FLUME-2650) Sinkgroup round robin load balancer hits first sink repeatedly

2015-03-24 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378718#comment-14378718 ] Hari Shreedharan commented on FLUME-2650: - What version of Flume is this? I don't

hdfs.retryInterval - issues

2015-03-24 Thread Roshan Naik
hdfs.retryInterval seems to have a some issues. * The default is not 0 as documented. * This statement does not seem to reflect the implementation: "If set to 0, the sink will try to close the file until the file is eventually closed". Setting it to 0 seems to be same as setting it to

[jira] [Comment Edited] (FLUME-2650) Sinkgroup round robin load balancer hits first sink repeatedly

2015-03-24 Thread Tim Chng (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378711#comment-14378711 ] Tim Chng edited comment on FLUME-2650 at 3/24/15 9:48 PM: -- We hav

[jira] [Commented] (FLUME-2650) Sinkgroup round robin load balancer hits first sink repeatedly

2015-03-24 Thread Tim Chng (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378711#comment-14378711 ] Tim Chng commented on FLUME-2650: - We have an application that has a 96 thread pool that s

[jira] [Comment Edited] (FLUME-2650) Sinkgroup round robin load balancer hits first sink repeatedly

2015-03-24 Thread Tim Chng (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378497#comment-14378497 ] Tim Chng edited comment on FLUME-2650 at 3/24/15 8:16 PM: -- we hav

[jira] [Comment Edited] (FLUME-2650) Sinkgroup round robin load balancer hits first sink repeatedly

2015-03-24 Thread Tim Chng (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378497#comment-14378497 ] Tim Chng edited comment on FLUME-2650 at 3/24/15 8:16 PM: -- we hav

[jira] [Commented] (FLUME-2650) Sinkgroup round robin load balancer hits first sink repeatedly

2015-03-24 Thread Tim Chng (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378497#comment-14378497 ] Tim Chng commented on FLUME-2650: - we have 64 sinks in our sinkgroup: agent.sinkgroups.si

[jira] [Created] (FLUME-2650) Sinkgroup round robin load balancer hits first sink repeatedly

2015-03-24 Thread Tim Chng (JIRA)
Tim Chng created FLUME-2650: --- Summary: Sinkgroup round robin load balancer hits first sink repeatedly Key: FLUME-2650 URL: https://issues.apache.org/jira/browse/FLUME-2650 Project: Flume Issue Typ

[jira] [Commented] (FLUME-2635) Documentation for zookeeper dynamic configuration in flume

2015-03-24 Thread Ashish Paliwal (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14377606#comment-14377606 ] Ashish Paliwal commented on FLUME-2635: --- [~roshan_naik] Welcome back :) Thanks for f