[jira] [Commented] (FLUME-1227) Introduce some sort of SpillableChannel

2013-03-21 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13608700#comment-13608700 ] Roshan Naik commented on FLUME-1227: Thanks Hari. 1) WRT the concern on not

[jira] [Created] (FLUME-1956) FileChannel LogFile.SequentialReader should use buffered io

2013-03-21 Thread Brock Noland (JIRA)
Brock Noland created FLUME-1956: --- Summary: FileChannel LogFile.SequentialReader should use buffered io Key: FLUME-1956 URL: https://issues.apache.org/jira/browse/FLUME-1956 Project: Flume

[jira] [Commented] (FLUME-997) Support secure transport mechanism

2013-03-21 Thread Joey Echeverria (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609017#comment-13609017 ] Joey Echeverria commented on FLUME-997: --- Thanks for the initial review Mike. I've

Jenkins build is back to normal : flume-trunk #381

2013-03-21 Thread Apache Jenkins Server
See https://builds.apache.org/job/flume-trunk/381/

[jira] [Created] (FLUME-1957) FileChannel should print channel size when in stop method

2013-03-21 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created FLUME-1957: --- Summary: FileChannel should print channel size when in stop method Key: FLUME-1957 URL: https://issues.apache.org/jira/browse/FLUME-1957 Project: Flume

[jira] [Updated] (FLUME-1957) FileChannel should print channel size when it stops

2013-03-21 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated FLUME-1957: Summary: FileChannel should print channel size when it stops (was: FileChannel should

[jira] [Commented] (FLUME-1957) FileChannel should print channel size when it stops

2013-03-21 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609324#comment-13609324 ] Roshan Naik commented on FLUME-1957: This should be the case with all channels

[jira] [Commented] (FLUME-1957) FileChannel should print channel size when it stops

2013-03-21 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609342#comment-13609342 ] Hari Shreedharan commented on FLUME-1957: - I agree, we should do it in the

[jira] [Commented] (FLUME-1227) Introduce some sort of SpillableChannel

2013-03-21 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609360#comment-13609360 ] Hari Shreedharan commented on FLUME-1227: - {quote} 1) WRT the concern on not

Re: Review Request: FLUME-1516. Write dual checkpoints.

2013-03-21 Thread Hari Shreedharan
On March 21, 2013, 3:01 a.m., Brock Noland wrote: Looks great Hari! One item I am not convinced we need is the backupCheckpoint{writeorderid/position}. It adds complexity for not a terrible amount of benefit. In the case we cannot seek into the file we will have to read all the

Flume-ng (v1.3.0) multi tail or tailing directory

2013-03-21 Thread Dibyajyoti Ghosh
Hi flume-dev, In flume v1.3.0 bundled with cdh-4.2.0 I am aware of exec source where one can do 'tail -f' for a single mutable file. Spool-dir is available but files have to be uniquely named and immutable. Is there some way I can tail a directory much like multi tail / tailDir option in the

Re: Flume-ng (v1.3.0) multi tail or tailing directory

2013-03-21 Thread Dibyajyoti Ghosh
Hi, I understand that tail can be applied to multiple files at once but that will combine all output together and my intension is to keep log data from different files separate from each other. Another way is to treat each file to monitor as distinct sources and then write output to distinct

[jira] [Commented] (FLUME-1227) Introduce some sort of SpillableChannel

2013-03-21 Thread Juhani Connolly (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609824#comment-13609824 ] Juhani Connolly commented on FLUME-1227: I had a look at the design doc and

[jira] [Commented] (FLUME-1227) Introduce some sort of SpillableChannel

2013-03-21 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609911#comment-13609911 ] Hari Shreedharan commented on FLUME-1227: - Hi Juhani, Thanks for you comments. I

[jira] [Commented] (FLUME-1787) Implement Pre-commit testing with Jenkins

2013-03-21 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609962#comment-13609962 ] Hari Shreedharan commented on FLUME-1787: - Hey Brock, Is this ready for commit?

[jira] [Commented] (FLUME-1787) Implement Pre-commit testing with Jenkins

2013-03-21 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609967#comment-13609967 ] Hari Shreedharan commented on FLUME-1787: - Committed to trunk and flume-1.4, rev:

[jira] [Commented] (FLUME-1516) Write Dual Checkpoints to avoid replays

2013-03-21 Thread Flume QA (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609969#comment-13609969 ] Flume QA commented on FLUME-1516: - Here are the results of testing the latest attachment