Re: WELCOME to dev@flume.apache.org

2015-10-01 Thread Shiva Ram
Set files are placed in the remote server[not a hadoop cluster node], which source type is suitable for collecting these files from remote server to HDFS using Flume. The initial study on Flume, I came to know source type "Exec", "Spooling Directory" can be used to collect these file, I want to kno

[jira] [Comment Edited] (FLUME-2787) org.apache.flume.sink.elasticsearch.ElasticSearchDynamicSerializer does not serialize @timestamp correctly

2015-10-01 Thread Tianji Li (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940488#comment-14940488 ] Tianji Li edited comment on FLUME-2787 at 10/2/15 3:12 AM: --- We e

[jira] [Updated] (FLUME-2787) org.apache.flume.sink.elasticsearch.ElasticSearchDynamicSerializer does not serialize @timestamp correctly

2015-10-01 Thread Tianji Li (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianji Li updated FLUME-2787: - Attachment: FLUME-2787.2.patch Reformatted code to use 2 spaces rather than tabs > org.apache.flume.sink.

[jira] [Commented] (FLUME-2437) S3 Source

2015-10-01 Thread Otis Gospodnetic (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940711#comment-14940711 ] Otis Gospodnetic commented on FLUME-2437: - +1 for getting this in. I see [~jrufus

[jira] [Commented] (FLUME-2437) S3 Source

2015-10-01 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940710#comment-14940710 ] Hari Shreedharan commented on FLUME-2437: - Nope. You reviewed it, if you think it

[jira] [Commented] (FLUME-2792) Flume Kafka Kerberos Support

2015-10-01 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940582#comment-14940582 ] Roshan Naik commented on FLUME-2792: Here are some notes that i gathered from talking

[jira] [Commented] (FLUME-2787) org.apache.flume.sink.elasticsearch.ElasticSearchDynamicSerializer does not serialize @timestamp correctly

2015-10-01 Thread Tianji Li (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940488#comment-14940488 ] Tianji Li commented on FLUME-2787: -- We experienced similar issues in our work and figured

[jira] [Updated] (FLUME-2787) org.apache.flume.sink.elasticsearch.ElasticSearchDynamicSerializer does not serialize @timestamp correctly

2015-10-01 Thread Tianji Li (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianji Li updated FLUME-2787: - Attachment: FLUME-2787.patch > org.apache.flume.sink.elasticsearch.ElasticSearchDynamicSerializer does not

[jira] [Commented] (FLUME-2437) S3 Source

2015-10-01 Thread Ashish Paliwal (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940419#comment-14940419 ] Ashish Paliwal commented on FLUME-2437: --- Cool. [~hshreedharan] Do you have an concer

[jira] [Commented] (FLUME-2437) S3 Source

2015-10-01 Thread Johny Rufus (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940414#comment-14940414 ] Johny Rufus commented on FLUME-2437: Sure [~ashishpaliwal], I think I addressed all th

[jira] [Commented] (FLUME-2437) S3 Source

2015-10-01 Thread Ashish Paliwal (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940288#comment-14940288 ] Ashish Paliwal commented on FLUME-2437: --- [~jrufus] Shall we push this in as an exper

[jira] [Updated] (FLUME-2437) S3 Source

2015-10-01 Thread Ashish Paliwal (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Paliwal updated FLUME-2437: -- Assignee: Johny Rufus (was: Ashish Paliwal) > S3 Source > - > > Key: FL