Mubarak Seyed created FLUME-1371:
------------------------------------

             Summary: ElasticSearch Sink
                 Key: FLUME-1371
                 URL: https://issues.apache.org/jira/browse/FLUME-1371
             Project: Flume
          Issue Type: New Feature
          Components: Sinks+Sources
            Reporter: Mubarak Seyed


Motivation: 
Some production usecase(s) requires event(log) to be indexed and searched. 
There are workarounds (e.g. store the log in HDFS and run MapReduce job to 
create an index) but lack of near real-time indexing and search latency are 
concerns for searching the log records.

Design:
ElasticSearch supports RESTful style API to publish events for indexing.

There is an existing ??flumeelastic?? sink [1] in github but it does not 
support batching of events for indexing.

[1] https://github.com/Aconex/elasticflume


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to