Repository: ambari Updated Branches: refs/heads/trunk f0d970b5b -> 4f36e1454
AMBARI-21144 ADDENDUM - Create .md files to describe Log Search input configurations (oleewere) Project: http://git-wip-us.apache.org/repos/asf/ambari/repo Commit: http://git-wip-us.apache.org/repos/asf/ambari/commit/4f36e145 Tree: http://git-wip-us.apache.org/repos/asf/ambari/tree/4f36e145 Diff: http://git-wip-us.apache.org/repos/asf/ambari/diff/4f36e145 Branch: refs/heads/trunk Commit: 4f36e1454dd37396782ef6497629192c603d5baf Parents: f0d970b Author: oleewere <oleew...@gmail.com> Authored: Wed May 31 11:29:08 2017 +0200 Committer: oleewere <oleew...@gmail.com> Committed: Wed May 31 11:29:08 2017 +0200 ---------------------------------------------------------------------- .../ambari-logsearch-logfeeder/README.md | 15 ++++++++------- .../ambari-logsearch-logfeeder/docs/filter.md | 6 +++--- .../ambari-logsearch-logfeeder/docs/input.md | 6 +++--- .../ambari-logsearch-logfeeder/docs/inputConfig.md | 2 +- .../ambari-logsearch-logfeeder/docs/postMapValues.md | 10 +++++----- 5 files changed, 20 insertions(+), 19 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/ambari/blob/4f36e145/ambari-logsearch/ambari-logsearch-logfeeder/README.md ---------------------------------------------------------------------- diff --git a/ambari-logsearch/ambari-logsearch-logfeeder/README.md b/ambari-logsearch/ambari-logsearch-logfeeder/README.md index c5c6848..5a64daf 100644 --- a/ambari-logsearch/ambari-logsearch-logfeeder/README.md +++ b/ambari-logsearch/ambari-logsearch-logfeeder/README.md @@ -17,26 +17,27 @@ limitations under the License. {% endcomment %} --> -#Log Search - Log Feeder: +# Log Search - Log Feeder: Log Feeder is a component of the Log Search service that reads logs, parses them and stores them in Apache Solr for the purpose of later analysis. -#Compilation +# Compilation +```bash mvn clean compile package - -#Deploy -##Copy to remote +``` +# Deploy +## Copy to remote copy target/logsearch-logfeeder.tgz to host machine -##Setup environment +## Setup environment ```bash mkdir /opt/logfeeder cd /opt/logfeeder tar xfz ~/logsearch-logfeeder.tar.gz ``` -#Input Configuration +# Input Configuration The configuration for the log feeder contains * description of the log files http://git-wip-us.apache.org/repos/asf/ambari/blob/4f36e145/ambari-logsearch/ambari-logsearch-logfeeder/docs/filter.md ---------------------------------------------------------------------- diff --git a/ambari-logsearch/ambari-logsearch-logfeeder/docs/filter.md b/ambari-logsearch/ambari-logsearch-logfeeder/docs/filter.md index 42c3271..129279b 100644 --- a/ambari-logsearch/ambari-logsearch-logfeeder/docs/filter.md +++ b/ambari-logsearch/ambari-logsearch-logfeeder/docs/filter.md @@ -17,7 +17,7 @@ limitations under the License. {% endcomment %} --> -#Filter +# Filter The filter element in the [input configuration](inputConfig.md) contains a list of filter descriptions, each describing one filter applied on an input. @@ -35,7 +35,7 @@ The general elements in the json are the following: | is\_enabled | A flag to show if the filter should be used | true | -##Grok Filter +## Grok Filter Grok filters have the following additional parameters: @@ -46,7 +46,7 @@ Grok filters have the following additional parameters: | message\_pattern | The grok pattern to use to parse the log entry | - | -##Key-value Filter +## Key-value Filter Key-value filters have the following additional parameters: http://git-wip-us.apache.org/repos/asf/ambari/blob/4f36e145/ambari-logsearch/ambari-logsearch-logfeeder/docs/input.md ---------------------------------------------------------------------- diff --git a/ambari-logsearch/ambari-logsearch-logfeeder/docs/input.md b/ambari-logsearch/ambari-logsearch-logfeeder/docs/input.md index e95401a..661eeb8 100644 --- a/ambari-logsearch/ambari-logsearch-logfeeder/docs/input.md +++ b/ambari-logsearch/ambari-logsearch-logfeeder/docs/input.md @@ -17,7 +17,7 @@ limitations under the License. {% endcomment %} --> -#Input +# Input The input element in the [input configuration](inputConfig.md) contains a list of input descriptions, each describing one source of input. @@ -42,7 +42,7 @@ The general elements in the json are the following: | is\_enabled | A flag to show if the input should be used | true | -##File Input +## File Input File inputs have the following parameters too: @@ -53,7 +53,7 @@ File inputs have the following parameters too: | copy\_file | Should the file be copied \(only if not processed\) | false | -##S3 File Input +## S3 File Input S3 file inputs have the following parameters in addition to the general file parameters: http://git-wip-us.apache.org/repos/asf/ambari/blob/4f36e145/ambari-logsearch/ambari-logsearch-logfeeder/docs/inputConfig.md ---------------------------------------------------------------------- diff --git a/ambari-logsearch/ambari-logsearch-logfeeder/docs/inputConfig.md b/ambari-logsearch/ambari-logsearch-logfeeder/docs/inputConfig.md index ae7ac05..a507bfd 100644 --- a/ambari-logsearch/ambari-logsearch-logfeeder/docs/inputConfig.md +++ b/ambari-logsearch/ambari-logsearch-logfeeder/docs/inputConfig.md @@ -17,7 +17,7 @@ limitations under the License. {% endcomment %} --> -#Input Configuration +# Input Configuration The input configurations are stored in json files. Each of them are describing the processing of the log files of a service. http://git-wip-us.apache.org/repos/asf/ambari/blob/4f36e145/ambari-logsearch/ambari-logsearch-logfeeder/docs/postMapValues.md ---------------------------------------------------------------------- diff --git a/ambari-logsearch/ambari-logsearch-logfeeder/docs/postMapValues.md b/ambari-logsearch/ambari-logsearch-logfeeder/docs/postMapValues.md index aa381cd..906359a 100644 --- a/ambari-logsearch/ambari-logsearch-logfeeder/docs/postMapValues.md +++ b/ambari-logsearch/ambari-logsearch-logfeeder/docs/postMapValues.md @@ -17,14 +17,14 @@ limitations under the License. {% endcomment %} --> -#Post Map Values +# Post Map Values The Post Map Values element in the [filter](filter.md) field names as keys, the values are lists of sets of post map values, each describing one mapping done on a field named before obtained after filtering. Currently there are four kind of mappings are supported: -##Map Date +## Map Date The name of the mapping element should be map\_date. The value json element may contain the following parameters: @@ -34,7 +34,7 @@ The name of the mapping element should be map\_date. The value json element may | target\_date\_pattern | If 'epoch' then the field is parsed as seconds from 1970, otherwise the content used as pattern | -##Map Copy +## Map Copy The name of the mapping element should be map\_copy. The value json element should contain the following parameter: @@ -43,7 +43,7 @@ The name of the mapping element should be map\_copy. The value json element shou | copy\_name | The name of the copied field | -##Map Field Name +## Map Field Name The name of the mapping element should be map\_fieldname. The value json element should contain the following parameter: @@ -51,7 +51,7 @@ The name of the mapping element should be map\_fieldname. The value json element |------------------|-------------------------------| | new\_field\_name | The name of the renamed field | -##Map Field Value +## Map Field Value The name of the mapping element should be map\_fieldvalue. The value json element should contain the following parameter:
