[ https://issues.apache.org/jira/browse/AMBARI-19847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851239#comment-15851239 ]
Miklos Gergely commented on AMBARI-19847: ----------------------------------------- committed to trunk: {code:java} commit 61f8f6d56937996ea7ca2f64b8961e83b72422fd Author: Miklos Gergely <mgerg...@hortonworks.com> Date: Fri Feb 3 09:56:10 2017 +0100 AMBARI-19847 Improve Log Feeder simulation to help scale testing (mgergely) Change-Id: I8a53b3285b919523a929656c10d4d1215169fbab {code} committed to branch-2.5: {code:java} commit 25499712d21c9c1f3f4e20308fe1a0bad5d8de51 Author: Miklos Gergely <mgerg...@hortonworks.com> Date: Fri Feb 3 09:57:22 2017 +0100 AMBARI-19847 Improve Log Feeder simulation to help scale testing (mgergely) Change-Id: I7dd15fc114eb651d1e8b9d7182e853cc30828b2f {code} > Improve Log Feeder simulation to help scale testing > --------------------------------------------------- > > Key: AMBARI-19847 > URL: https://issues.apache.org/jira/browse/AMBARI-19847 > Project: Ambari > Issue Type: Bug > Components: ambari-logsearch > Affects Versions: 2.5.0 > Reporter: Miklos Gergely > Assignee: Miklos Gergely > Fix For: 2.5.0 > > > Simulated Log Feeder input writes almost identical log messages, which is not > really simulates real logs. > Instead of the logfeeder.simulate.log_message_size property there will be 3 > new properties (the simulated Log Feeders would enforce a minimum, and a > maximum value, and also set a default for them, if they are not specified): > logfeeder.simulate.number_of_words - the number of different words that may > appear in the simulated logs (50 / 1000000, default 1000) > logfeeder.simulate.min_log_words - the minimum number of words in a simulated > log message (1 / 10, default 5) > logfeeder.simulate.max_log_words - the maximum number of words in a log > message (10 / 20, default 10) > After the parameters are set each logfeeder will start to load messages like > this. In each message all the words are different: > Word000912 Word000903 Word000940 Word000760 Word000564 Word000762 Word000955 > Word000553 > Word000320 Word000218 Word000872 Word000204 Word000120 Word000298 Word000727 > Word000720 Word000475 > Word000413 Word000642 Word000872 Word000464 Word000746 Word000250 > The rest of the properties remain the same: > logfeeder.simulate.input_number - number of paralell inputs (threads) loading > the logs, if it is set and not 0 then all the rest of the configured inputs > are ignored (running in simulation mode)!! > logfeeder.simulate.log_ids - comma separated list of the log ids to propagate > at random, if not set by default all the available logs are propagated at > random, example: storm_drpc,storm_logviewer,storm_nimbus > logfeeder.simulate.log_level - the level of the simulated log messages, by > default WARN > logfeeder.simulate.sleep_milliseconds - the time interval at which each > simulated inputs writes one log message at random -- This message was sent by Atlassian JIRA (v6.3.15#6346)