Carmen,
you can provide "csv.log.dir" on properties to csv reporter to point target
directory on csv files.
Looks like Metrics V2 doc misses some spots. I'll try to find time to fix
it, but I would be really appreciated if anyone could lend hand to do it.
Thanks,
Jungtaek Lim (HeartSaVioR)
2018년 8월 22일 (수) 오전 8:51, Erik Weathers <e...@apache.org>님이 작성:
> Unfortunately I’m not at all familiar with metrics2. I’ll have to refer
> you to the docs or code, or defer to someone else.
>
> Though as a guess maybe you can use “lsof -p YOUR_WORKER_PID” on the
> worker host if this is a local file that you aren’t sure where it goes.
>
> - Erik
>
> On Tue, Aug 21, 2018 at 4:42 PM Carmen M. <molcar8...@gmail.com> wrote:
>
>> Hello Eric
>>
>> Thank you so much. It worked. The topology no longer crashes. Maybe
>> you can answer my other question. Where does the csv file get created?
>> What parameter in storm.yaml controls the location of the csv file. Is
>> there a configuration in the worker.xml and/or cluster.xml file?
>>
>> Thank you again.
>>
>> Carmen
>>
>> On Tue, Aug 21, 2018 at 4:27 PM Erik Weathers <e...@apache.org> wrote:
>>
>>> Looks like a typo in the docs to me:
>>>
>>> ➜ storm git:(master) ✗ git checkout v1.2.2
>>> HEAD is now at d2d6f4034... [maven-release-plugin] prepare release v1.2.2
>>> ➜ storm git:(d2d6f4034) ✗ git grep CsvReporter
>>> docs/metrics_v2.md: * CSV Reporter
>>> (`org.apache.storm.metrics2.reporters.CsvReporter`):
>>> storm-core/src/jvm/org/apache/storm/daemon/metrics/reporters/CsvPreparableReporter.java:import
>>> com.codahale.metrics.CsvReporter;
>>> storm-core/src/jvm/org/apache/storm/daemon/metrics/reporters/CsvPreparableReporter.java:public
>>> class CsvPreparableReporter implements PreparableReporter<CsvReporter> {
>>> storm-core/src/jvm/org/apache/storm/daemon/metrics/reporters/CsvPreparableReporter.java:
>>> CsvReporter reporter = null;
>>> storm-core/src/jvm/org/apache/storm/daemon/metrics/reporters/CsvPreparableReporter.java:
>>> CsvReporter.Builder builder = CsvReporter.forRegistry(metricsRegistry);
>>> storm-core/src/jvm/org/apache/storm/metrics2/reporters/CsvStormReporter.java:import
>>> com.codahale.metrics.CsvReporter;
>>> storm-core/src/jvm/org/apache/storm/metrics2/reporters/CsvStormReporter.java:
>>> CsvReporter.Builder builder = CsvReporter.forRegistry(metricsRegistry);
>>>
>>>
>>> I'd try:
>>> org.apache.storm.metrics2.reporters.CsvStormReporter
>>>
>>> instead of:
>>> org.apache.storm.metrics2.reporters.CsvReporter
>>>
>>> - Erik
>>>
>>>
>>> On Tue, Aug 21, 2018 at 2:36 PM Carmen M. <molcar8...@gmail.com> wrote:
>>>
>>>> All
>>>>
>>>> I’m trying to use the CsvReporter. When I start the topology, the
>>>> worker crashes.
>>>>
>>>> storm.yaml configuration:
>>>>
>>>> storm.log.dir: "/apps/logs"
>>>> storm.metrics.reporters:
>>>>
>>>> - class: "org.apache.storm.metrics2.reporters.CsvReporter"
>>>> daemons:
>>>> - "supervisor"
>>>> - "nimbus"
>>>> - "worker"
>>>> report.period: 10
>>>> report.period.units: “SECONDS"
>>>>
>>>> Also, where is the csv file created?
>>>>
>>>> Thank you for your help. Carmen
>>>>
>>>> 2018-08-21 20:56:57.824 o.a.s.m.StormMetricRegistry main [INFO]
>>>> Starting metrics reporters...
>>>> 2018-08-21 20:56:57.824 o.a.s.m.StormMetricRegistry main [INFO]
>>>> Attempting to instantiate reporter class:
>>>> org.apache.storm.metrics2.reporters.CsvReporter
>>>> 2018-08-21 20:56:57.825 o.a.s.d.worker main [ERROR] Error on
>>>> initialization of server mk-worker
>>>> java.lang.RuntimeException: java.lang.ClassNotFoundException:
>>>> org.apache.storm.metrics2.reporters.CsvReporter
>>>> at org.apache.storm.utils.Utils.newInstance(Utils.java:187)
>>>> ~[storm-core-1.2.2.jar:1.2.2]
>>>> at
>>>> org.apache.storm.metrics2.StormMetricRegistry.startReporter(StormMetricRegistry.java:117)
>>>> ~[storm-core-1.2.2.jar:1.2.2]
>>>> at
>>>> org.apache.storm.metrics2.StormMetricRegistry.start(StormMetricRegistry.java:102)
>>>> ~[storm-core-1.2.2.jar:1.2.2]
>>>> at
>>>> org.apache.storm.daemon.worker$fn__11300$exec_fn__2470__auto____11301.invoke(worker.clj:620)
>>>> ~[storm-core-1.2.2.jar:1.2.2]
>>>> at clojure.lang.AFn.applyToHelper(AFn.java:178)
>>>> ~[clojure-1.7.0.jar:?]
>>>> at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?]
>>>> at clojure.core$apply.invoke(core.clj:630) ~[clojure-1.7.0.jar:?]
>>>> at
>>>> org.apache.storm.daemon.worker$fn__11300$mk_worker__11391.doInvoke(worker.clj:605)
>>>> [storm-core-1.2.2.jar:1.2.2]
>>>> at clojure.lang.RestFn.invoke(RestFn.java:512)
>>>> [clojure-1.7.0.jar:?]
>>>> at org.apache.storm.daemon.worker$_main.invoke(worker.clj:798)
>>>> [storm-core-1.2.2.jar:1.2.2]
>>>> at clojure.lang.AFn.applyToHelper(AFn.java:165)
>>>> [clojure-1.7.0.jar:?]
>>>> at clojure.lang.AFn.applyTo(AFn.java:144) [clojure-1.7.0.jar:?]
>>>> at org.apache.storm.daemon.worker.main(Unknown Source)
>>>> [storm-core-1.2.2.jar:1.2.2]
>>>> Caused by: java.lang.ClassNotFoundException:
>>>> org.apache.storm.metrics2.reporters.CsvReporter
>>>> at
>>>> jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:582)
>>>> ~[?:?]
>>>> at
>>>> jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:190)
>>>> ~[?:?]
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:499) ~[?:?]
>>>> at java.lang.Class.forName0(Native Method) ~[?:?]
>>>> at java.lang.Class.forName(Class.java:291) ~[?:?]
>>>> at org.apache.storm.utils.Utils.newInstance(Utils.java:185)
>>>> ~[storm-core-1.2.2.jar:1.2.2]
>>>> ... 12 more
>>>> 2018-08-21 20:56:57.834 STDERR Thread-1 [INFO]
>>>> [3.554s][trace][gc,region ] G1HR ALLOC(EDEN) [0x000000063dc00000,
>>>> 0x000000063dc00000, 0x000000063e000000]
>>>> 2018-08-21 20:56:57.834 o.a.s.util main [ERROR] Halting process:
>>>> ("Error on initialization")
>>>> java.lang.RuntimeException: ("Error on initialization")
>>>>
>>>
