My questions relate to custom "counters" in order to dynamically monitor progress during execution of a pig job.
I would like to increment some custom counters in the context of pig UDFs. I would like to access these counters during execution under differnt ExecTypes ... local/mapreduce/tez I see that PigStatusReporter.getInstance().incrCounter(...) is the recommended way to increment counters so that they are accessible under both MR and tez execution models. I do not see how one can fetch the current value of a counter during execution via PigRunner or PigServer. I expected to find access to counters under PigStats, but have been unable to locate a way to access counters. Q: How does one retrieve current values of counters during execution of a pig script? Thanks, Michael
