Unfortunately those APIs do not make async calls while submitting pig scripts for execution. You could use Yarn APIs to query counters directly if you had the hadoop job ids available.
Probably a chance to contribute changes to make Counters be available with Pig APIs (thinking a Listener). On Thu, Jun 18, 2015 at 4:22 AM, Michael Howard <[email protected]> wrote: > My questions relate to custom "counters" in order to dynamically monitor > progress during execution of a pig job. > > I would like to increment some custom counters in the context of pig UDFs. > I would like to access these counters during execution under differnt > ExecTypes ... local/mapreduce/tez > > I see that PigStatusReporter.getInstance().incrCounter(...) is the > recommended way to increment counters so that they are accessible under > both MR and tez execution models. > > I do not see how one can fetch the current value of a counter during > execution via PigRunner or PigServer. > I expected to find access to counters under PigStats, but have been unable > to locate a way to access counters. > > Q: How does one retrieve current values of counters during execution of a > pig script? > > > Thanks, > Michael >
