Re: ParDo Execution Time stat is always 0

2019-04-03 Thread Akshay Balwally
Should have added- I'm using Python sdk, Flink runner On Wed, Apr 3, 2019 at 10:32 AM Akshay Balwally wrote: > Hi, > I'm hoping to get metrics on the amount of time spent on each operator, so > it seams like the stat > > > {organization_specific_prefix}.operator.beam

ParDo Execution Time stat is always 0

2019-04-03 Thread Akshay Balwally
rpret as 0 milliseconds spent per bundle, which can't be correct (other stats show that the operators are running, and timers within the operators show more reasonable times). Is this a known bug? -- *Akshay Balwally* Software Engineer 937.271.6469 <+19372716469> [image: Lyft] <http://www.lyft.com/>

Fwd: Logging with Key-Value Tags

2019-01-29 Thread Akshay Balwally
Hi, I have logging statements in my Beam python code (using Flink). To improve debugging, I add tags to the log statement, which are then indexable on my log tool (kibana). However, the log statements that come out are not properly formatted. For example, statements like: logger.exception('this i