Hi MG, Thanks for sending over the batch job IDs. I took a look at the time it took for the jobs to run for the slow running jobs. I didn't see any that exceeded 15 minutes and most were completing within 5 minutes. There is a bit of load balancing going on with a lot of job requests, so it's expected that while some jobs may only take 2 minutes, there will be a few that may exceed 10 minutes. Luckily, the jobs don't appear to be getting stuck indefinitely, and they're not hanging for hours on end. I'll keep an eye on things as I did see a spike in processing time this morning, but it looks like things are returning to normal again. Please reach out if you see the times increasing even more.
Thanks again, Nadine, AdWords API Team On Monday, February 13, 2017 at 9:39:03 AM UTC-5, AdWordsApiUser wrote: > > Hello team, > > The issue seems to happen again, though not as bad as last time, so I > thought I'd let you know before it becomes worse. Some jobs are taking a > long time to process, while others process very fast. Last time it > happened, over 2-3 days, the jobs became slower, and a higher proportion of > jobs started getting stuck till you guys did some magic to make everything > fast again: > > stuck/took very long: > 445491084 > 445522515 > 445523004 > > not stuck/ran fast: > 445491588 > 445352074 > > Cheers, > MG > > On Thursday, February 2, 2017 at 6:51:38 PM UTC+1, AdWordsApiUser wrote: >> >> Thanks Nadine! You and your team saved us a costly rewrite that we had >> started planning for (without using the bulk job service). We'll keep an >> eye out and report back if we see issues. Thanks team - you're the most >> responsive team at Google I've interacted with ;) >> >> On Thursday, February 2, 2017 at 6:46:03 PM UTC+1, Nadine Sundquist >> (AdWords API Team) wrote: >>> >>> Hello Everyone, >>> >>> I have good news! We found the root cause, and the issue has been fixed. >>> Your batch job processing times should be back to normal now. Thanks again >>> for reporting this! >>> >>> Take care, >>> Nadine, AdWords API Team >>> >>> On Thursday, February 2, 2017 at 11:11:20 AM UTC-5, Nadine Sundquist >>> (AdWords API Team) wrote: >>>> >>>> Greetings Fellow AdWordsians, >>>> >>>> Thanks for the batch job IDs. They are a BIG help. I've taken a look at >>>> the history of those batch jobs in our internal systems, and I've found a >>>> pattern. I need to run it by a few teammates here to see if my >>>> observations >>>> result in finding a root cause. I'll update you when I've made a bit more >>>> progress. >>>> >>>> Cheers, >>>> Nadine, AdWords API Team >>>> >>>> On Wednesday, February 1, 2017 at 5:24:36 PM UTC-5, AdWordsApiUser >>>> wrote: >>>>> >>>>> Hi Vishal, >>>>> >>>>> Thanks for your reply. However, we have had 100% of the jobs we've >>>>> submitted in the last 6 hours take over 15 mintues to complete. >>>>> >>>>> Regards, >>>>> MG >>>>> >>>>> On Wednesday, February 1, 2017 at 11:16:53 PM UTC+1, Vishal Vinayak >>>>> (Adwords API Team) wrote: >>>>>> >>>>>> Hi MG, >>>>>> >>>>>> Issues related to batch job performance tend to be intermittent some >>>>>> of the times. In such cases, cancelling the job and sending a new >>>>>> request >>>>>> solves the issue. Could you please try cancelling >>>>>> <https://developers.google.com/adwords/api/docs/guides/batch-jobs#canceling_a_batch_job> >>>>>> all >>>>>> current jobs with the status >>>>>> <https://developers.google.com/adwords/api/docs/reference/v201609/BatchJobService.BatchJob#status> >>>>>> AWAITING_FILE >>>>>> or ACTIVE and retry? If that doesn't help, please feel free to revert >>>>>> and >>>>>> I'll check with my team to see if we can dig into this issue further. >>>>>> >>>>>> Regards, >>>>>> Vishal, AdWords API Team >>>>>> >>>>> -- -- =~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~ Also find us on our blog and Google+: https://googleadsdeveloper.blogspot.com/ https://plus.google.com/+GoogleAdsDevelopers/posts =~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~ You received this message because you are subscribed to the Google Groups "AdWords API Forum" group. To post to this group, send email to adwords-api@googlegroups.com To unsubscribe from this group, send email to adwords-api+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/adwords-api?hl=en --- You received this message because you are subscribed to the Google Groups "AdWords API Forum" group. To unsubscribe from this group and stop receiving emails from it, send an email to adwords-api+unsubscr...@googlegroups.com. Visit this group at https://groups.google.com/group/adwords-api. To view this discussion on the web visit https://groups.google.com/d/msgid/adwords-api/00a8ecac-4073-47cc-a57f-9661ee831985%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.