Intermittent failures with GoogleAds API

2022-12-09 Thread Tanishq Hooda
Hi Team,

We have noticed from the last few days, google ads API has been unstable 
and fails intermittently. We had some internal server errors today and upon 
re-trying they have been failing with the same error. Could you please 
check since this is impacting our production application? I'm sharing logs 
of 2 runs below - 

[2022-12-08 14:24:29,518] {{logging_mixin.py:112}} INFO - [2022-12-08 
14:24:29,517] {{logging_interceptor.py:267}} INFO - Request
---
Method: /google.ads.googleads.v10.services.GoogleAdsService/SearchStream
Host: googleads.googleapis.com
Headers: {
  "developer-token": "REDACTED",
  "login-customer-id": "5464537117",
  "x-goog-api-client": "gl-python/3.7.15 grpc/1.38.1 gax/1.31.5 
gccl/16.0.0",
  "x-goog-request-params": "customer_id=4059920229"
}
Request: customer_id: "4059920229"
query: "SELECT 
customer.descriptive_name,\ncampaign.id,\ncampaign.name,\ncampaign.status,\nad_group.id,\nad_group.name,\nad_group.status,\nsearch_term_view.status,\nmetrics.clicks,\nmetrics.conversions,\nmetrics.cost_micros,\nsegments.date,\nsegments.day_of_week,\nsegments.device,\nmetrics.impressions,\nsegments.keyword.info.text,\nsegments.keyword.ad_group_criterion,\nsegments.month,\nsegments.ad_network_type,\nsearch_term_view.search_term,\nsegments.week,\nsegments.year
 
FROM search_term_view WHERE segments.date = \'2022-12-06\'"


Response
---
Headers: {
  "google.ads.googleads.v10.errors.googleadsfailure-bin": 
"\nA\n\u0002P\u0004\u0012;A transient internal error has occurred. Retry 
the request.\u0012\u0016vVM-s3QGQi9FLDvQ86VWZQ",
  "grpc-status-details-bin": "\b\r\u0012\u001bInternal error 
encountered.\u001a\u0001\nDtype.googleapis.com/google.ads.googleads.v10.errors.GoogleAdsFailure\u0012[\nA\n\u0002P\u0004\u0012;A
 
transient internal error has occurred. Retry the 
request.\u0012\u0016vVM-s3QGQi9FLDvQ86VWZQ",
  "request-id": "vVM-s3QGQi9FLDvQ86VWZQ"
}
Fault: {
  "created": "@1670509469.517541245",
  "description": "Error received from peer ipv4:172.253.122.95:443",
  "file": "src/core/lib/surface/call.cc",
  "file_line": 1066,
  "grpc_message": "Internal error encountered.",
  "grpc_status": 13
}

+


[2022-12-08 14:11:36,608] {{logging_mixin.py:112}} INFO - [2022-12-08 
14:11:36,608] {{logging_interceptor.py:267}} INFO - Request
---
Method: /google.ads.googleads.v10.services.GoogleAdsService/SearchStream
Host: googleads.googleapis.com
Headers: {
  "developer-token": "REDACTED",
  "login-customer-id": "5464537117",
  "x-goog-api-client": "gl-python/3.7.15 grpc/1.38.1 gax/1.31.5 
gccl/16.0.0",
  "x-goog-request-params": "customer_id=4700016696"
}
Request: customer_id: "4700016696"
query: "SELECT 
customer.descriptive_name,\ncampaign.id,\ncampaign.name,\ncampaign.status,\nad_group.id,\nad_group.name,\nad_group.status,\nsearch_term_view.status,\nmetrics.clicks,\nmetrics.conversions,\nmetrics.cost_micros,\nsegments.date,\nsegments.day_of_week,\nsegments.device,\nmetrics.impressions,\nsegments.keyword.info.text,\nsegments.keyword.ad_group_criterion,\nsegments.month,\nsegments.ad_network_type,\nsearch_term_view.search_term,\nsegments.week,\nsegments.year
 
FROM search_term_view WHERE segments.date = \'2022-12-06\'"


Response
---
Headers: {
  "google.ads.googleads.v10.errors.googleadsfailure-bin": 
"\nA\n\u0002P\u0004\u0012;A transient internal error has occurred. Retry 
the request.\u0012\u0016hi2w2fw16nuqbOZ_GME5-A",
  "grpc-status-details-bin": "\b\r\u0012\u001bInternal error 
encountered.\u001a\u0001\nDtype.googleapis.com/google.ads.googleads.v10.errors.GoogleAdsFailure\u0012[\nA\n\u0002P\u0004\u0012;A
 
transient internal error has occurred. Retry the 
request.\u0012\u0016hi2w2fw16nuqbOZ_GME5-A",
  "request-id": "hi2w2fw16nuqbOZ_GME5-A"
}
Fault: {
  "created": "@1670508696.602557205",
  "description": "Error received from peer ipv4:172.253.122.95:443",
  "file": "src/core/lib/surface/call.cc",
  "file_line": 1066,
  "grpc_message": "Internal error encountered.",
  "grpc_status": 13
}

-- 
-- 
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog:
https://googleadsdeveloper.blogspot.com/
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~

You received this message because you are subscribed to the Google
Groups "AdWords API and Google Ads API Forum" group.
To post to this group, send email to adwords-api@googlegroups.com
To unsubscribe from this group, send email to
adwords-api+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/adwords-api?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Google Ads API and AdWords API Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to adwords-api+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/adwords-api/35f7deba-48aa-460a-9c58-61503d173ec7n%40googlegroups.com.


Intermittent failure with Google Ads API

2022-12-08 Thread Tanishq Hooda
Hi Team,

We have been noticing that Google Ads API has been unstable and there have 
been intermittent failures when we fetch data from the API. Could you 
please check this since it is impacting our production application? I'm 
sharing 2 failure logs - 

[2022-12-08 14:24:29,518] {{logging_mixin.py:112}} INFO - [2022-12-08 
14:24:29,517] {{logging_interceptor.py:267}} INFO - Request
---
Method: /google.ads.googleads.v10.services.GoogleAdsService/SearchStream
Host: googleads.googleapis.com
Headers: {
  "developer-token": "REDACTED",
  "login-customer-id": "5464537117",
  "x-goog-api-client": "gl-python/3.7.15 grpc/1.38.1 gax/1.31.5 
gccl/16.0.0",
  "x-goog-request-params": "customer_id=4059920229"
}
Request: customer_id: "4059920229"
query: "SELECT 
customer.descriptive_name,\ncampaign.id,\ncampaign.name,\ncampaign.status,\nad_group.id,\nad_group.name,\nad_group.status,\nsearch_term_view.status,\nmetrics.clicks,\nmetrics.conversions,\nmetrics.cost_micros,\nsegments.date,\nsegments.day_of_week,\nsegments.device,\nmetrics.impressions,\nsegments.keyword.info.text,\nsegments.keyword.ad_group_criterion,\nsegments.month,\nsegments.ad_network_type,\nsearch_term_view.search_term,\nsegments.week,\nsegments.year
 
FROM search_term_view WHERE segments.date = \'2022-12-06\'"


Response
---
Headers: {
  "google.ads.googleads.v10.errors.googleadsfailure-bin": 
"\nA\n\u0002P\u0004\u0012;A transient internal error has occurred. Retry 
the request.\u0012\u0016vVM-s3QGQi9FLDvQ86VWZQ",
  "grpc-status-details-bin": "\b\r\u0012\u001bInternal error 
encountered.\u001a\u0001\nDtype.googleapis.com/google.ads.googleads.v10.errors.GoogleAdsFailure\u0012[\nA\n\u0002P\u0004\u0012;A
 
transient internal error has occurred. Retry the 
request.\u0012\u0016vVM-s3QGQi9FLDvQ86VWZQ",
  "request-id": "vVM-s3QGQi9FLDvQ86VWZQ"
}
Fault: {
  "created": "@1670509469.517541245",
  "description": "Error received from peer ipv4:172.253.122.95:443",
  "file": "src/core/lib/surface/call.cc",
  "file_line": 1066,
  "grpc_message": "Internal error encountered.",
  "grpc_status": 13
}




[2022-12-08 14:11:36,608] {{logging_mixin.py:112}} INFO - [2022-12-08 
14:11:36,608] {{logging_interceptor.py:267}} INFO - Request
---
Method: /google.ads.googleads.v10.services.GoogleAdsService/SearchStream
Host: googleads.googleapis.com
Headers: {
  "developer-token": "REDACTED",
  "login-customer-id": "5464537117",
  "x-goog-api-client": "gl-python/3.7.15 grpc/1.38.1 gax/1.31.5 
gccl/16.0.0",
  "x-goog-request-params": "customer_id=4700016696"
}
Request: customer_id: "4700016696"
query: "SELECT 
customer.descriptive_name,\ncampaign.id,\ncampaign.name,\ncampaign.status,\nad_group.id,\nad_group.name,\nad_group.status,\nsearch_term_view.status,\nmetrics.clicks,\nmetrics.conversions,\nmetrics.cost_micros,\nsegments.date,\nsegments.day_of_week,\nsegments.device,\nmetrics.impressions,\nsegments.keyword.info.text,\nsegments.keyword.ad_group_criterion,\nsegments.month,\nsegments.ad_network_type,\nsearch_term_view.search_term,\nsegments.week,\nsegments.year
 
FROM search_term_view WHERE segments.date = \'2022-12-06\'"


Response
---
Headers: {
  "google.ads.googleads.v10.errors.googleadsfailure-bin": 
"\nA\n\u0002P\u0004\u0012;A transient internal error has occurred. Retry 
the request.\u0012\u0016hi2w2fw16nuqbOZ_GME5-A",
  "grpc-status-details-bin": "\b\r\u0012\u001bInternal error 
encountered.\u001a\u0001\nDtype.googleapis.com/google.ads.googleads.v10.errors.GoogleAdsFailure\u0012[\nA\n\u0002P\u0004\u0012;A
 
transient internal error has occurred. Retry the 
request.\u0012\u0016hi2w2fw16nuqbOZ_GME5-A",
  "request-id": "hi2w2fw16nuqbOZ_GME5-A"
}
Fault: {
  "created": "@1670508696.602557205",
  "description": "Error received from peer ipv4:172.253.122.95:443",
  "file": "src/core/lib/surface/call.cc",
  "file_line": 1066,
  "grpc_message": "Internal error encountered.",
  "grpc_status": 13
}

Thanks!

-- 
-- 
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog:
https://googleadsdeveloper.blogspot.com/
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~

You received this message because you are subscribed to the Google
Groups "AdWords API and Google Ads API Forum" group.
To post to this group, send email to adwords-api@googlegroups.com
To unsubscribe from this group, send email to
adwords-api+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/adwords-api?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Google Ads API and AdWords API Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to adwords-api+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/adwords-api/df1d8192-818a-4e7b-a55a-690a0b020153n%40googlegroups.com.


Re: Performance of SearchStream

2022-09-30 Thread Tanishq Hooda
Is there any update on this issue? We have some pipelines in production 
which are stuck and eventually fail with Stream removed. I have already 
shared the error log before.

On Wednesday, 28 September 2022 at 16:38:44 UTC+5:30 Ronald Findling wrote:

> We also experience these problems the last days. Massive slowdown + 
> *RST_STREAM* errors and some more :/
> On Wednesday, 28 September 2022 at 12:42:41 UTC+2 Filipe wrote:
>
>> Same here. SearchStream stucks in large reports
>>
>> A quarta-feira, 28 de setembro de 2022 à(s) 09:41:25 UTC+1, Zweitze 
>> escreveu:
>>
>>> Same here
>>> [image: latency.PNG]
>>>
>>> I did notice that, when the server-side timeout occurs, the error 
>>> changed.
>>>  
>>> Sep 27, 02:31 CEST:
>>> *Status(StatusCode="Unknown", Detail="Stream removed", 
>>> DebugException="Grpc.Core.Internal.CoreErrorDetailException: 
>>> {"created":"@1664238664.22000","description":"Error received from peer 
>>> ipv4:216.58.214.10:443 
>>> ","file":"..\..\..\src\core\lib\surface\call.cc","file_line":1070,"grpc_message":"Stream
>>>  
>>> removed","grpc_status":2}")* 
>>>
>>> Sep 28, 02:30 CEST:
>>> *Status(StatusCode="Internal", Detail="Received RST_STREAM with error 
>>> code 2", DebugException="Grpc.Core.Internal.CoreErrorDetailException: 
>>> {"created":"@1664325053.84400","description":"Error received from peer 
>>> ipv4:142.250.179.170:443 
>>> ","file":"..\..\..\src\core\lib\surface\call.cc","file_line":1070,"grpc_message":"Received
>>>  
>>> RST_STREAM with error code 2","grpc_status":13}")* 
>>>
>>> This was from the same GAQL query, on the same CustomerId.
>>>
>>>
>>> On Wednesday, September 28, 2022 at 9:02:47 AM UTC+2 
>>> tjadi@billygrace.com wrote:
>>>
 Hi,

 We are still running into the same issue for large reports (our small 
 ones never stopped working either).

 Kind regards,

 Op woensdag 28 september 2022 om 07:51:40 UTC+2 schreef 
 sean.d...@coolblue.nl:

> Hello,
>
> Also for us, the large reports still fail. With HTTP requests or with 
> the client library in the ads to bq dataflow pipeline.
>
> Smaller reports do work, but they never stopped working on our end.
>
> On Wednesday, September 28, 2022 at 6:30:40 AM UTC+2 Robert Heise 
> wrote:
>
>> Hi,
>>
>> still having the same issue. Some reports finish, most of them don't, 
>> search_stream requests not finishing and getting stuck.
>>
>> Please provide an ETA when the issue will be resolved on Google side.
>>
>> Thanks,
>>
>> Robert
>>
>> On Tuesday, 27 September 2022 at 22:29:44 UTC+2 adsapi wrote:
>>
>>> Greetings!
>>>
>>> Thanks for providing the information. You should see traffic coming 
>>> back to normal with your errors returning to normal levels. The issue 
>>> that 
>>> caused this has been resolved. Please get back to me if you continue to 
>>> see 
>>> issues.
>>>
>>> Thanks,
>>> [image: Google Logo] 
>>> Nadine Wang 
>>> Google Ads API Team 
>>>   
>>>
>>> ref:_00D1U1174p._5004Q2egxrU:ref
>>>
>>

-- 
-- 
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog:
https://googleadsdeveloper.blogspot.com/
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~

You received this message because you are subscribed to the Google
Groups "AdWords API and Google Ads API Forum" group.
To post to this group, send email to adwords-api@googlegroups.com
To unsubscribe from this group, send email to
adwords-api+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/adwords-api?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Google Ads API and AdWords API Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to adwords-api+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/adwords-api/5833f1f2-86de-4333-ade2-0d1f17387002n%40googlegroups.com.


Re: API requests timing out

2022-09-28 Thread Tanishq Hooda
Hi,

Even we are facing the same issue. I have shared the error log using reply 
to the author on this thread. It will be helpful if we get some update on 
this and ETA for resolution.

Thanks & Regards,
Tanishq

On Wednesday, 28 September 2022 at 12:48:12 UTC+5:30 Robert Heise wrote:

> Hi Sherwin,
>
> I think there are enough posts from various developers in multiple threads 
> which are pointing to the same problem: search_stream in Google Ads API not 
> ending the stream properly, leaving the stream open and being killed at 
> some point by some timeout. Please check 
> https://groups.google.com/g/adwords-api/c/Uwqy0BlkNDA and 
> https://groups.google.com/g/adwords-api/c/Gx4QN7ER33s threads as well, 
> they describe the same issue in the Google Ads API and have I think 
> sufficient information to further check the issue on Google side.
>
> As mentioned in other threads linked, it would be great to have an ETA and 
> a status page where this issue can be tracked in a clear way instead of 
> various threads in this forum.
>
> Thanks,
>
> Robert
>
> On Wednesday, 28 September 2022 at 09:06:44 UTC+2 adsapi wrote:
>
>> Hi all,
>>
>> Thank you for reaching us out. I am Sherwin from Google Ads API support 
>> team. I hope that you are doing well today.
>>
>> Moving forward to your concern. Could you please tell us if you still 
>> encounter the same issue? If yes, could you please provide us the complete 
>> request 
>> 
>>  and response 
>> 
>>  logs 
>> with request ID 
>> 
>>  and request header 
>> 
>>  generated 
>> on your end? You can provide it via Reply privately to author option. If 
>> this option is not available, then send it instead on this email address 
>> *googleadsa...@google.com*. If you haven't enabled the logging yet, 
>> logging can be enabled by navigating to the Client libraries > Your client 
>> library (ex. Java) > Logging documentation, which you can access from this
>>  link 
>> .
>>
>> Kind regards, 
>> [image: Google Logo] 
>> Sherwin Vincent 
>> Google Ads API Team 
>>   
>>
>> ref:_00D1U1174p._5004Q2ehPN3:ref
>>
>

-- 
-- 
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog:
https://googleadsdeveloper.blogspot.com/
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~

You received this message because you are subscribed to the Google
Groups "AdWords API and Google Ads API Forum" group.
To post to this group, send email to adwords-api@googlegroups.com
To unsubscribe from this group, send email to
adwords-api+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/adwords-api?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Google Ads API and AdWords API Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to adwords-api+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/adwords-api/91755e61-c58a-4783-b882-3a5b4560293en%40googlegroups.com.