Hi Mitesh,
Here are some workarounds to your issue:
- Instead of passing 50K emails in each thread, you can pass up to 1
million emails
<https://developers.google.com/adwords/api/docs/reference/v201809/AdwordsUserListService.MutateMembersOperand>
in a single operation. That would reduce the number of total operations
required. Hence, you can run your process with less threads.
- If multi-threading is a must, when a CONCURRENT_MODIFICATION error
occurs, you can use exponential backoff
<https://developers.google.com/adwords/api/docs/guides/bestpractices#distinguish_error_types>
to spread out the threads in each retry.
- Each thread can start with a different start time. The idea is to
spread out the threads to avoid collision.
Note that processing large data sets for a relatively longer time is
normal.
Thanks,
Poki, AdWords API Team
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog and discussion group:
http://googleadsdeveloper.blogspot.com/search/label/adwords_api
https://developers.google.com/adwords/api/community/
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
On 02/25/19 19:45:26 mit...@actioniq.com wrote:
Hi Milind,
Yes I absolutely am using multiple processes. Each one calls
AdwordsServices.getUserList, then calls MutateMembers with about 50000 user
email hashes. They all run at the same time, because I have noticed that
running one at a time is too slow (takes 1 hour). Running them all
concurrently, it reduces the time to 40 mins, but its still very slow.
My real question is when will Adwords API allow concurrent adding of users
to a single UserList? This seems like a very critical feature, otherwise
how do other people use the API to create UserLists with 20M+ users?
On Monday, February 25, 2019 at 10:28:40 AM UTC-6, mit...@actioniq.com
wrote:
I'm trying to add many users (25 million email hashes) to a newly created
adwords list. I'm doing this via many (around 30+) threads each doing a
single big MutateMembersOperand with many users. I get
CONCURRENT_MODIFICATION a lot, and just retry after a random wait time, but
this still causes the performance to be very bad.
I read here that some aspects of the API now allow concurrent changes. Is
it true that adding users to an ad list is still something that cannot be
done concurrently? Is there a plan to improve this?
Thanks!
--
Mitesh
--
--
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog:
https://googleadsdeveloper.blogspot.com/
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
You received this message because you are subscribed to the Google
Groups "AdWords API and Google Ads API Forum" group.
To post to this group, send email to adwords-api@googlegroups.com
To unsubscribe from this group, send email to
adwords-api+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/adwords-api?hl=en
---
You received this message because you are subscribed to the Google Groups
"AdWords API and Google Ads API Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to adwords-api+unsubscr...@googlegroups.com.
Visit this group at https://groups.google.com/group/adwords-api.
To view this discussion on the web visit
https://groups.google.com/d/msgid/adwords-api/aecbde29-fc36-4eb5-94b2-c3f0749532bf%40googlegroups.com
<https://groups.google.com/d/msgid/adwords-api/aecbde29-fc36-4eb5-94b2-c3f0749532bf%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
--
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog:
https://googleadsdeveloper.blogspot.com/
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
You received this message because you are subscribed to the Google
Groups "AdWords API and Google Ads API Forum" group.
To post to this group, send email to adwords-api@googlegroups.com
To unsubscribe from this group, send email to
adwords-api+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/adwords-api?hl=en
---
You received this message because you are subscribed to the Google Groups "AdWords API and Google Ads API Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to adwords-api+unsubscr...@googlegroups.com.
Visit this group at https://groups.google.com/group/adwords-api.
To view this discussion on the web visit
https://groups.google.com/d/msgid/adwords-api/00d12elboo000001go3uka0007f0b4y64mj2c1i6oo30c1g68qj8d1h%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
