[google-appengine] Re: How to export more than 50 Kinds from Google Cloud Datastore into the same Cloud Storage Bucket?

['Jose Antonio Soni Solchaga' via Google App Engine]

It has two limits, its up to 50 concurrent exports and outputs and to 
initialize up to 20 per minute. 

It depends totally on the time they take to get exported, if the chunks are 
small and they get exported fast then you might get close to the limit per 
minute so i would suggest you to control that the maximum amount of calls 
to this is 20 per minute so you don't exceed this limit.

On Monday, September 23, 2019 at 2:13:08 PM UTC-5, Hamid Raza wrote:
>
> Hi George,
>
> Thanks for your reply.
> Yes, I do export a chunk of 40 entities in a single operation. And 
> according to my understanding, the limit of 20 export and import requests 
> is actually the limit on the number of times the export and import API can 
> be called in a minute, right? And, I am triggering the export of subsequent 
> chunk only after the previous one has completed. So, I think it will be 
> very unlikely that I will hit this 20 export and import requests per minute 
> limit.
>
> On Monday, September 23, 2019 at 9:38:00 PM UTC+5, George (Cloud Platform 
> Support) wrote:
>>
>> Hello Hamid, 
>>
>> You mention splitting your export into chunks of 40 entities. Do you 
>> export this chunk in a single operation? If so, you may check the value of 
>> requests per minute, as there is a limit of maximum of 20 export and import 
>> requests per minute for a project. You may find related information on the 
>> "Exporting and Importing Entities" documentation page 
>> . 
>>
>> To avoid the path error, you may consider using the NAMESPACE_PATH 
>> parameter, when setting an environment variable for your Cloud Storage 
>> bucket ID: BUCKET="YOUR_BUCKET_NAME[/NAMESPACE_PATH]" . In the extreme, you 
>> may lodge a request for quota increase, to be able to export more than 50 
>> concurrent exports and imports. You should rather open an issue in the 
>> Public 
>> Issue Tracker , as here you cannot 
>> transmit private information needed, and other confidential information, 
>> and progress is difficult to track. 
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/d2bd6811-ab23-4b33-9912-bb3f55877ecb%40googlegroups.com.

[google-appengine] Re: How to export more than 50 Kinds from Google Cloud Datastore into the same Cloud Storage Bucket?

['Hamid Raza' via Google App Engine]

Hi George,

Thanks for your reply.
Yes, I do export a chunk of 40 entities in a single operation. And 
according to my understanding, the limit of 20 export and import requests 
is actually the limit on the number of times the export and import API can 
be called in a minute, right? And, I am triggering the export of subsequent 
chunk only after the previous one has completed. So, I think it will be 
very unlikely that I will hit this 20 export and import requests per minute 
limit.

On Monday, September 23, 2019 at 9:38:00 PM UTC+5, George (Cloud Platform 
Support) wrote:
>
> Hello Hamid, 
>
> You mention splitting your export into chunks of 40 entities. Do you 
> export this chunk in a single operation? If so, you may check the value of 
> requests per minute, as there is a limit of maximum of 20 export and import 
> requests per minute for a project. You may find related information on the 
> "Exporting and Importing Entities" documentation page 
> . 
>
> To avoid the path error, you may consider using the NAMESPACE_PATH 
> parameter, when setting an environment variable for your Cloud Storage 
> bucket ID: BUCKET="YOUR_BUCKET_NAME[/NAMESPACE_PATH]" . In the extreme, you 
> may lodge a request for quota increase, to be able to export more than 50 
> concurrent exports and imports. You should rather open an issue in the Public 
> Issue Tracker , as here you cannot 
> transmit private information needed, and other confidential information, 
> and progress is difficult to track. 
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/11ef341a-a64f-4883-9b83-1f3ebf1b234d%40googlegroups.com.