[google-appengine] Memcache behaves differently on EU server than on US server

[Hooman Korasani]

As strange as this may sound, I have the exact same code published on a 
US-EAST server and on a EU server.
Both server have billing enabled.

Th expiration is set to 7200 seconds.

memcache.set(memcache_key, result_dic, 7200)


And I have cron jobs enabled to rerun the line of code above to refresh the 
cache for the unique key.

- description: Cache 0:20 hour
  url : /worker/topnews-cache-update
  schedule: every day 0:20

- description: Cache 2:20 hour
  url : /worker/topnews-cache-update
  schedule: every day 2:20


This works perfectly fine for the US-EAST server.
Memcache dashboard shows 2,064 items in cache.

Memcache dashboard on the EU server however looses the objects very fast. 
 In a short amount of time the objects disappear back to zero, despite the 
fact that the cron jobs keep running successfully.

It is the same code deployed on the two servers, why is memcache acting 
like this?

Thanks,
Houman

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/61f22415-2594-4594-bb71-70e692624223%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: create_bulkloader_config doesn't reflect the latest schema changes

[Hooman Korasani]

Hi Jesse,

First off thank you so much for replying to this issue. We are a young 
startup and are in process of migrating from AWS to GAE.
On day one (early this week) the bulkloader worked nicely even despite 
the HRD.  I understand I can't rely on it, but how else do we transfer 
our data to google app engine?


At least, if I were able to create one bulk_loader_config yaml, I would 
be able to transfer our data via cvs files.  Is there any other official 
way for HDS?


Many Thanks,
Hooman


On 27/06/13 18:58, Jesse Rohwer wrote:

Hi Hooman,

Bulkload operations on the HRD are eventually consistent, which means 
you cannot use bulkloader with HRD and be guaranteed to get up-to-date 
data.


You can read more in the bulkloader docs: 
https://developers.google.com/appengine/docs/python/tools/uploadingdata

In particular,
*Note: *This document applies to apps that use the master/slave 
datastore 
<https://developers.google.com/appengine/docs/python/datastore/hr>. If 
your app uses the High Replication datastore, it is possible to copy 
data from the app, but Google does not currently support this use 
case. If you attempt to copy from a High Replication datastore, you'll 
see a |high_replication_warning| error in the Admin Console, and the 
downloaded data might not include recently saved entities.


That said, it is true that in the past two days the HRD has had 
longer-than-usual eventual consistency. This is returning to a more 
normal range now, but again: for operations that are not strongly 
consistent, including bulkloader, there are no guarantees. I hope this 
helps clarify the situation.


Thanks,
Jesse Rohwer on behalf of the App Engine team

On Wednesday, June 26, 2013 2:41:40 AM UTC-7, Hooman Korasani wrote:

Any one from google here?

The statistics are failing since three days. Without up-to-date
statistics there is no way to get the bulkloader working properly.


http://stackoverflow.com/questions/17275202/how-to-force-create-bulkloader-config-to-pickup-latest-schema-data/17277052#comment25075099_17277052

<http://stackoverflow.com/questions/17275202/how-to-force-create-bulkloader-config-to-pickup-latest-schema-data/17277052#comment25075099_17277052>


On Tuesday, 25 June 2013 08:58:18 UTC+1, Hooman Korasani wrote:

I have created a bulkloader.yaml like this:

|
appcfg.py create_bulkloader_config
--filename=tools/bulkloader.yaml
--url=https://myid.appspot.com/_ah/remote_api
<http://myid.appspot.com/_ah/remote_api>
|


However it doesn't reflect my changes from a day ago.  How
long do I have to wait until it picks it up?

According to the data-store statistics, the last statistic
update was *Last updated: 1 day, 21:11:28 ago
*However it also says *"**Statistics are updated at least once
per day"

*Is there any other way to get the bulkloader consider my
latest changes?*

*Many Thanks,
Hooman*

*

--
You received this message because you are subscribed to a topic in the 
Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit 
https://groups.google.com/d/topic/google-appengine/1zv8LNucS7g/unsubscribe.
To unsubscribe from this group and all its topics, send an email to 
google-appengine+unsubscr...@googlegroups.com.

To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.




--
You received this message because you are subscribed to the Google Groups "Google 
App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: create_bulkloader_config doesn't reflect the latest schema changes

[Hooman Korasani]

Any one from google here?

The statistics are failing since three days. Without up-to-date statistics 
there is no way to get the bulkloader working properly.  

http://stackoverflow.com/questions/17275202/how-to-force-create-bulkloader-config-to-pickup-latest-schema-data/17277052#comment25075099_17277052


On Tuesday, 25 June 2013 08:58:18 UTC+1, Hooman Korasani wrote:
>
> I have created a bulkloader.yaml like this:
>
> appcfg.py create_bulkloader_config --filename=tools/bulkloader.yaml --url=
> https://myid.appspot.com/_ah/remote_api
>
>
> However it doesn't reflect my changes from a day ago.  How long do I have 
> to wait until it picks it up?
>
> According to the data-store statistics, the last statistic update was *Last 
> updated: 1 day, 21:11:28 ago
> *However it also says *"**Statistics are updated at least once per day"
>
> *Is there any other way to get the bulkloader consider my latest changes?*
>
> *Many Thanks,
> Hooman*
>
> *
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] create_bulkloader_config doesn't reflect the latest schema changes

[Hooman Korasani]

I have created a bulkloader.yaml like this:

appcfg.py create_bulkloader_config --filename=tools/bulkloader.yaml --url=
https://myid.appspot.com/_ah/remote_api


However it doesn't reflect my changes from a day ago.  How long do I have 
to wait until it picks it up?

According to the data-store statistics, the last statistic update was *Last 
updated: 1 day, 21:11:28 ago
*However it also says *"**Statistics are updated at least once per day"

*Is there any other way to get the bulkloader consider my latest changes?*

*Many Thanks,
Hooman*

*

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[google-appengine] Re: Google App Engine community support is moving to Stack Overflow

[Hooman Korasani]

-1 
Stackoverflow has a very strict FAQ rules, and questions are easily 
closed.  I don't think it is a good idea to move support to that platform.


On Tuesday, 7 February 2012 02:14:54 UTC, Ikai Lan wrote:
>
> *Hi App Engine Developers,
>
> In the last few years, the Q&A website Stack 
> Overflowhas become an invaluable tool for 
> developer communities. We’re pleased to 
> announce that we are migrating to Stack Overflow as the official channel 
> for answering development questions about Google App Engine.The 
> google-appengine  group 
> will remain open for general discussions and announcements that are better 
> suited for the groups format.
>
> We believe that Stack Overflow is better platform for sharing knowledge 
> and answering support questions given its larger community, de-duping of 
> similar questions and contributor reputation system. We also expect that 
> App Engine developers will be able to contribute and benefit from the wider 
> range of language-related information not specific to App Engine. In 
> addition, due to Stack Overflow’s use of OpenID for account management, 
> developers will not need to create a new account to participate in the 
> discussion - developers will be able to log in with any of the identity 
> providers supported by Stack Overflow, including Google Accounts.
>
> We plan on deprecating the App Engine language-specific groups, namely 
> google-appengine-pythonand
>  
> google-appengine-java. 
> The 
> google-appengine-godiscussion
>  group will continue to remain open for at least as long as the 
> Go runtime is in experimental status. 
>
> The Python and Java groups will be placed into read-only on March 5th, 
> 2012. While answering technical questions, we will begin nudging developers 
> to ask their questions on Stack Overflow using the google-app-engine 
> tag
> .
>
> Please let us know if there are any questions or concerns about this 
> announcement.
>
> Happy coding!
>
> - Ikai Lan, on behalf of the App Engine team*
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.