date:20140721

hi, are you a google guy?

what do you think the real usage of the key group ( or tree ) is?

for example, a forum, user entity and article entity, i set article.author 
to user entity, then how can i get all articles for a user? in db, i can 
set it with referenceproperty and get a _set ended property in user entity. 
in ndb, i have to use query to do this?



在 2014年7月21日星期一UTC+8上午3时02分27秒，Kaan Soral写道：

 I've also tested utilizing parent's recently, don't remember the exact 
 reason

 I've found out that you can't get an entity only by id, if it has a 
 parent, you have to know the parent too, that's why I utilized a different 
 method to achieve whatever I was after at that time (don't remember)

 I also like to simply get entities by their id's - so I almost never give 
 them parent's

 I would suggest not utilizing parent's unless you exactly know what you 
 are doing

 I suspect you are learning ndb, I would suggest reading 
 https://developers.google.com/appengine/docs/python/ndb*/ *fully

 AppEngine documentations are really easy to read and pretty fun, it 
 shouldn't take 3 hours to grasp all concepts related to ndb


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Application Data Center/Zone

2014-07-21 Thread Miguel Vitorino


Hi,

How is possible to know the current Zone (as in: us-central1-a, b, f) where 
an AppEngine application is currently running?
Cloud SQL allows us to specify that its location should follow an AppEngine 
app, but for general GCE instances there isn't a similar option (since they 
obviously aren't managed so static to one zone...)
We would like to create GCE instances in the same zone as the app to reduce 
latency.
One way we thought of was to start one instance in each zone and then test 
the latency but we would naturally prefer a simpler approach to find this 
out...

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: ndb, get_by_id can not get an entity with a parent key only by id?

2014-07-21 Thread Kaan Soral

Not associated with google, also not an expert on ndb

As far as I know key groups are related with consistency, in my opinion, 
you shouldn't put article's and author's in the same group, there is a 1/s 
write speed limit on entity groups, if you put them in the same entity 
group, you could hit this limit more easily

You don't even have to use referenceproperty's - I would just put the 
author key in an article StringProperty named author and query for it, if 
I were you

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: ndb, get_by_id can not get an entity with a parent key only by id?

to query may cost too many ops. i don't query.



在 2014年7月21日星期一UTC+8下午8时53分29秒，Kaan Soral写道：

 Not associated with google, also not an expert on ndb

 As far as I know key groups are related with consistency, in my opinion, 
 you shouldn't put article's and author's in the same group, there is a 1/s 
 write speed limit on entity groups, if you put them in the same entity 
 group, you could hit this limit more easily

 You don't even have to use referenceproperty's - I would just put the 
 author key in an article StringProperty named author and query for it, if 
 I were you


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] what is the best way to store entities with relations in ndb?

for example,  there are two models, author and article.

author1 writes article1 and article2.
author2 writes article3 and article4.

features: find the author of a article. find all articles written by an 
author.

in db, i set a referenceproperty named auth in article model. link it to 
author. in author, use auth_set to find the articles.

in ndb, how to store this relation to make author and article find each 
other without querying? 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Datastore eventual consistency

2014-07-21 Thread Jeff Schnitzer

Just a minor nit - I don't recall offhand exactly how ndb manages this, but
I believe that the session cache can affect query results in a subtle way.
It won't affect which entities come back (that is determined by walking the
index), but when a result comes back, I would expect ndb to replace the
fetched version by a session version in the cache. So as long as the entity
was a query hit before the change, you may see the new version if it
was in the cache - even though the query returned the old version.

This is pretty minor, and probably not what you are seeing, but it's worth
mentioning. And it's possible I have this wrong; I haven't used ndb in a
long time, but this is the behavior I would expect from a session cache.

Jeff


On Mon, Jul 21, 2014 at 3:04 AM, Dan uvico...@gmail.com wrote:

 Thanks for the answer.

 The results I am seeing are not because of ndb caching as it does not
 cache queries by property.

 I imagine that the datastore eventual consistency has always been fast
 enough so the required indexes are updated by the time I run a put, then
 get operation making the subsequent query by property always work so far in
 testing. Thanks for making it clear that there is no technical
 reason/guarantee to rely on this.


 On Sunday, July 20, 2014 11:36:49 PM UTC+1, Jeff Schnitzer wrote:

 The answer to your question is no.

 Queries are eventually consistent because index changes are replicated
 between datacenters asynchronously and queries are served by any
 datacenter. Strongly consistent get-by-key operations require a quorum of
 datacenters; they have no effect on query index replication.

 Note that while get-by-key is strongly consistent by default, you can
 explicitly request an eventually consistent get-by-key. Since it returns
 the first result as-is (without waiting for a quorum), it is quite a bit
 faster.

 Also: You may be experiencing cache behavior; ndb caches at both session
 and memcache level.

 Jeff


 On Fri, Jul 18, 2014 at 2:17 PM, Dan uvic...@gmail.com wrote:

 Apologies Chad, I didn't make myself clear. I was using Python ndb
 terminology with 'get', 'put' and 'query'.

 What I want to clarify is if an entity will always be returned from a
 fetch by kind if it has previously been fetched by key.

 This is what I experience in testing. I also remember reading that an
 entity's indexed properties are written to their respective indexes, if not
 done already, on its first fetch by key.

 Therefore can you effectively get strong consistency by adding a fetch
 by key after adding an entity to the datastore?

 Example 1:
 1) Put entity A.
 2) Query for entity A by kind. // This does not always return entity A
 due to the eventual consistency nature of the datastore.

 Example 2:
 1) Put entity B.
 2) Fetch entity B by key.
 3) Query for entity B by kind. // Always appears to return entity B.

 --
 You received this message because you are subscribed to the Google
 Groups Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send
 an email to google-appengi...@googlegroups.com.
 To post to this group, send email to google-a...@googlegroups.com.

 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/d/optout.


  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/d/optout.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: NoSQL vs Relational DBs - pros and cons

2014-07-21 Thread David Hardwick

Thanks, Kaan.

I realize my post looks too mired in opinion.  In retrospect, I should have
stated that we are using App Engine and the Datastore, and we ARE operating
at that scale mentioned (40,000 customers, 10million records each across 50
or so entities), we don't have a DBA, etc..I just wanted to talk to
someone that has either:


   - a)  figured out how to shard a relational database at multi-tenant
   scale (e.g., 30,000 customers containing 10M records per customer, across
   50 tables each) such that the relational database scales and is as reliable
   as a NoSQL database.  For example, did they just shard on a 'namespace'
   column and shard on that using the database's sharding capabilities vs
   creating a db/schema for every customer and having to reshuffle these
   around.

...OR...

   - b) Overcome querying deficiencies of a NoSQL database by writing the
   data to both a NoSQL datastore and something like Elastic Search (which
   also scales easily).  This would make up for a number of the 'cons' of a
   NoSQL database for this use case based on a small spike project we did last
   summer.  So that's another option I would like to hear from someone about
   that has implemented this architecture and are fans.  I've recently heard
   from a person using a 200M record, multi-tentant app in mysql that used
   Elastic Search in front of it too for speed reasons.

Thanks again!
  Hardwick




On Sun, Jul 20, 2014 at 3:33 PM, Kaan Soral kaanso...@gmail.com wrote:

 Relational databases also require indexes, however NoSQL indexes are much
 harder to generate and costly

 You generally have to build with precision when developing with NoSQL,
 always knowing what you want and how you want it, build the models and
 indexes / systems for that

 There are also many other gotchas you learn with NoSQL - or AppEngine
 specifically

 But I will say this, I've never felt hopeless while using AppEngine, there
 is always someone out there to help with issues, or an efficient
 documentation

 Long story short, I've been using AppEngine at large scale for a while
 now, I would suggest it
 (The taskqueue system is also pretty strong, you can easily build a
 mapping task (map of mapreduce) and iterate over all entities in a
 relatively short time, so if costs are not a big issue, you can always
 iterate over everything instead of running a flexible relational db query
 that you would do otherwise)

 (Issues also happen, but there is always the soothing fact that someone
 else solves them at scale, however, since you are intending for a corporate
 usage, you might take the responsibility yourself and build a custom
 system, would be much harder, much more costly)

 I'm guessing this isn't the detailed reply you were looking for, but just
 my .02

 --
 You received this message because you are subscribed to a topic in the
 Google Groups Google App Engine group.
 To unsubscribe from this topic, visit
 https://groups.google.com/d/topic/google-appengine/txoW1CyVaPs/unsubscribe
 .
 To unsubscribe from this group and all its topics, send an email to
 google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/d/optout.




-- 
 David Hardwick, CTO

 p. 646.237.5388
m. 703.338.0741
a. 3405 Piedmont Road NE, Suite 325, Atlanta, GA 30305
e. david.hardw...@bettercloud.com
 New Guide: Best Practices for Managing Google Apps Using FlashPanel
http://www.flashpanel.com/guide/?utm_source=emailutm_medium=clickutm_campaign=BCsig

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: NoSQL vs Relational DBs - pros and cons

2014-07-21 Thread Jeff Schnitzer

There is a tech talk video online (several years old at this point) by a
Facebook engineer which describes the lengths they went to to get MySQL to
scale. You can probably find it with some googling. The upshot is they
basically use MySQL as a NoSQL system: Data is stored in schemaless blobs 
there are no joins.

Jeff


On Mon, Jul 21, 2014 at 10:12 AM, David Hardwick 
david.hardw...@bettercloud.com wrote:

 Thanks, Kaan.

 I realize my post looks too mired in opinion.  In retrospect, I should
 have stated that we are using App Engine and the Datastore, and we ARE
 operating at that scale mentioned (40,000 customers, 10million records each
 across 50 or so entities), we don't have a DBA, etc..I just wanted to
 talk to someone that has either:


- a)  figured out how to shard a relational database at multi-tenant
scale (e.g., 30,000 customers containing 10M records per customer, across
50 tables each) such that the relational database scales and is as reliable
as a NoSQL database.  For example, did they just shard on a
'namespace' column and shard on that using the database's sharding
capabilities vs creating a db/schema for every customer and having to
reshuffle these around.

 ...OR...

- b) Overcome querying deficiencies of a NoSQL database by writing the
data to both a NoSQL datastore and something like Elastic Search (which
also scales easily).  This would make up for a number of the 'cons' of a
NoSQL database for this use case based on a small spike project we did last
summer.  So that's another option I would like to hear from someone about
that has implemented this architecture and are fans.  I've recently heard
from a person using a 200M record, multi-tentant app in mysql that used
Elastic Search in front of it too for speed reasons.

 Thanks again!
   Hardwick




 On Sun, Jul 20, 2014 at 3:33 PM, Kaan Soral kaanso...@gmail.com wrote:

 Relational databases also require indexes, however NoSQL indexes are much
 harder to generate and costly

 You generally have to build with precision when developing with NoSQL,
 always knowing what you want and how you want it, build the models and
 indexes / systems for that

 There are also many other gotchas you learn with NoSQL - or AppEngine
 specifically

 But I will say this, I've never felt hopeless while using AppEngine,
 there is always someone out there to help with issues, or an efficient
 documentation

 Long story short, I've been using AppEngine at large scale for a while
 now, I would suggest it
 (The taskqueue system is also pretty strong, you can easily build a
 mapping task (map of mapreduce) and iterate over all entities in a
 relatively short time, so if costs are not a big issue, you can always
 iterate over everything instead of running a flexible relational db query
 that you would do otherwise)

 (Issues also happen, but there is always the soothing fact that someone
 else solves them at scale, however, since you are intending for a corporate
 usage, you might take the responsibility yourself and build a custom
 system, would be much harder, much more costly)

 I'm guessing this isn't the detailed reply you were looking for, but just
 my .02

 --
 You received this message because you are subscribed to a topic in the
 Google Groups Google App Engine group.
 To unsubscribe from this topic, visit
 https://groups.google.com/d/topic/google-appengine/txoW1CyVaPs/unsubscribe
 .
 To unsubscribe from this group and all its topics, send an email to
 google-appengine+unsubscr...@googlegroups.com.

 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/d/optout.




 --
  David Hardwick, CTO

  p. 646.237.5388
 m. 703.338.0741
 a. 3405 Piedmont Road NE, Suite 325, Atlanta, GA 30305
 e. david.hardw...@bettercloud.com
  New Guide: Best Practices for Managing Google Apps Using FlashPanel
 http://www.flashpanel.com/guide/?utm_source=emailutm_medium=clickutm_campaign=BCsig

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/d/optout.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit

Re: [google-appengine] Re: NoSQL vs Relational DBs - pros and cons

2014-07-21 Thread David Hardwick

Thanks, Jeff.  Yes, I'm starting to get some calls in with folks and one
company told me they don't make the decision at an application level, they
make it per tableso they use both relational and NoSQL.   Not going to
have massive scale needs and need relational?  Then they use
relational...going to have mind blowing scale (X thousand records per
second) they use NoSQL.

Thanks for the tip on the Google search for how Facebook scaled MySQL, I'm
seeing some great articles and videos to get through here.

Rock on,
  Hardwick


On Mon, Jul 21, 2014 at 1:24 PM, Jeff Schnitzer j...@infohazard.org wrote:

 There is a tech talk video online (several years old at this point) by a
 Facebook engineer which describes the lengths they went to to get MySQL to
 scale. You can probably find it with some googling. The upshot is they
 basically use MySQL as a NoSQL system: Data is stored in schemaless blobs 
 there are no joins.

 Jeff


 On Mon, Jul 21, 2014 at 10:12 AM, David Hardwick 
 david.hardw...@bettercloud.com wrote:

 Thanks, Kaan.

 I realize my post looks too mired in opinion.  In retrospect, I should
 have stated that we are using App Engine and the Datastore, and we ARE
 operating at that scale mentioned (40,000 customers, 10million records each
 across 50 or so entities), we don't have a DBA, etc..I just wanted to
 talk to someone that has either:


- a)  figured out how to shard a relational database at multi-tenant
scale (e.g., 30,000 customers containing 10M records per customer, across
50 tables each) such that the relational database scales and is as 
 reliable
as a NoSQL database.  For example, did they just shard on a
'namespace' column and shard on that using the database's sharding
capabilities vs creating a db/schema for every customer and having to
reshuffle these around.

 ...OR...

- b) Overcome querying deficiencies of a NoSQL database by writing
the data to both a NoSQL datastore and something like Elastic Search 
 (which
also scales easily).  This would make up for a number of the 'cons' of a
NoSQL database for this use case based on a small spike project we did 
 last
summer.  So that's another option I would like to hear from someone about
that has implemented this architecture and are fans.  I've recently heard
from a person using a 200M record, multi-tentant app in mysql that used
Elastic Search in front of it too for speed reasons.

 Thanks again!
   Hardwick




  On Sun, Jul 20, 2014 at 3:33 PM, Kaan Soral kaanso...@gmail.com wrote:

  Relational databases also require indexes, however NoSQL indexes are
 much harder to generate and costly

 You generally have to build with precision when developing with NoSQL,
 always knowing what you want and how you want it, build the models and
 indexes / systems for that

 There are also many other gotchas you learn with NoSQL - or AppEngine
 specifically

 But I will say this, I've never felt hopeless while using AppEngine,
 there is always someone out there to help with issues, or an efficient
 documentation

 Long story short, I've been using AppEngine at large scale for a while
 now, I would suggest it
 (The taskqueue system is also pretty strong, you can easily build a
 mapping task (map of mapreduce) and iterate over all entities in a
 relatively short time, so if costs are not a big issue, you can always
 iterate over everything instead of running a flexible relational db query
 that you would do otherwise)

 (Issues also happen, but there is always the soothing fact that someone
 else solves them at scale, however, since you are intending for a corporate
 usage, you might take the responsibility yourself and build a custom
 system, would be much harder, much more costly)

 I'm guessing this isn't the detailed reply you were looking for, but
 just my .02

 --
 You received this message because you are subscribed to a topic in the
 Google Groups Google App Engine group.
 To unsubscribe from this topic, visit
 https://groups.google.com/d/topic/google-appengine/txoW1CyVaPs/unsubscribe
 .
 To unsubscribe from this group and all its topics, send an email to
 google-appengine+unsubscr...@googlegroups.com.

 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/d/optout.




 --
  David Hardwick, CTO

  p. 646.237.5388
 m. 703.338.0741
 a. 3405 Piedmont Road NE, Suite 325, Atlanta, GA 30305
 e. david.hardw...@bettercloud.com
  New Guide: Best Practices for Managing Google Apps Using FlashPanel
 http://www.flashpanel.com/guide/?utm_source=emailutm_medium=clickutm_campaign=BCsig

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to google-appengine+unsubscr...@googlegroups.com.

 To

[google-appengine] I updated Google Eclipse Plugin to 3.6.0 and then could NOT deploy due to size limit of 150MB

2014-07-21 Thread Rodrigo Teixo

Hi All,

After I updated from Google Eclipse Plugin from 3.4.2 to 3.6.0, it cannot 
let me deploy. The message error is:
*Applications are limited to 157286400 bytes of resource files, you have 
212567564.*

I backup my eclipse version before de update and I could deploy again with 
no code alteration.

Its is very strange cause the staging directory after the end of 
permutation is about 2.6Mb. Its much more during the compile. 


I found something very curious searching for a solution for this error. I 
found the snipet of code of appengine that produces this message in this 
link:

http://code.google.com/p/googleappengine/source/browse/trunk/java/src/main/com/google/appengine/tools/admin/AppVersionUpload.java

if (resourceTotal  resourceLimits.maxTotalFileSize()) {
  throw new LocalIOException(Applications are limited to 
  + resourceLimits.maxTotalFileSize() +  bytes of resource files, 
  + you have  + resourceTotal + .);
}

And on same page looking for how resourceTotal is calculated we see that is 
the sum of size of files relative to a variable called *basepath*.

Looking for how this variable is initiated we find out this function:

private File getBasepath() {
File path = app.getStagingDir();
if (path == null) {
  path = new File(app.getPath());
}
return path;
}

Look that it uses the staging directory, but if for some reason could not 
return it uses de app directory witch in my case, the war directory is much 
more than 150Mb and I think its my case.

This code is very strange, cause if the staging directory could not be 
returned it should gives a error and not make this adjustment that could 
end in a quota limit.

I am completed tied in this bug, cause its brings a lot of insecurity if I 
could not deploy with new updates of google plugin.


Aditional info:
1 - That deploy folder is outside of the war directory with the -deploy and 
-extra parameters.
2 - I have about 50 jars with total 17Mb in WEB-INF/lib folder. With the 
jars generated by appengine and gwt it goes to about 68Mb in the 
WEB-INF/lib folder.
3 - In my current app, under the versions tab of appengine dashboard the 
sizes of the deployed versions are all more de 150Mb. (are this the same 
number of the limit?)
4 - I updated the latest versions gwt (2.6.0) and appengine(1.9.7) and 
could deploy normally. I just cant update the Eclipse Plugin to 3.6.0.

Any help would be very appreciated.
[],
Rodrigo.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Add image to page with static folder

That is where mine are located.
On Jul 18, 2014 12:07 AM, Vinny P vinny...@gmail.com wrote:

 On Thu, Jul 17, 2014 at 4:51 AM, Mahyar mahyar...@gmail.com wrote:

 i have a problem to use image with static folder path in my page. this is
 my app.yaml
 I have templates, static/images, controllers (has MainHandler.py) folders
 and in my root i have main.py and app.yaml files. in my problem is when
 page was loaded i cant see my fig1.jpg picture.




 Just to be clear, the image files are located within the subdirectory
 */static/images/*, correct?

 When you try to access the image file, do you see any message in logging?
 Does it say anything similar to * static file referenced by handler not
 found *? What path are you using when running the script?


 -
 -Vinny P
 Technology  Media Consultant
 Chicago, IL

 App Engine Code Samples: http://www.learntogoogleit.com

  --
 You received this message because you are subscribed to a topic in the
 Google Groups Google App Engine group.
 To unsubscribe from this topic, visit
 https://groups.google.com/d/topic/google-appengine/x0el308P9OU/unsubscribe
 .
 To unsubscribe from this group and all its topics, send an email to
 google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/d/optout.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Add image to page with static folder

./images/file.jpg I think you need the dot.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Add image to page with static folder

div
img src=./images/fig1.jpg
/div

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Can't deploy with Google App Engine Launcher

2014-07-21 Thread avant . vasilev

I'm on win7 with firewall turned off, using GAEL version 1.9.7 and my 
google account does not use 2-Step Verification, experiencing the following 
error on deploy each time:

2014-07-18 13:34:50 Running command: ['C:\\Python27\\pythonw.exe', '-u', 
'C:\\Program Files (x86)\\Google\\google_appengine\\appcfg.py', 
'--no_cookies', u'--email=my_google_aco...@gmail.com', '--passin', 
'update', 'C:\\Development\\Html\\Projects\\fitty\\bin']
01:34 PM Application: fitty-evolution; version: 1
01:34 PM Host: appengine.google.com
01:34 PM 
Starting update of app: fitty-evolution, version: 1
01:34 PM Getting current resource limits.
Password for my_google_aco...@gmail.com: Invalid username or password.
2014-07-18 13:34:55,424 ERROR appcfg.py:2395 An error occurred processing 
file '': HTTP Error 401: Unauthorized. Aborting. 
Error 401: --- begin server output ---
Must authenticate first.
--- end server output ---
2014-07-18 13:34:55 (Process exited with code 1)

You can close this window now.




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Abridged summary of google-appengine@googlegroups.com - 10 updates in 10 topics

I have been reviewing and i see reasons for using memcache, and datastore
and cloudsql, as well or instead of postgres.

The argument for keeping it together is that it avoids developing islands
of information that cannot be easily connected. But if all i want is a page
counter then why not just use a memcache for that specific item. In the
case of the page counter, i was looking at having it as a package function
that i can use on any page i create in go.

For the family site, a datastore would be adequate as the list would likely
remain short and the relationships would remain uncomplicated.

For the goclio site, the profile would be a record in an sql table, the
record could be created, modified, posted, flagged to be deleted. the
posting process is when I create a list of all unposted records to be
posted to the goclio site for commission purposes. I can think of no other
operation to be performed on that site.

The eve database was ideal for postgres but I am not playing eve right now,
partly because i do not have the money, but partly because i would rather
invest my time in reality, even if my reality is virtual reality of
universe.

The database for universe is something that i have some notes on, seems
like they were mostly just transactional type things. The format was not so
much a table as a list of documents that define game assets that may be
read from the database but the idea is that any one of the documents could
stand alone and be validated as authentic without consulting the database
which would allow peer-to-peer communication with some post journal ling to
work. I never did actually define that structure, so i was excited by
postgres 9.4 as i thought it would well support what I wanted to do, even
though i havent really figured out exactly what I wanted to do.

I am thinking the most typical thing in universe is to have 10 million
documents and get a list of all those documents that meet criterion
desired, in which case the document and the database may not be the same
thing except in my mind the entries into the database are part of the
document.

An example of a query would be all documents from a particular node that do
not expire before a given date, although retrieval may need to be
prioritized to certain types of records, you may need to be able to see the
sawmill before you know what kind of sawmill or get a list of inventory
from the sawmill. The thing is, this is the same thing as the standard GL
accounting programming I was doing in the old days on a 286, the only
difference is scale, and I am accustomed to avoiding any unnecessary
traffic. I think to many modern programmers do concepts without traffic
analysis and create their own bottlenecks with useless duplicate queries
and redundant indexes.

Well this is my database rant.

I expect I will create a dasa.cc/package locally for my postgres security
stuff that will not be saved to github and give it a test but will also
likely create a package with some standard solutions for the use cases I
expect to actually deal with most often using the google cloud storage
stuff.


On Fri, Jul 18, 2014 at 2:08 PM, google-appengine@googlegroups.com wrote:

   Today's topic summary

 Group: http://groups.google.com/group/google-appengine/topics

- Datastore eventual consistency #1474ae03771095be_group_thread_0 [1
Update]
- NoSQL vs Relational DBs - pros and cons
#1474ae03771095be_group_thread_1 [1 Update]
- Idle instances not working #1474ae03771095be_group_thread_2 [1
Update]
- Add image to page with static folder
#1474ae03771095be_group_thread_3 [1 Update]
- 403 Error from url open #1474ae03771095be_group_thread_4 [1 Update]
- 500 server Error internal #1474ae03771095be_group_thread_5 [1
Update]
- ImportError: No module named feedparser
#1474ae03771095be_group_thread_6 [1 Update]
- When receiving mail is more than maximum size limit
#1474ae03771095be_group_thread_7 [1 Update]
- Store list in google datastore #1474ae03771095be_group_thread_8 [1
Update]
- Use OAuth2 for authentication + compatibility with
google.appengine.api.users service #1474ae03771095be_group_thread_9
[1 Update]

   Datastore eventual consistency
 http://groups.google.com/group/google-appengine/t/5fac602da1cbbf2a

Dan uvico...@gmail.com Jul 18 11:06AM -0700

Eventual consistency means that it will take a undetermined amount of
time after a datastore entity 'put' for a query on that entity to be
returned.

However am I right in thinking that if I 'put' ...more
http://groups.google.com/group/google-appengine/msg/66b07c6876b8dd6

Back to top #1474ae03771095be_digest_top

   NoSQL vs Relational DBs - pros and cons
 http://groups.google.com/group/google-appengine/t/b71a16d42c9568fb

David Hardwick david.hardw...@bettercloud.com Jul 18 06:57AM -0700

And how are you?

My purpose with this email to not to seek out a religious debate on
NoSQL vs

[google-appengine] Re: Use OAuth2 for authentication + compatibility with google.appengine.api.users service

2014-07-21 Thread Mihail Russu

Don't know if this is what you are looking for but I've successfully been 
using https://code.google.com/p/gae-simpleauth/ for OAuth2 authentication 
in combination with Users API. With some minor changes my users can link 
their manually registered accounts to Facebook and authenticate with either 
as well as use only Facebook. Also, not sure how to answer most of your 
answers but scopes are service dependent, i.e. they'd be different for 
Facebook/Google and working with Users API shouldn't be any different after 
OAuth2 and there shouldn't be any conflicts.

On Thursday, July 17, 2014 9:58:57 PM UTC-5, John Del Rosario wrote:

 (x-post from SO and reddit, for maximum visibility)

 We're trying to put our app on Google Marketplace, and one of the 
 requirements was to use OAuth2 for authentication. Unfortunately (and 
 strangely), AppEngine doesn't have an option for this.

 Right now, we are using OpenID for authentication. I've been trying to 
 find resources online, but have failed in finding a definitive guide on how 
 to do this properly. 

 My concerns are:

 1. What scope should I use?
 2. How should sessions be managed? (the [Users](
 https://developers.google.com/appengine/docs/python/users/) service 
 handled this very well)
 3. What would the local development process be like? Would I need to have 
 an internet connection to be able to use `dev_appserver.py`?
 4. We rely heavily on the [`user_id`](
 https://developers.google.com/appengine/docs/python/users/userclass#User_user_id)
  
 property provided by the Users service. Can I rely on it having the same 
 value when switching to OAuth2?
 5. Any possible conflicts in other AppEngine services (ones that rely on 
 Users service)?
 6. Would the `login: required` flag in `app.yaml` still work as expected 
 after migrating?
 7. Are there plans on supporting proper OAuth2 authentication as a default 
 option in AppEngine projects?

 Also, the AppEngine docs seem to be out of date with regards to 
 integrating with Marketplace.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] How long to wait for submitting a request for additional email quota

2014-07-21 Thread Ryota Yamada

My quota of the Recipients-Emailed is 100 and I have submitted for 
submitting a request for additional email quota in the link, If your 
application needs to send more emails, you can *submit a request* 
https://appengine.google.com/quotas/mail_quota?app_id=s~willpowerdevelopment 
for 
additional email quota.

My support package is Bronze.

Already two week has passed, I still could not have any reply, approval or 
deny, and message in the Dashboard is still Your request for increased 
email quota has been received and is currently under review.

I wan to know how long to wait usually... I saw in the forum, ti's around a 
week...

Thanks.




 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: bot attack

2014-07-21 Thread Vlad

I faced the same issue.
As I found out, the attacker used the URLs, which were provided to him by 
chrome extension. In my case it was awesomescreenshot extension in Google 
Chrome, which leaked all the internal pages (in admin account) I was 
visiting myself. So the bot later just pinged those.

When extension is installed basically it receives access to all the pages 
URLs you visit. I just removed the extension, now in doubts whether I need 
to reset all password of all my accounts, because potentially cookies also 
could be leaked.

On Thursday, May 15, 2014 3:55:11 PM UTC+2, dimitriosd1983 wrote:

 I have an application that only runs cron jobs and uses a backend, so 
 there are no incoming requests from any client. I noticed that a request 
 from a user named 'niki-bot' was received and I'm quite surprised as my app 
 url does not appear anywhere it's only used by admin account which sends 
 cron requests. Fortunately I had setup security on my crons so this user 
 got a 403 forbidden message, but I'm still wondering how could this happen. 
 Has any of you guys experienced something similar?


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] 500 server Error internal

2014-07-21 Thread Eduardo Gutiérrez

if i use incognito window it happens the same.

The instructions you give me to download wouldnt work as i have gae python.

I want to download my course make with gae, so i dont mind download
everything or only the course.

thanks

El viernes, 18 de julio de 2014 07:02:58 UTC+2, Vinny P escribió:

On Thu, Jul 17, 2014 at 10:59 AM, Eduardo Gutiérrez edufi...@gmail.com
javascript: wrote:

Hello since yesterday i cant enter in my app curso-apeo.appspot.com...I
cant enter as admin nor in the dashboard
I also cant enter in Datastore admin as i always get a too many
redirections error in the left column.
So what can i do to enter in my course and restore my work of these lasts
days ?
I have tried to download and then upload the course again.. but i cant
enter...500 error is everywhere
Please help i have to give my final degree project tomorrow...

Are you trying to download and upload data or the application itself? You
can download the application by using appcfg:
https://developers.google.com/appengine/docs/java/tools/uploadinganapp#Downloading_an_Application

In regards to the redirection issue, can you try to open up a new browser
Incognito/Private Browsing window and try logging into the console again?

-
-Vinny P
Technology Media Consultant
Chicago, IL

App Engine Code Samples: http://www.learntogoogleit.com

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Advanced Sample for Endpoints?

2014-07-21 Thread Will Merydith

Bumping this.  Trying to find a sample that shows how one would translate 
NDB objects to Messages in order to work with Endpoints.  It seems like 
this is the most common use case for Endpoints but I cannot find any 
guidance.  

On Wednesday, July 9, 2014 4:19:08 PM UTC-7, Will Merydith wrote:

 I would love to see a more advanced sample for using Endpoints to build an 
 API (in Python on App Engine). Meaning a sample project with multiple 
 models, interesting queries and support for all REST methods on each 
 collection.

 Please reply with a link if you know of any.  Thanks.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Twitter Like Feed?

2014-07-21 Thread Aake Gregertsen

What's the best way to implement a twitter like feed on GAE? I'm guessing 
an IN query with thousands of users would be extremely slow. What are my 
options here since each user will have a unique feed depending on how they 
are subscribed to.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Twitter Like Feed?

2014-07-21 Thread Jay

This is a fanout problem. You don't want to try and do it with a query. 

Note: Prospective Search would be the ideal solution for this on App 
Engine, but it has serious quota issues in the state it is in currently.
I wound up implementing my own fanout solution.

On Monday, July 21, 2014 3:27:55 AM UTC-5, Aake Gregertsen wrote:

 What's the best way to implement a twitter like feed on GAE? I'm guessing 
 an IN query with thousands of users would be extremely slow. What are my 
 options here since each user will have a unique feed depending on how they 
 are subscribed to.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: ndb, get_by_id can not get an entity with a parent key only by id?

2014-07-21 Thread Jay

Responding to your first post ... that is right. The parent key is part of 
the entity's key. When you use get_by_id, this is just shorthand for 
Key('Foo', 99).get().
You cannot get an entity by key unless you know the key, the whole key. 

You say you don't want to query, but your use case ... give me all 
articles for user A ... sounds like a query. 
articles = Article.query(Article.author == user_key)...

If you want to do something like most recent n articles then you can 
store those keys in a 'secondary index' of sorts and use ndb.get_multi()

On Monday, July 21, 2014 8:11:20 AM UTC-5, saintthor wrote:

 to query may cost too many ops. i don't query.



 在 2014年7月21日星期一UTC+8下午8时53分29秒，Kaan Soral写道：

 Not associated with google, also not an expert on ndb

 As far as I know key groups are related with consistency, in my opinion, 
 you shouldn't put article's and author's in the same group, there is a 1/s 
 write speed limit on entity groups, if you put them in the same entity 
 group, you could hit this limit more easily

 You don't even have to use referenceproperty's - I would just put the 
 author key in an article StringProperty named author and query for it, if 
 I were you



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: NoSQL vs Relational DBs - pros and cons

2014-07-21 Thread Nick

I've had very good results on AppEngine mixing the datastore and full text 
search api.

I use java, so the search api is used to index java objects, and we use 
Objectify to store the same object in the datastore.

Basic crud operations, or anything required to be transactional, are 
performed on the datastore. Queries are run through the search api which 
returns an id. We then fetch the object from the datastore using that id as 
the single source of 'truth'.

The only downside is that the search service does not participate in 
transactions, and its consistency semantics are not documented. If you 
assume eventual consistentency then it's no worse off than the datastore.

As with every service on appengine, there are limitations however, 
particularly with the type of data you can store and the precision of that 
data. For example numeric values in the search index are doubles but 
constrained to the range of an int, and range queries on dates only take 
into account the date itself, not the time. In most cases, you can make it 
work for you, but it isn't as easy as it could be.




On Tuesday, July 22, 2014 3:13:04 AM UTC+10, David Hardwick wrote:

 Thanks, Kaan.

 I realize my post looks too mired in opinion.  In retrospect, I should 
 have stated that we are using App Engine and the Datastore, and we ARE 
 operating at that scale mentioned (40,000 customers, 10million records each 
 across 50 or so entities), we don't have a DBA, etc..I just wanted to 
 talk to someone that has either:


- a)  figured out how to shard a relational database at multi-tenant 
scale (e.g., 30,000 customers containing 10M records per customer, across 
50 tables each) such that the relational database scales and is as 
 reliable 
as a NoSQL database.  For example, did they just shard on a 
'namespace' column and shard on that using the database's sharding 
capabilities vs creating a db/schema for every customer and having to 
reshuffle these around.

 ...OR...

- b) Overcome querying deficiencies of a NoSQL database by writing the 
data to both a NoSQL datastore and something like Elastic Search (which 
also scales easily).  This would make up for a number of the 'cons' of a 
NoSQL database for this use case based on a small spike project we did 
 last 
summer.  So that's another option I would like to hear from someone about 
that has implemented this architecture and are fans.  I've recently heard 
from a person using a 200M record, multi-tentant app in mysql that used 
Elastic Search in front of it too for speed reasons. 

 Thanks again!
   Hardwick




 On Sun, Jul 20, 2014 at 3:33 PM, Kaan Soral kaan...@gmail.com 
 javascript: wrote:

 Relational databases also require indexes, however NoSQL indexes are much 
 harder to generate and costly

 You generally have to build with precision when developing with NoSQL, 
 always knowing what you want and how you want it, build the models and 
 indexes / systems for that

 There are also many other gotchas you learn with NoSQL - or AppEngine 
 specifically

 But I will say this, I've never felt hopeless while using AppEngine, 
 there is always someone out there to help with issues, or an efficient 
 documentation

 Long story short, I've been using AppEngine at large scale for a while 
 now, I would suggest it
 (The taskqueue system is also pretty strong, you can easily build a 
 mapping task (map of mapreduce) and iterate over all entities in a 
 relatively short time, so if costs are not a big issue, you can always 
 iterate over everything instead of running a flexible relational db query 
 that you would do otherwise)

 (Issues also happen, but there is always the soothing fact that someone 
 else solves them at scale, however, since you are intending for a corporate 
 usage, you might take the responsibility yourself and build a custom 
 system, would be much harder, much more costly)

 I'm guessing this isn't the detailed reply you were looking for, but just 
 my .02

 -- 
 You received this message because you are subscribed to a topic in the 
 Google Groups Google App Engine group.
 To unsubscribe from this topic, visit 
 https://groups.google.com/d/topic/google-appengine/txoW1CyVaPs/unsubscribe
 .
 To unsubscribe from this group and all its topics, send an email to 
 google-appengi...@googlegroups.com javascript:.
 To post to this group, send email to google-a...@googlegroups.com 
 javascript:.
 Visit this group at http://groups.google.com/group/google-appengine.
 For more options, visit https://groups.google.com/d/optout.




 -- 
  David Hardwick, CTO

  p. 646.237.5388
 m. 703.338.0741
 a. 3405 Piedmont Road NE, Suite 325, Atlanta, GA 30305
 e. david.h...@bettercloud.com javascript:
  New Guide: Best Practices for Managing Google Apps Using FlashPanel 
 http://www.flashpanel.com/guide/?utm_source=emailutm_medium=clickutm_campaign=BCsig
   
  

-- 
You received this message

Re: [google-appengine] Can't deploy with Google App Engine Launcher

On Fri, Jul 18, 2014 at 5:43 AM, avant.vasi...@gmail.com wrote:

 I'm on win7 with firewall turned off, using GAEL version 1.9.7 and my
 google account does not use 2-Step Verification, experiencing the
 following error on deploy each time:

 Password for my_google_aco...@gmail.com: Invalid username or password.
 2014-07-18 13:34:55,424 ERROR appcfg.py:2395 An error occurred processing
 file '': HTTP Error 401: Unauthorized. Aborting.



I would retry using the OAuth option (
https://developers.google.com/appengine/docs/python/tools/uploadinganapp#Python_Password-less_login_with_OAuth2
). If that still doesn't work, a few questions: how many people have access
to this application ID? Is this the first time you've attempted deployment,
or have you successfully deployed an application before (to this app ID and
to other application IDs). Can you try creating a new application ID and
deploying to that?


-
-Vinny P
Technology  Media Consultant
Chicago, IL

App Engine Code Samples: http://www.learntogoogleit.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Advanced Sample for Endpoints?

On Mon, Jul 21, 2014 at 9:22 AM, Will Merydith will.meryd...@gmail.com
 wrote:

 Bumping this.  Trying to find a sample that shows how one would translate
 NDB objects to Messages in order to work with Endpoints.  It seems like
 this is the most common use case for Endpoints but I cannot find any
 guidance.



There's a reasonably advanced example of Endpoints in Java here:
https://cloud.google.com/developers/articles/how-to-build-mobile-app-with-app-engine-backend-tutorial
but I'm not sure if there's an advanced example of Python endpoints
available https://github.com/GoogleCloudPlatform/endpoints-proto-datastore
.

But if you're only interested in Endpoints to move data to/from the
datastore, you may be interested in Google Cloud Save
https://developer.android.com/google/gcs/index.html . It seems to be
targeted to a similar use case (translating data objects from db to an
endpoint client).


-
-Vinny P
Technology  Media Consultant
Chicago, IL

App Engine Code Samples: http://www.learntogoogleit.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Twitter Like Feed?

On Mon, Jul 21, 2014 at 3:27 AM, Aake Gregertsen aake.gregert...@gmail.com
 wrote:

 What's the best way to implement a twitter like feed on GAE? I'm guessing
 an IN query with thousands of users would be extremely slow. What are my
 options here since each user will have a unique feed depending on how they
 are subscribed to.




There's a good overview at
http://highscalability.com/blog/2013/7/8/the-architecture-twitter-uses-to-deal-with-150m-active-users.html
but the TL;DR is that there's a lot of writing going on.

As Jay said, the best solution would probably be rolling out a Prospective
Search (or similar) service to test for interesting messages, then write
them into the individual account feeds.


-
-Vinny P
Technology  Media Consultant
Chicago, IL

App Engine Code Samples: http://www.learntogoogleit.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Dev workflow for Modules + Maven

On Thu, Jul 17, 2014 at 12:25 PM, Juan de Dios Becerra 
j.becerra4...@gmail.com wrote:

 I can't make it work, when I complete my configuration(modify the actual
 project) I deploy to App Engine but I get this warning: Performance
 settings included in this update are being ignored because your application
 is not using the Modules feature. See the Modules documentation for more
 information.



Are you sure you have the configuration files and directory set up
properly? Your directory structure needs to look similar to the picture
here:
https://developers.google.com/appengine/docs/java/modules/#Java_Configuration


On Thu, Jul 17, 2014 at 12:25 PM, Juan de Dios Becerra 
j.becerra4...@gmail.com wrote:

 I don't see the *Performance Settings Migration for Modules*,



You'll only see that section if you've changed any of the frontend
settings. If you don't see it, that's fine.


On Thu, Jul 17, 2014 at 12:25 PM, Juan de Dios Becerra 
j.becerra4...@gmail.com wrote:

 or it is possible to use Modules without Maven?



You can use Modules without Maven, as long as the files and directories are
placed correctly. But Maven does make it much easier to manage the build
process.


-
-Vinny P
Technology  Media Consultant
Chicago, IL

App Engine Code Samples: http://www.learntogoogleit.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: ndb, get_by_id can not get an entity with a parent key only by id?

in db, i set such a property in model article:

 auth = db.ReferenceProperty( author, collection_name=AuthSet )


and use author.AuthSet to get all articles written by the certain author. 
there is no query. how can i do the same thing in ndb?


在 2014年7月22日星期二UTC+8上午3时55分28秒，Jay写道：

 Responding to your first post ... that is right. The parent key is part of 
 the entity's key. When you use get_by_id, this is just shorthand for 
 Key('Foo', 99).get().
 You cannot get an entity by key unless you know the key, the whole key. 

 You say you don't want to query, but your use case ... give me all 
 articles for user A ... sounds like a query. 
 articles = Article.query(Article.author == user_key)...

 If you want to do something like most recent n articles then you can 
 store those keys in a 'secondary index' of sorts and use ndb.get_multi()

 On Monday, July 21, 2014 8:11:20 AM UTC-5, saintthor wrote:

 to query may cost too many ops. i don't query.



 在 2014年7月21日星期一UTC+8下午8时53分29秒，Kaan Soral写道：

 Not associated with google, also not an expert on ndb

 As far as I know key groups are related with consistency, in my opinion, 
 you shouldn't put article's and author's in the same group, there is a 1/s 
 write speed limit on entity groups, if you put them in the same entity 
 group, you could hit this limit more easily

 You don't even have to use referenceproperty's - I would just put the 
 author key in an article StringProperty named author and query for it, if 
 I were you



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: ndb, get_by_id can not get an entity with a parent key only by id?

and, if you were a google guy, i'd like to ask what do you think the usage 
of key.parent is? in what instance it may be useful?

在 2014年7月22日星期二UTC+8上午3时55分28秒，Jay写道：

 Responding to your first post ... that is right. The parent key is part of 
 the entity's key. When you use get_by_id, this is just shorthand for 
 Key('Foo', 99).get().
 You cannot get an entity by key unless you know the key, the whole key. 

 You say you don't want to query, but your use case ... give me all 
 articles for user A ... sounds like a query. 
 articles = Article.query(Article.author == user_key)...

 If you want to do something like most recent n articles then you can 
 store those keys in a 'secondary index' of sorts and use ndb.get_multi()

 On Monday, July 21, 2014 8:11:20 AM UTC-5, saintthor wrote:

 to query may cost too many ops. i don't query.



 在 2014年7月21日星期一UTC+8下午8时53分29秒，Kaan Soral写道：

 Not associated with google, also not an expert on ndb

 As far as I know key groups are related with consistency, in my opinion, 
 you shouldn't put article's and author's in the same group, there is a 1/s 
 write speed limit on entity groups, if you put them in the same entity 
 group, you could hit this limit more easily

 You don't even have to use referenceproperty's - I would just put the 
 author key in an article StringProperty named author and query for it, if 
 I were you



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Use OAuth2 for authentication + compatibility with google.appengine.api.users service

On Thu, Jul 17, 2014 at 9:58 PM, John Del Rosario j...@collabspot.com
 wrote:

 We're trying to put our app on Google Marketplace, and one of the
 requirements was to use OAuth2 for authentication. Unfortunately (and
 strangely), AppEngine doesn't have an option for this.

 Also, the AppEngine docs seem to be out of date with regards to
 integrating with Marketplace.



You can't use the Users App Engine API with an Apps Marketplace
application. A Marketplace application must implement SSO and cannot
include a login step (which the Users API will show). See the note on this
page (quoted below):
https://developers.google.com/google-apps/marketplace/sso

*Caution: Every Marketplace application should present an invocation flow
that is free of an intermediate login step. The end user should never be
asked to provide an ID and password. Applications that do not follow this
flow will not be approved for listing in the Marketplace.*

You can use Mihail's suggestion of a third-party auth library, or use the
Google+ auth lib directly: https://developers.google.com/+/web/signin/


-
-Vinny P
Technology  Media Consultant
Chicago, IL

App Engine Code Samples: http://www.learntogoogleit.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] How long to wait for submitting a request for additional email quota

On Sat, Jul 19, 2014 at 2:10 AM, Ryota Yamada 
willpo...@willpowerdevelopment.com wrote:

 My quota of the Recipients-Emailed is 100 and I have submitted for
 submitting a request for additional email quota in the link

 Already two week has passed, I still could not have any reply, approval or
 deny, and message in the Dashboard is still Your request for increased
 email quota has been received and is currently under review.

 I wan to know how long to wait usually... I saw in the forum, ti's around
 a week...



There's no specific time frame to wait. Usually it takes between 1 - 2
weeks, but it could take longer.

If you have a pressing need to send email, you should consider using the
SendGrid integration:
https://developers.google.com/appengine/docs/python/mail/sendgrid#send_an_email
. You get a 25,000 emails per month free quota and it's easy to expand past
that.



-
-Vinny P
Technology  Media Consultant
Chicago, IL

App Engine Code Samples: http://www.learntogoogleit.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Application Data Center/Zone