[google-appengine] Re: Total Stored Data at 91%
Just guessing here, I worked for a few weeks with cassandra (another nosql, like bigtable), and it seems distributed deletes are really hard to do. Basically, deletes will not free up your memory inmediatly (more like in a week or so). That would explain your problems. Well, but that just how it works on cassandra. On Sep 25, 3:33 am, Hugo Visser botte...@gmail.com wrote: Another me too again. This happens once in a while, and it is mentioned in a couple of threads. I never got a clear explanation on what causes this. The amount of data that my app stores is constant, but there are a lot of updates to that data. I also use memcache, but the things I put in memcache have an expire time set so that should also be kinda constant. The quota page says: The total amount of data stored in datastore entities and corresponding indexes, in the memcache, and in the Blobstore. I've flushed the memcache again for my app, let's see if it helps... On Sep 24, 11:07 pm, chrisfarms chrisfa...@gmail.com wrote: I see similar. But didn't think too much of it since I have lots of data in the blobstore which the quota registers as 0, I assumed my blobstore storage was getting lumped into the datastore pile. Also see:http://code.google.com/p/googleappengine/issues/detail?id=2479 On Sep 23, 5:09 pm, David wordsmithg...@gmail.com wrote: The Total Stored Data quota seems to be very incorrect. The Datastore statistics only show 71MB for the size of all entities. And I only have one index in the Datastore indexes section which is an index on a string and an integer. The string is typically 30 characters long or so. I do have the app periodically delete entities when it is done with them, but they are typically short lived entities where they may only be in there for a number of days. I saw the Total Stored Data drop once when I added the auto pruning of data, but now I'm getting close the 1GB limit and I don't want my application to stop working. Does anybody know what might be going on? How do it get it to reduce the number to where it should be? Thanks, David -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: DB lmitations: how to use multiple criteria on many columns? URGENT!
Hi,
I´ve come with a solution to a similar problem I had.
What I did was this:
Lets say you can have MAX 6 rooms, so, on one field you store the
actual number of rooms and in other a list of room queries que
entity fits:
I'll explain myself:
class Entity{
Long rooms;
ArrayListLong roomQueries;
}
Now you need a code for every possible query for a room range i.e.
14 (from 1 to 4), 23 (from 2 to 3), 1 (exactly 1). Then you
calculate the ranges that fit your number of rooms and store them in
roomQueries.
Having all this set, you can query with a equality filter
i.e .filter(roomQueries = 56).
Another way of implementing this (actually the one im using) is
assigning every slot a power of 2, then a range query would be the
sum of all slots values involved
Using the above case, you'd have
1 room -- 1
2 rooms -- 2
3 rooms -- 4
4 rooms -- 8
5 rooms -- 16
6 rooms -- 32
the the query for 2 to 3 rooms would be = 6, 2 to 5 = 30.. and so on.
Hope this can help you :)
On Sep 19, 2:11 am, GAE-framework.googlecode.com
anton.danilche...@gmail.com wrote:
Hillo GAE developers!
I have a serious situation with datastore. I need select data from
model with multiple criteria. I have a House model, where exists
fields: cost, rooms, floor. I need filter all houses, where cost
5 and 15, and also rooms = 3 and 5, and also floor = 1
and 3.
How can I select this dataset? As I see, the Datastore says that I can
use filter criteria with , , =, = and != only on one column. But I
reallly need use this rules on multiple columns.
Please, help me!!!
How to implement my task with Datastore limitations?
Thank you. I really need your help.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Security exception using the new getServingUrl capabilities on dev server
I have the same problem. Works fine when uploaded, the problem is on deve server. On Aug 18, 4:17 pm, Spines kwste...@gmail.com wrote: getServingUrl works fine, returning a url ofhttp://localhost:8080/_ah/img/sxO56aAM_qVlARX4ym61bQ, but when i navigate my browser to that url i get a security exception: any ideas how to fix this, or is it a dev server bug? Aug 18, 2010 8:14:45 PM com.google.apphosting.utils.jetty.JettyLogger warn [java] WARNING: /_ah/img/sxO56aAM_qVlARX4ym61bQ [java] java.lang.SecurityException: Unable to create temporary file [java] at java.io.File.checkAndCreate(File.java:1701) [java] at java.io.File.createTempFile(File.java:1793) [java] at javax.imageio.stream.FileCacheImageInputStream.init(FileCacheImageInputSt ream.java: 80) [java] at com.sun.imageio.spi.InputStreamImageInputStreamSpi.createInputStreamInstanc e(InputStreamImageInputStreamSpi.java: 51) [java] at javax.imageio.ImageIO.createImageInputStream(ImageIO.java:331) [java] at javax.imageio.ImageIO.read(ImageIO.java:1325) [java] at com.google.appengine.api.images.dev.LocalImagesService.openImage(LocalImage sService.java: 230) [java] at com.google.appengine.api.images.dev.LocalBlobImageServlet.transformImage(Lo calBlobImageServlet.java: 211) [java] at com.google.appengine.api.images.dev.LocalBlobImageServlet.doGet(LocalBlobIm ageServlet.java: 47) [java] at javax.servlet.http.HttpServlet.service(HttpServlet.java:693) [java] at javax.servlet.http.HttpServlet.service(HttpServlet.java:806) [java] at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) [java] at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1166) [java] at AC.ACFilter.doFilter(ACFilter.java:93) [java] at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) [java] at com.google.appengine.tools.appstats.AppstatsFilter.doFilter(AppstatsFilter. java: 140) [java] at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) [java] at com.google.appengine.api.blobstore.dev.ServeBlobFilter.doFilter(ServeBlobFi lter.java: 58) [java] at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) [java] at com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter(Trans actionCleanupFilter.java: 43) [java] at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) [java] at com.google.appengine.tools.development.StaticFileFilter.doFilter(StaticFile Filter.java: 122) [java] at org.mortbay.jetty.servlet.ServletHandler $CachedChain.doFilter(ServletHandler.java:1157) [java] at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java: 388) [java] at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java: 216) [java] at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java: 182) [java] at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java: 765) [java] at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418) [java] at com.google.apphosting.utils.jetty.DevAppEngineWebAppContext.handle(DevAppEn gineWebAppContext.java: 70) [java] at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java: 152) [java] at com.google.appengine.tools.development.JettyContainerService $ApiProxyHandler.handle(JettyContainerService.java:349) [java] at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java: 152) [java] at org.mortbay.jetty.Server.handle(Server.java: 326) [java] at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java: 542) [java] at org.mortbay.jetty.HttpConnection $RequestHandler.headerComplete(HttpConnection.java:923) [java] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:547) [java] at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) [java] at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) [java] at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java: 409) [java] at org.mortbay.thread.QueuedThreadPool $PoolThread.run(QueuedThreadPool.java:582) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to
[google-appengine] Google Code favicon
I've been working (learning lately a lot with app engine and gwt, and typically I have my browser with 10+ tabs open, ~8 of which are google code pages (code.google.com) or google search pages(www.google.com). The problem (not a really serious one thou), is that sometimes takes me a while (1-5 seconds) to get to the tab I wanted. So it would be nice if Google code could have it's own favicon, so developers could get to the desired page faster. Does somebody else think this would be nice? Am i the only one with this problem? Pd: sorry if this is not the correct channel to send this message, but I couldn't find one more appropriated. Pd2: Google IO's presentation this year on app engine are awesome. Congrats to the team. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] INFO: This request caused a new process to be started for your application
Hi everyone,
Whenever i get the:
INFO: This request caused a new process to be started for your
application, and thus caused your application code to be loaded for
the first time. This request may thus take longer and use more CPU
than a typical request for your application.
the server returns an empty page. I don know what the problem may me
anyone got any clues? has this happend to anyone?
this is my handler.py file's header, where i run the main method
# -*- coding: utf-8 -*-
import sys
reload(sys); sys.setdefaultencoding('utf-8')
for k in [k for k in sys.modules if k.startswith('django')]:
del sys.modules[k]
from google.appengine.dist import use_library
use_library('django', '1.1')
import os
os.environ['DJANGO_SETTINGS_MODULE'] = 'settings'
Maybe theres the problem?
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
