[appengine-java] Re: File content getting truncated while uploading the same in blob store

2012-01-05 Thread Stuart Langley
Probably a good idea to create a simple repro of your issue and open an issue in the tracker with the repro attached. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit

[appengine-java] Re: Conversion API - Adding Assets Example Wrongly Documented

2012-01-05 Thread RAJ
I have solved this issue now :) (Java Documentation must be updated with right example) code Asset asset = new Asset( text/html, bsome data/bimg src=static/icon.gif/ .getBytes(), testfile.html); byte[] image_data = // Read your image into bytes[] array; Asset subAsset = new Asset(

[appengine-java] Re: How to take webpage screenshot in Google App Engine?

2012-01-05 Thread Tahir Akram
Any help? On Dec 30 2011, 2:50 pm, Tahir Akram tahirakra...@gmail.com wrote: I want to ask, by using GAE/J can I take a screenshot of a web page? If it's supported, which API I should use for it. Thanks. -- You received this message because you are subscribed to the Google Groups Google

[appengine-java] Re: Failed to initialize App Engine SDK at ... appengine-java-sdk-1.6.0

2012-01-05 Thread Bat
Is there someone interested by that big problem? On 31 déc 2011, 22:36, J jem...@gmail.com wrote: One more thing, I am running Eclipse 3.7 as well as 3.6. HTH -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this

[appengine-java] My Project: Forum Hosting

2012-01-05 Thread objectuser
My project is a forum hosting service. I have it up in demo mode at: http://support.fuzedtest.appspot.com/ The demo is limited by the free quota, but you can still create and manage your own forum, register for a forum, etc. This won't be the final location: it will be abandoned once the

Re: [appengine-java] My Project: Forum Hosting

2012-01-05 Thread Matthew Jaggard
I've already done the JDO to Objectify, using Guice and am planning on using HRD. So, why do you use Shiro? By the way, I find the password requirements quite annoying - you have to specify an overly complicated password (more secure than my bank requires!) and you don't even tell me in advance -

Re: [appengine-java] My Project: Forum Hosting

2012-01-05 Thread Matthew Jaggard
Also, the SSL doesn't quite work correctly. When I visit a URL like this: https://support.fuzedtest.appspot.com/signin.html I get a certificate error in chrome (server's certificate does not match the URL) despite the fact that the certificate specifies *.appspot.com - not sure what's going on

Re: [appengine-java] My Project: Forum Hosting

2012-01-05 Thread objectuser
I think I'm used to strong passwords. I should probably loosen that up a bit. :) Thanks for the feedback. I used Shiro because it's pretty well documented and flexible. Spring has Spring Security, but there's no default equivalent for Guice. Also Shiro seems more comprehensive than Spring

Re: [appengine-java] Re: How to take webpage screenshot in Google App Engine?

2012-01-05 Thread Gal Dolber
This is as best as it can get http://html2canvas.hertzen.com/ On Thu, Jan 5, 2012 at 7:13 AM, Tahir Akram tahirakra...@gmail.com wrote: Any help? On Dec 30 2011, 2:50 pm, Tahir Akram tahirakra...@gmail.com wrote: I want to ask, by using GAE/J can I take a screenshot of a web page? If

[appengine-java] DataStoreFactory

2012-01-05 Thread SAS
Hi All, Is we need any additional lib to be included in the classpath to use the DataStoreFactory and KeyFactory in GAE? I am trying to use the both but it fires an exception like this java.lang.NoClassDefFoundError: com/google/appengine/api/datastore/ KeyFactory Regards, Suresh -- You

[appengine-java] DeferedTask Enquiry

2012-01-05 Thread Jim
Hi There, I am new to the GAE environment and was keen to get some project completed using this environment. I have a project which should use the Jazzy spell checker to spell check some text in addition to other actions. When I run this code locally it runs fine however, when I deploy it, it

Re: [appengine-java] Re: JDO second level cache getting in the way...

2012-01-05 Thread Péter Kovács
Thank you, Andy, for this information! I have upgraded to DataNucleus plugin 2.0.0-RC2 which solves the issue in my development environment. Can I use this version (RC2) in the GAE production environment as well? Can I use the same deployment procedure from within Eclipse as with the DataNucleus

[appengine-java] How to Limit/Slow Down Task Queue Execution

2012-01-05 Thread Casey
I've created a custom task queue that I want to execute one task every 30 seconds so that the impact on my application performance is very low. It's not time sensitive data so the slow execution has no downside. I've created my queue.xml file and defined it like so: queue-entries !--Set the

Re: [appengine-java] How to Limit/Slow Down Task Queue Execution

2012-01-05 Thread Bruno Fuster
Isn't better to use a cron task each 30 secs that checks which processes need to be executed and add them to the task queue to do it in background? On Thu, Jan 5, 2012 at 10:36 PM, Casey j.casey.one...@gmail.com wrote: I've created a custom task queue that I want to execute one task every 30

[appengine-java] Error

2012-01-05 Thread VIKASH
I am getting error as internal server error while executing program -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group,

[google-appengine] Caching datastore gets in memcache, worth it?

2012-01-05 Thread Andrin von Rechenberg
Hey there For latency reasons we cache frequently fetched datastore entities: http://code.google.com/appengine/articles/scaling/memcache.html#entity_cache *def getProfile(id):* * profile = memcache.get(id)* * if not profile:* *profile = datastore.get(id)* *memcache.put(profile)* *

Re: [google-appengine] Re: instance scheduler does not respect settings

2012-01-05 Thread Andreas
hi greg, thank you for the explaination. yes the settings are a bit confusing and its not really clear what exactly to expect when setting the instances sliders. andreas On Jan 4, 2012, at 7:52 PM, Gregory D'alesandre wrote: Hi Andreas, I know this might be a bit confusing. The setting

[google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread Richard Watson
A couple thoughts. Maybe the GAE team should borrow the idea of spot prices from Amazon. That's a great way to have lower-priority jobs that can run when there are instances available. We set the price we're willing to pay, if the spot cost drops below that, we get the resources. It creates a

Re: [google-appengine] Re: Where to start optimizing cost?

2012-01-05 Thread Andrin von Rechenberg
Actually appstats gives me pretty much what I need, now that I looked at it more carefully. If you put the Billing History side by side with the appstats RPC stats (that you can have per path) you see exactly what paths your cost comes from (except CPU time). Cheers, -Andrin On Tue, Jan 3, 2012

[google-appengine] HR Down?

2012-01-05 Thread bFlood
suddenly lots of The API call datastore_v3.Get() took too long to respond and was cancelled and The API call user.CreateLoginURL() took too long to respond and was cancelled errors anyone else? -- You received this message because you are subscribed to the Google Groups Google App Engine

[google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread sb
Google Cloud SQL looks interesting. From http://code.google.com/apis/sql/faq.html#cost We will give you at least 30 days’ advance notice before we begin billing in the future. 30 days is not enough notice to respond to changes/decisions that may be made. On Jan 5, 2:14 am, Nickolas Daskalou

[google-appengine] Re: HR Down?

2012-01-05 Thread bFlood
seems to be back up now. for the record, that was about 10-15 mins of nothing working. Python27, threadsafe=false, HR cheers brian On Jan 5, 10:31 am, bFlood bfl...@spatialdatalogic.com wrote: suddenly lots of The API call datastore_v3.Get() took too long to respond and was cancelled and The

[google-appengine] Fatal: Wrong mime-type in CSS responses

2012-01-05 Thread Mos
My site is down currently, because GAE response CSS files without mime-type: REQUEST: GET /static/css/master.css HTTP/1.1 ... User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.25) Gecko/20111212 Firefox/3.6.25 Accept: text/css,*/*;q=0.1 .. WRONG RESPONSE: HTTP/1.1 200 OK

Re: [google-appengine] Fatal: Wrong mime-type in CSS responses

2012-01-05 Thread Barry Hunter
Have you tried, specifcally specifying a mimetype? http://code.google.com/appengine/docs/python/config/appconfig.html#Static_File_Pattern_Handlers mime_type Optional. If specified, all files served by this handler will be served using the specified MIME type. On Thu, Jan 5, 2012 at 4:30 PM, Mos

[google-appengine] Re: Fatal: Wrong mime-type in CSS responses

2012-01-05 Thread Mos
Just found the issue http://code.google.com/p/googleappengine/issues/detail?id=6655 It's three days old and describes a fatal error that seems to hit more and more people. No response from Google? On Thu, Jan 5, 2012 at 5:30 PM, Mos mosa...@googlemail.com wrote: My site is down currently,

[google-appengine] Re: Caching datastore gets in memcache, worth it?

2012-01-05 Thread Jason Collins
There is still $$ difference. Memcache is (or appears to be) free, datastore reads are not. j On Jan 5, 8:01 am, Andrin von Rechenberg and...@miumeet.com wrote: Hey there For latency reasons we cache frequently fetched datastore

[google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread Petey
In this one case we had to change all of the items in the listproperty. In our most common case we might have to add and delete a couple items to the list property every once in a while. That would still cost us well over $1,000 each time. Most of the reasons for this type of data in our product

Re: [google-appengine] Erroneous billing? How to get addressed?

2012-01-05 Thread Marc Matteo
Thank you Amy, that form worked and someone from Google got back to me and clarified things. It seems a charge failed sometime in the recent past and so it was never paid. The charge however wasn't showing in the Balance column so it appeared to me as if everything was OK. When billing was

Re: [google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread Ikai Lan (Google)
Brian (apologies if that is not your name), How much of the costs are instance hours versus datastore writes? There's probably something going on here. The largest costs are to update indexes, not entities. Assuming $6500 is the cost of datastore writes alone, that breaks down to: ~$0.0004 a

Re: [google-appengine] Re: Fatal: Wrong mime-type in CSS responses

2012-01-05 Thread Ikai Lan (Google)
Mos, what browser is this? I've seen some talk of this but it's passing and we can't seem to catch it in action. I need more data so I can hunt this down - URLs when this is failing. The reports I've seen are that this happens specifically to Chrome users. -- Ikai Lan Developer Programs

Re: [google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread Iván Rodríguez
I think your problem is similar to the mine. http://groups.google.com/group/google-appengine-java/browse_thread/thread/1ace5bd8658d89d/a62d0b3f2b3c4e74#a62d0b3f2b3c4e74 Ikai, please, can explain us how many cost in terms of write ops, should us expect for updating indexed list property adding X

Re: [google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread Amy Unruh
Iván, 2012/1/6 Iván Rodríguez ivan.rd...@gmail.com I think your problem is similar to the mine. http://groups.google.com/group/google-appengine-java/browse_thread/thread/1ace5bd8658d89d/a62d0b3f2b3c4e74#a62d0b3f2b3c4e74 Ikai, please, can explain us how many cost in terms of write ops,

Re: [google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread Amy Unruh
On Fri, Jan 6, 2012 at 8:00 AM, Amy Unruh amyu+gro...@google.com wrote: Iván, 2012/1/6 Iván Rodríguez ivan.rd...@gmail.com I think your problem is similar to the mine.

Re: [google-appengine] Re: Stylesheet not being applied in Chome browser

2012-01-05 Thread Pieter Coucke
I have the problem in IE too. Also the content-type=null response and it is gone after a new deployment of exactly the same code and app version. On Wed, Jan 4, 2012 at 11:18 PM, Daniel dnl.k...@gmail.com wrote: I had these problems too. After deployment, the stylesheet was not applied in

Re: [google-appengine] Re: Caching datastore gets in memcache, worth it?

2012-01-05 Thread Andrin von Rechenberg
True, but there is also CPU overhead for the two rpcs if the Cache Hit ratio is low -A On Jan 5, 2012 6:02 PM, Jason Collins jason.a.coll...@gmail.com wrote: There is still $$ difference. Memcache is (or appears to be) free, datastore reads are not. j On Jan 5, 8:01 am, Andrin von

[google-appengine] Re: GAE 1.6 can not import module jinja2

2012-01-05 Thread Albert Woo
I did it. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/4Q2vGjVCW2EJ. To post to this group, send email to google-appengine@googlegroups.com. To

[google-appengine] Graphviz on GAE

2012-01-05 Thread Biancio
I know this theme has been discussed many times on different other forums, but I am still trying to understand how it could be possible to generate graph representations (similar to the ones produced by Graphviz) on Google App Engine. I'm using GAE with Python 2.7 and everything looks great. I

Re: [google-appengine] A fun app engine story with a moral.

2012-01-05 Thread Raja
Hi everyone, I re-open this thread because I'm getting aalmost the same issue. I'm not able to re-enable my application. It says You cannot currently re-enable this application because some owners already have too many enabled free apps Which is not true. I even created a new gmail account

RE: [google-appengine] Re: Caching datastore gets in memcache, worth it?

2012-01-05 Thread Brandon Wirtz
This shouldn't be a Topic for debate. YES. Check Instance, Check MemCache, Check DataStore. Always Every Time. Well assuming you have implemented Write to Instance, Write To Memcache, Write to Datastore I might also throw an exception in for you are operating of HTTPS. When you are in HTTP,

[google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread Corey [Firespotter]
I work with Petey on this and can help clarify some of the details. The Entities; We have a lot of entities (~14mi) each of which have a StringListProperty called geoboxes. Like so: class Place(search.SearchableModel): name = db.StringProperty() ... # Location specific

[google-appengine] Re: How to delete Error index

2012-01-05 Thread Jose Montes de Oca
Hi Jack this is the relevant FAQ page for index in error state: http://code.google.com/appengine/kb/general.html#error_indexes Please follow this steps to vacumm and rebuild your indexes: 1. Create a backup of your index.yaml specification 2. Determine the indexes in state ERROR from the

[google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread Yohan
Hi, I feel your pain. it cost me a few thousand dollars to delete my millions enities from the datastore after a migration job (ikai never replied my post though...) and im still paying since the deletion is not completed yet (spending 100-300$ a day for the past 2 weeks now!!). Not doing much

Re: [google-appengine] Server error

2012-01-05 Thread Ron Malen
Yes, something has happened to my account and I can not locate some of the functionality. I have purchased the business plan but that has not helped. For some unknown reason my app returns server errors. Ran perfectly for over 8 months, never changed a line of code. If I need to upgrade to

[google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread de Witte
What if you disable the app for maintenance, doing the following steps: - - make sure the users can't access the app. - - delete all indexes. - - redeploy a subset of your application for updating the 15 million entities. - - redeploy the full application. - -

[google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread salim
Our pricing went up by 5X! This is after the 50% discount, so it would have been 10X. I had disable bunch of stuff and we are trying to find a way to move our site away. Here is a quick graph of our pricing change: https://plus.google.com/114790424055754975707/posts/eUMhYDVf6i5 On Jan 4, 5:41 

[google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread salim
I just don't think google can do that, our price was increased by 5X! And we are stock right now and we need to re-enginer the entire site now to wove it away. I was considering seeing a lawyer regarding. Perhaps if there is enough of us we can do it all together.

[google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread Jon Stevens
For our application, we used Geohashing based on this article: http://code.google.com/apis/maps/articles/geospatial.html It is a slightly different twist on the indexes which I think would prevent you from having to re-index every time you want to change the precision.

Re: [google-appengine] Stylesheet not being applied in Chome browser

2012-01-05 Thread Jon Stevens
Ikai, this is a real bug, not some browser cache issue. Your CDN is returning Content-type: null headers, which is wrong. After posting a question to the google-appengine-java list and not getting any response, I filed a bug 3 days ago that nobody has responded to. There are 15 stars on it.

Re: [google-appengine] Re: Fatal: Wrong mime-type in CSS responses

2012-01-05 Thread Jon Stevens
http://code.google.com/p/googleappengine/issues/detail?id=6655 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/UWgqyJ6yFgoJ. To post to this group,

[google-appengine] [Python] Threadsafe or not?

2012-01-05 Thread Kaan Soral
I *think* my requests are lightweight. I have enabled threadsafe a long time ago but my QPS values for Instances are 0.1 0.3 1.4 etc Very low I also have a lot of instances like these, 10s of them ( min_idle = 1 ) Is there anyone who can confirm concurrency in Python? (I think my regular

[google-appengine] Re: vijayp on migration of partychat from GAE to EC2/GAE-hybrid; from $20/day expense to $1/day

2012-01-05 Thread Shane Elbo
I've just started to learn about GAE. Should I go for this strategy instead of full rely on GAE? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit

[google-appengine] Bulkloader / datastore quota

2012-01-05 Thread Richard Arrano
Hello, I've been uploading some data from the development to the production server. This first upload was ~450 entities with 3 indexed properties each. In one upload(batching at 10/post), I burned 60% of the free quota of writes. Is this normal? If not, any idea on what I'm doing wrong? My concern

Re: [google-appengine] Stylesheet not being applied in Chome browser

2012-01-05 Thread Ikai Lan (Google)
It's sounding that way. Any chance you guys have noticed any details about when this tends to happen? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai On Thu, Jan 5, 2012 at 5:36 PM, Jon Stevens latch...@gmail.com wrote: Ikai, this is a real bug,

Re: [google-appengine] Stylesheet not being applied in Chome browser

2012-01-05 Thread Jon Stevens
No idea. We did a push of an app, css didn't look right. It seems limited to css files for some reason. Maybe that'll be a clue for your engineers. jon On Thu, Jan 5, 2012 at 6:31 PM, Ikai Lan (Google) ika...@google.com wrote: It's sounding that way. Any chance you guys have noticed any

Re: [google-appengine] Stylesheet not being applied in Chome browser

2012-01-05 Thread Ikai Lan (Google)
Okay. That's good information. We haven't been able to reproduce this yet, but maybe we can find more information with some digging. I also wonder if it's also possible it's not limited to CSS files, it's just that a null content-type doesn't impact browser rendering of any other static asset.

Re: [google-appengine] [Python] Threadsafe or not?

2012-01-05 Thread Brian Quinlan
The Python 2.5 runtimes does not support concurrent requests. The Python 2.7 runtime (currently experimental) does. Cheers, Brian On Fri, Jan 6, 2012 at 1:06 PM, Kaan Soral kaanso...@gmail.com wrote: I think my requests are lightweight. I have enabled threadsafe a long time ago but my QPS

[google-appengine] Re: Recurring DeadlineExceededError when loading instances..

2012-01-05 Thread Brandon Thomson
Seems like we are back to normal since 6 hours ago... did anyone else see improvements? Hope it lasts! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit

[google-appengine] Re: Cost of mapreduce was $6,500 to update a ListProperty on 14.1 million entities

2012-01-05 Thread Vivek Puri
Even i have a table with 1.5TB of data. I need to truncate it but dont want to give thousands to delete data(i had paid thousands in old pricing model for another table. Not sure how much more it will cost now), while i pay hundreds for the data to be there. AppEngine team really needs to have a

Re: [google-appengine] Stylesheet not being applied in Chome browser

2012-01-05 Thread Amy Unruh
For those of you observing this problem, do you see it with Java apps? In particular, if anyone is seeing this with a python app, can you indicate that on this thread or the related issue http://code.google.com/p/googleappengine/issues/detail?id=6655 ? -Amy On Fri, Jan 6, 2012 at 1:54 PM, Ikai

RE: [google-appengine] Stylesheet not being applied in Chome browser

2012-01-05 Thread Brandon Wirtz
It effects other assets. But yes Mime Type bothers Chrome more. Especially on CSS. I believe it is an issue with Google Front end not GAE (just looking at the 'black box') We have seen this on Python, and Java, with both static and non-static assets. However unlike the behavior described in

[google-appengine] Outgoing bandwidth explosion

2012-01-05 Thread n8gray
Hi, I've got an app that I've had running for a long time now and its resource usage is highly predictable. The app consistently uses about 60-70MB outgoing bandwidth per day. But today the dashboard tells me it's used over 2GB! When I look at the bytes sent/sec graph for the last 7 days