Are are using backends to parallelize large batches of work for our
users. This involves adding 100's of tasks to a dedicated queue which
spreads the tasks across 5 dynamic backends. Many of these tasks do a
url fetch to external web services.
When we run this for one user it seems to work fine
On Thu, Jan 19, 2012 at 5:19 AM, Priyatham Suresh
priyat...@ariveguru.com wrote:
hi
this is priyatham suresh
i have devoloped a simple playframework-crudsiena-2.0.2-gae-1.6.0_b1
application.
it runs successfully in my local db
but when i run this in app engine it displays the following
Hi there,
I have been following Ikai's blog (which I have found to be most useful, so
thanks):
http://ikaisays.com/2010/07/09/using-the-java-mapper-framework-for-app-engine/
It seems I have set things up properly with web.xml / mapreduce.xml my
mapper class. However, there is a problem.
Oh, I also see:
Status ViewID
NameActivityStart time Time
elapsedControl
... and my task queue for mapreduce:
mapreduce http://192.168.0.56:8080/_ah/admin/taskqueue?queueName=mapreduce
5.0/s100
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To view this discussion on the web visit
I can remove the Jobs from the datastore and get rid of them that way, but
this does not explain why my Jobs get stuck in RUNNING state and it never
hits the break points in my Mapper class.
I must have set something up slightly wrong, but I can't think what. Here
is my xml:
configurations
Hi everyone, this is my first post here :)
I recently started developing GAE apps, currently following as many
tutorials as I can and implementing my own apps...
I'm having a problem with the OAuth tutorial: not with the app itself,
which works just fine, but with the Authentication Options I
Hint: You want to have this class on your classpath:
org.json.JSONObject
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To view this discussion on the web visit
Hi,
I've followed this (http://code.google.com/appengine/articles/soap.html)
and created a SOAP client for a webservice (ASP.NET). The client is used by
a G/A/E Backend. I've verified that backed+client works correctly against a
development server that (1) uses HTTP and (2) requires no
I updated the google plug-in for eclipse and now I get the following
error:
Error: Could not find or load main class
com.google.appengine.tools.development.DevAppServerMain
Since I can't load main class, I can't even compile my projects.
Please suggest me what to do.
--
You received this
This is the problem description for the same:
Description ResourcePathLocationType
The project 'Wooosbee' does not have any App Engine SDKs on its build
pathWooosbeeUnknown Google App Engine Problem
The project cannot be built until build path errors
No problem. Most the time I am talking to myself J if I put my notes in the
forum It is easy to find. But it is really helpful that people like Brian
chime in with bits of how things work in the black box behind the code.
I try to share what I can, I know I do a lot more testing than most
Never used it but sounds interesting.
How works this async feature in combination with the unreliable writes? I
often (In comparision to RDBMS) have failed writes and have to repeat them.
How does this work here? Have you already found some best practices?
--
You received this message because
I find this also strange...you have to precalculculate / estimate your
writes / s and pay for that?! 1 $ for 1GB? Wow...
But on the other side, you seem to have missed the part where they claim
this thing would be nearly as fast as our memcache here. We will see, but:
We GAE users are at the
I've started an app migration 3 days ago and it's still running. Yesterday it
seemed to be making progress, the status of the copy phase changed from
'copying' to 99.00% (approximately 0:30:00 remaining). The approximate time
slowly increasing during the day and is now at 0:43:19.
I'm
My understanding is that with HRD you won’t have failed writes. Or no more
so than you would have otherwise. And if you like the last line of your
code can be the check to see if the Write completed.
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf
At the risk of someone tracking down my comments and using them against me…
I talked to them the other day… They don’t get it.
My product has a version that runs on AWS and we tested it with Dynamo, it
isn’t as fast as memcache. It’s not as fast as DataStore. They claimed they
would be tuning
How would you check to see if the write was completed, with async there is
no guarantee when the write actually takes place?
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
Hi
We noticed a few days ago that starting from the middle-end of the
day, a new quota line now appears in one of our app dashboard:
Log Records Received - 95% - 946,267 of 1,000,000
This line is not there in other apps or at the beginning of the day.
So it must appear only because we are
http://code.google.com/appengine/docs/python/datastore/functions.html
Get Result will let you know if your Put has finished. That way you can do
other things while the put happens. (or you can do what I do, and assume
HRD won't fail.
From: google-appengine@googlegroups.com
You always seem to be in a special GAE wonderland zone ;)
All operations can fail and...HDR or not...they fail sometimes. If a RDBMS
would fail as often as HDR on writes I would throw it away.
So my first question for such fire-and-forget async methods is: How do I
handle errors: even in RDBMS
I should re-phrase. What do you do if HRD fails now?The best you can do
is log an error and hope for the best. Async doesn’t have to be fire and
forget, it can be fire and check back as the last line of your code.
You can actually use this as a way to make your apps more reliable. The
On Thu, Jan 19, 2012 at 5:13 AM, André Pankraz
andrepank...@googlemail.com wrote:
So my first question for such fire-and-forget async methods is: How do I
handle errors: even in RDBMS environment.
Keep in mind that async operations are not really fire and forget.
They're fire and forget until
I've released NDB 0.9.6. If all goes well this release will also be
included in the 1.6.2 App Engine SDK.
Download it at
http://code.google.com/p/appengine-ndb-experiment/downloads/detail?name=appengine-ndb-experiment-0.9.6.zip
Release notes:
- Issue 141: Speed up fetch(), especially for
On Thu, Jan 19, 2012 at 05:13, Brandon Wirtz drak...@digerat.com wrote:
http://code.google.com/appengine/docs/python/datastore/functions.html
Get Result will let you know if your Put has finished. That way you can do
other things while the put happens. (or you can do what I do, and assume
As much as I hate to admit it, I had the same feelings as you when I
read the DynamoDB announcement yesterday. ;)
Their pricing is a confusing and means I have to estimate the capacity
I will need, which sucks. Most of the apps I deal with have pretty
distinct wave-like traffic patterns, the
I'd also like to see every quota and limit documented, ideally in one
easy to reference spot.
http://code.google.com/p/googleappengine/issues/detail?id=5677
Also, to go along with that, having a list of quotas your apps hit
logged in some persistent way:
Hi Daniel,
Do you use tasks? In the past I've seen some pretty strange
patterns similar to what you posted that resulted from bursts of
tasks. I've not seen those in several months though.
Robert
On Wed, Jan 18, 2012 at 23:44, Daniel danielkra...@gmail.com wrote:
For a little more then
Any suggestion to resolve this error ?
On Thu, Jan 19, 2012 at 1:16 AM, Deepak Singh deepaksingh...@gmail.comwrote:
aapengine-web.xml
?xml version=1.0 encoding=utf-8?
appengine-web-app xmlns=http://appengine.google.com/ns/1.0;
applicationyatrafinderdevenv/application
version1/version
Hi,
I've seen this with two different type of queries, both are limited to
1000 entities returned. I've not yet profiled with Appstats.
I will update this issue when i've profiled them.
On Jan 18, 8:47 pm, Brian Quinlan bquin...@google.com wrote:
Hi Sergio,
On Thu, Jan 19, 2012 at 4:46 AM,
If you were starting a new app today, would you use java or python?
Why?
Will python ever be as efficient in multi threading as java?
Will Larry Ellison keep java free?
Python is a beautiful language, but may be too expensive to run in
GAE.
--
You received this message because you are
On Jan 19, 2012, at 3:25 PM, GAEfan wrote:
If you were starting a new app today, would you use java or python?
python
Why?
Far more efficient development cycle.
Will python ever be as efficient in multi threading as java?
Certainly in the ways that matter for the kinds of apps you write for
we use java via gaelyk framework.
though we've explored with go a bit too.
Not sure what Larry Ellison has to do with all this, JDK 1.6 is GPL. Not like
GAE is going to be upgrading to JDK7 anytime soon anyway.
As for why we use java. we like groovy, we like gaelyk. We found it works
well
Oracle already succeeded in tempting lots of people to look away from Java
as a language! Hopefully, the JVM is still a great runtime environment with
the best opensource professional projects.
Against that, Mr Ellison can't do much ;)
Give a try to Play framework + Java or Scala on JVM...
On
Hi,
In January, I began to notice short periods (about an hour or so) of
increased latency.
New instances take about a minute to load. The pages only load simple
django patterns. No database operations. Normally, new instances take about
4 seconds to load. So the minute load time looks
I am fetching one record's key like this.
The result I got in 'profile' is a list containing
one entity. I was expecting the result the be an entity,
not a one item list.
===
key = google_db.GqlQuery('SELECT __key__ FROM
Robert wrote:
However, I still hope that this will give Google incentive to
innovate
and be competitive.
Certainly am pulling for Dynamo to bring some competitive pressure
(but very happy any port seems a long ways off). Not yet there, but
fingers crossed -- come on Jeff apply that giant alien
fetch() returns a list with entities, get() returns the first entity found by
the query.
On Jan 19, 2012, at 4:40 PM, thstart wrote:
I am fetching one record's key like this.
The result I got in 'profile' is a list containing
one entity. I was expecting the result the be an entity,
not a
Our app exists as both a Java Version and a Python version. We ended up
deploying the Python version because (despite what everyone says should be
the case) Python has been faster for us (except for a brief period when java
offered concurrency and Python didn't).
We chalked this up to the
Thank you!
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/AtoigXjY1DEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To
GAE needs a dedicated Tech Evangelist to write best practices, and to
generate clear examples of how code should be used. But also to show X vs Y
performance numbers.
You can't easily peer in to GAE's pricing. And a lot of people blame the
Expense on Google when they need to look at their own
Hi to all,
First, I'm french, so please apologize for my english mistakes...
I'm working with Google app Engine and channel api since few weeks
now, and I get some troubles when a client disconnect once the token
is expired (so, about 2 hours)
Once expired, trying to delete and replace the old
Hey!
Those instances have exhausted my free quota. Now every request spins up a
new instance and every request takes ~10 minutes (according the logs)
2012-01-19 14:32:10.764 /request 200 *602229*ms 3kb Mozilla/4.0
(compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; )
2012-01-19
I cannot find this particular file in my home directory either.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/wsDiVvrew2AJ.
To post to this group,
Hi,
I would like to do is to authenticate into Google Accounts using a
Username and Password.
Basically,
[Authenticate User Context - Log in Pro grammatically into Google
Accounts inside a Java Servlet]
UserService userService = UserServiceFactory.getUserService();
Thanks, guys. Good to know. I have used Python exclusively so far,
but have been getting random 500 DeadlineExceeded Errors lately, since
going to 2.7 and threadsafe. I thought perhaps Java with its inherent
multi-threading would be faster.
I am happy to use Python for our next app.
And
I'm probably too expensive, and interviews with Google always devolve down
to when are you going to get a degree? But I appreciate the vote of
confidence. ;-)
-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of GAEfan
Sent:
Alexis,
It looks that GEA has hidden balancing/lack of resources problems or
deadlocks both results in RANDOM problems.
I think about moving to HRD but it looks that you suffer same on HRD
the last days so it will not help till GEA will not generate RANDOM
problems - I do some optimization it
They claim you can do 250,000 writes per second
On Jan 18, 1:57 pm, Brandon Wirtz drak...@digerat.com wrote:
Google should pay me to do a parody of
thishttp://www.youtube.com/watch?feature=player_embedded
http://www.youtube.com/watch?feature=player_embeddedv=oz-7wJJ9HZ0#!
v=oz-7wJJ9HZ0#!
I
Yeah? So?
Have I Not shared when Google bot crawls me at 100k per hour? I hit 1/4 that
during those spikes. I could do some load testing if someone wants to foot
the bill, but I'll bet money I can push GAE to 1M easily.
-Original Message-
From: google-appengine@googlegroups.com
On Jan 19, 8:37 am, hugues2 hugues.flam...@gmail.com wrote:
- The application should be able to serve +/- 1,000 companies. Each company
having +/- 10 registered users. The system should be abe to support +/- 3
transactions / second.
- The data from one company should not be visible for the
I am going to start doing a Video series for first time programmers on
writing in AppEngine with Python.
I am going to recommend the Portable version of GAE with Python 2.5 this
has some limitations but is easy to get started with.
Does anyone have anything they specifically think people
that is 250K per second, not per hour
On Jan 19, 6:44 pm, Brandon Wirtz drak...@digerat.com wrote:
Yeah? So?
Have I Not shared when Google bot crawls me at 100k per hour? I hit 1/4 that
during those spikes. I could do some load testing if someone wants to foot
the bill, but I'll bet money I
Aware. During big bursts we are handling 36 writes per crawled page, and
doing at times 1500 RPS
-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Andrei
Sent: Thursday, January 19, 2012 5:29 PM
To: Google App Engine
i wonder why i could not get more than 1500 writes per second
On Jan 19, 7:35 pm, Brandon Wirtz drak...@digerat.com wrote:
Aware. During big bursts we are handling 36 writes per crawled page, and
doing at times 1500 RPS
-Original Message-
From: google-appengine@googlegroups.com
Was it very nearly exactly that number? You aren't supposed to have to ask,
but sometimes you have to get the guys to take the training wheels off.
Or it may be the way your code is written, or the number of instances you
had active. What was the error you got when you pushed harder?
One of
Greg, thanks for answering. Pretty much every answer has been nailed.
In general, Google doesn't provide consulting services, but there are
people in this group such as Greg and Brandon who have been longtime
community members and are more than happy to offer consulting services.
What Google does
You just enjoy watching gladiator combat, eh?
Perhaps this should be phrased as JVM vs Python runtime, because
there are other languages you can run on the JVM besides Java
(including Python, oddly enough).
I write most of my serious apps in Java because I think statically
typed languages are
Static typing is over-rated. 1+1 doesn't always have to equal 2, sometimes
11 is a great answer, so is January 1 st, 1969 at 2 milliseconds past
Midnight.
And sometimes I want to Add A and B as the sum of their Unicode characters.
-Brandon
PS
My typing is often confused for static, because when
Nice.
Thread safety and the cost of indexing is the most important thing I
believe.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send
Note that it is a hidden (dot) file.
On Thu, Jan 19, 2012 at 18:03, Subhash Pant subhash.p...@gmail.com wrote:
I cannot find this particular file in my home directory either.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view
Hi Deepak,
You might try changing the version number. I know, with Python,
I've had version numbers get screwed up and needed to change it before
the deploy would go through.
Robert
On Thu, Jan 19, 2012 at 13:51, Deepak Singh deepaksingh...@gmail.com wrote:
Any suggestion to resolve
Hi,
Are you using the master slave or high replication datastore? This
type of issue was (is?) quite common when using the master slave
datastore.
Also, you note that pages typically take 1-4 seconds to load? That
seems very slow. Is that typical of all your pages? Have you used
appstats
Hi Jerry,
Are you trying to access data within your application's datastore,
or are you trying to access a user's data from other Google services
(such as Google Docs)?
If you're trying to access data within your app, why don't you just
get the user object from the datastore or something
On Thu, Jan 19, 2012 at 15:25, GAEfan ken...@gmail.com wrote:
If you were starting a new app today, would you use java or python?
Python
Why?
It is faster to develop in, and the terse syntax is very nice (once
you're accustomed to it).
Will python ever be as efficient in multi threading as
On Wed, Jan 18, 2012 at 14:37, hugues2 hugues.flam...@gmail.com wrote:
Hi,
Before investing financial resources to develop a mission critical
application on Google App Engine, I would be very interested to have your
view on the following :
I. Application requirements
- The application
I'd like to guarantee a transaction runs once, and once only. Let's
say I'm simulating a bank transfer of $5 from AccountA to AccountB.
The normal transaction is not idempotent:
Repeat until success {
* start txn
* debit $5 from AccountA
* credit $5 to AccountB
* commit txn
}
If this
Hey Jeff,
That is more-or-less the best I've come up with as well. My flow looks like:
1) produce a transaction marker entity with a deterministic key-name
from the involved accounts,
2) Start transaction:
2.a) Load the involved entities (including the marker).
2.b) If I get a
Have you recently installed JDK 7 at all? It looks like something is
either trying or has compiled one of your JSPs/classes in JDK 7.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
69 matches
Mail list logo
