[google-appengine] Re: Google app engine has been down for my app for the last 5 hours

2010-11-22 Thread esilver
Sorry, I'm just very frustrated at this point. My app has been down
for the past 12 hours  I would consider myself a major App Engine
customer ($1k/mo) , so I'm quite familiar with this platform. At this
point, I'm seeing constant datastore timeouts and download errors (I
had to move major parts of my index off of app engine and retrieve
data via urlfetching of a database hosted on EC2). As I've mentioned
before on this forum, I can accept downtime, but there's no evidence
of this on the status page, and it's not clear who to contact to
resolve this issue other than file a bug that may or may not be
investigated. I'm at a loss about what to do. I just tried pushing a
new version, no luck.

On Nov 22, 2:58 am, Tim Hoffman zutes...@gmail.com wrote:
 What sort of error are you getting in your logs ?

 I have half a dozen apps running all without any issues.  You may be
 stuck in a bad patch of
 hardware or you could have a broken instance, that isn't getting
 recycled.

 I don't agree with your general statement about fitness or
 reliability. Yes appengine has its bad patches
 but 99% of the time its great.

 T

 On Nov 22, 2:26 pm, esilver ericsilverb...@gmail.com wrote:







  App engine status has reported AOK the whole time. This is ridiculous.
  This platform is grossly unreliable. This is unfit for web
  applications of any size or scale. At least be honest 
  onhttp://code.google.com/status/appengine

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Google app engine has been down for my app for the last 5 hours

2010-11-21 Thread esilver
App engine status has reported AOK the whole time. This is ridiculous.
This platform is grossly unreliable. This is unfit for web
applications of any size or scale. At least be honest on
http://code.google.com/status/appengine

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: I can see the number of instances!

2010-10-14 Thread esilver
+1 What is considered good or bad? I see a bunch of instances with an
average of 0.729 QPS (which seems really low) and an average memory
footprint of 63MB (also seems low). Maybe I've been brainwashed by the
EC2 specs, but would love some guidance on these numbers...

On Oct 14, 9:32 pm, nischalshetty nischalshett...@gmail.com wrote:
 Yayy... I can now see the number ofinstancesmy app is taking in the
 admin console. But, what do those columns mean and what should the
 optimum values be for each column?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Suggestion: Truth in uptime on GAE status page

2010-09-28 Thread esilver
App Engine Team - If you're reading this, thanks for the recent email.
I totally get that sites go up and down, and I'm glad to hear you're
working hard to improve things. My #1 request - please be more honest
on the app engine status page. Frustration is not that my app is down,
it's that my app is down and your page reports 100% uptime, all green
checks. I just need to know that *someone* out there in Google knows
about the problem and is working on it, and I don't enjoy filing bugs
about my app any more than you enjoy processing and closing them.

Thanks,
Eric

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Why doesn't App Engine Status reflect the actual uptime of GAE?

2010-09-23 Thread esilver
Righ now my app is 100% down and has been down now for about 45
minutes, http://appengine.google.com is down for me as well, and yet
this page:

http://code.google.com/status/appengine

Reports all is fine across GAE. What gives? I get that services go up
and down, but a little truth in reporting would be appreciated

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] What happens when I access key().id() in a loop - how many DB calls?

2010-09-21 Thread esilver
Simple performance question -- assuming I have already retrieved
object x, a datastore object, how many times will this code query the
database:

for i in range(0,10):
   print %d % x.key().id()


The answer is either zero (because it's already been looked up by
key), one (the first time it calls key().id()), or 10 (why I would not
know, that seems really inefficient).

Thanks!
-Eric

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Start inserting rows with max_int for key instead of 0

2010-09-19 Thread esilver
Hi folks,
I want to test that my client doesn't suffer from int overflow issues,
so I want to start inserting elements beginning at row id 4294967295,
instead of beginning at 0. I am happy to hack the app engine code
because I just need to run a simple test.

If anyone has done this, or can tell me where to look in the GAE
codebase, I'd be grateful.

Thanks!
-Eric

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Frequently see cannot connect to host when connecting to GAE over ATT 3G

2010-07-06 Thread esilver
Folks,
Lately I am seeing the message cannot connect to host when
attempting to connect to multiple sites I run atop GAE. Connections to
bigger sites (cnn.com, msnbc.com, google.com) work fine.

Do other people see this behavior? Do these larger sites have some
kind of colo deal with ATT, such that their traffic is routed while
traffic to smaller sites is dropped? My iPhone app runs on GAE and
it's frustrating when I see that message. I verified when I try to
connect over Safari I see the same cannot connect to host message.

Thanks,
-Eric

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: @Google: Can't delete two old versions of my app

2010-04-30 Thread esilver
Google? Can you please help me, or let me know you have filed a bug?

On Mar 31, 11:36 pm, esilver ericsilverb...@gmail.com wrote:
 Hi - This is the same issue as:

 http://groups.google.com/group/google-appengine/browse_thread/thread/...

 For my app, version v1-03 and v1-10 ofhusbandmaterialappare un-
 deletable - a server error occurs when I attempt to delete either one
 of them. The former is more than a month old.

 Is there any fix for this or do they have to stay around as zombie
 versions?

 Thanks,
 -Eric

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] @Google: Can't delete two old versions of my app

2010-03-31 Thread esilver
Hi - This is the same issue as:

http://groups.google.com/group/google-appengine/browse_thread/thread/b22977b26a769028/49817ecfd8a80975?lnk=gstq=server+error+occured+delete#49817ecfd8a80975


For my app, version v1-03 and v1-10 of husbandmaterialapp are un-
deletable - a server error occurs when I attempt to delete either one
of them. The former is more than a month old.

Is there any fix for this or do they have to stay around as zombie
versions?

Thanks,
-Eric

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Unable to delete an app version in app engine

2010-03-03 Thread esilver
I too am seeing this same behaviour. I have an undeletable version;
every attempt reports A server error occurred.

On Feb 18, 9:56 am, Satya mo.sa...@gmail.com wrote:
 I have 2 versions of my application. Version 1 and Version 2. This is
 a GWT application and using Datastore.

 Version 1 is the default and serving.

 When I tried to delete the Version 2, I got the below message.
 Server Error
 A server error has occurred.

 I tried to delete this version by disabling  enabling the
 application. But of no use.

 Any idea about what is stopping me from deleting this version?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Algorithm advice: Help design a twist on the digg scoring model

2009-03-09 Thread esilver

Hi folks,

I have an algorithm question for the group that I've been toying with
for awhile and really want to get some fresh thoughts on. It's kind of
a twist on the digg scoring model, so I thought it might be
interesting for a lot of people on this list.

My site is http://www.wordds.com. It's basically like Google Reader +
Digg for feature-length articles from magazines. Content is not user-
contributed; instead we crawl about a dozen popular magazine sites.

Presently the home page lists recent articles, sorted into categories
based on word count. The algorithm that scores each article to
determine the order they appear on the home page (which is the same as
the recent page) sucks. I wrote it so I can say so. I'm constantly
dissatisfied and am manually tuning it too much.

The key requirement I am trying to satisfy is heterogeneity. I don't
want clumps of articles from the same source appearing next to each
other in any given word-count bucket.

Let's focus on one word count bucket, and say we are loading data from
three magazines, A, B, and C, represented by three arrays of articles:
[A1, A2, A3], [B1, B2], [C1, C2, C3, C4, C5]. If we are loading these
articles at the same time, the proper display order should be: [A1,
B1, C1, A2, B2, C2, A3, C3, C4, C5]. Any ordering of A1, B1, and C1 is
fine, any ordering of A2, B2, C2 is fine, etc, so we could reasonably
have [B1, C1, A1, A2, C2, B2, ...], but we should never have [A1, A2,
B1, C1, ...]

As we go further out in time, this restriction gets relaxed, such that
if we load a new source D a month later, where its array of articles
is [D1, D2, D3], it would be acceptable to have [D1, D2, A1, D3, B1,
C1, ...]

What I've realized is that some magazine sources publish daily/weekly
(duh), others publish monthly (duh), and the algorithm I have in place
is causing the daily/weekly magazines to rise too fast in my recent
results. Therefore, let's say that A publishes daily, B publishes
weekly, and C publishes monthly. On day 2, A publishes the following 2
new articles: [A4, A5]. The proper 'recent articles' display order
should now be:

[A4, B1, C1, A5, B2, C2, A1, C3, ...]

There are also source-specific recent pages. Thus, if you filter just
on source A, the proper display order is:
[A4, A5, A1, A2, A3]. Again, the order of article display for articles
loaded at the same time is arbitrary, so [A5, A4, A1, ...] is
acceptable too.

Back to our 'recent articles' home page: because source B publishes
weekly, it should hold its spot as the second article in the list for
up to a week. Let's say B gets lazy and doesn't publish (writers
strike). A continues its daily schedule, so now it's OK if B starts
losing some ground: one display order could be: [A10, A11, C1, A9, B1,
C2, ]

Notice that C is still holding its positions in the display order
because he publishes monthly. Eventually C would refresh and kick out
its older articles from the top of the list. And if C didn't refresh
it would be slowly replaced by A or other sources that did.

* * *

I read the article at http://code.google.com/appengine/articles/overheard.html
that talks about voting and decay. That works great for my voting
code, but not for my recent articles code. Here is my 'recent' scoring
algorithm:

# wc_bucket is the word count bucket this article is in
# wc_bucket_ct is a per-source dictionary

created = (now - datetime.datetime(2008, 10, 1)).days

if wc_bucket not in wc_bucket_ct:
   wc_bucket_ct[wc_bucket] = 1

strata = wc_bucket_ct[wc_bucket]
wc_bucket_ct[wc_bucket] = strata + 1

rnd = ((settings.DAY_SCALE * 14) / strata) + random.random() # up to a
2-wk boost
score = (created * settings.DAY_SCALE) + rnd


You can see in this code that I'm breaking up articles into various
strata and then adding a random amount to get that heterogeneity.
DAY_SCALE is set to 2, meaning each additional day is worth 2 more
points. But, this code totally doesn't capture the daily/weekly/
monthly aspect of sources, which I think is a piece of state I will
have to manually add.

Anyhow, if anyone on this list likes these sorts of algorithmic
puzzles and is inclined to propose an elegant solution, I'm all ears.
If I haven't explained anything well enough, let me know. And who
knows, maybe this would make a good interview question for someone :-)

Cheers folks,
-Eric


--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] New GAE App: Wordds.com - magazine articles optimized for your iPhone, Kindle BlackBerry

2009-03-04 Thread esilver

Announcing wordds.com: Feature-length magazine articles optimized for
your iPhone, Kindle  BlackBerry

Wordds aggregates feature stories from more than a dozen magazine
sources. Stories are organized by word count, so you decide what to
read based on how much time you have to spend. Wordds links directly
to the printable versions of stories, so it's a single click to load
the full article. If you login with your Google account, you may save
articles for later reading. Wordds is optimized for all major mobile
smartphone platforms and doesn't require any app download or
installation.

If you ride the bus or subway, or have random downtime during the day,
Wordds is a great way to discover in-depth, original content matched
to the amount of time you have to read. Google News is for skimming
headlines, RSS readers are for short content, and blogs rarely offer
anything beyond commentary or re-posted breaking news. Wordds lets you
keep up on the magazines you always mean to read but never actually
carry.

Visit http://www.wordds.com on your iPhone, Android, Kindle,
BlackBerry, and laptop. And of course, Wordds.com is hosted on Google
App Engine.

Questions? Comments? Feedback? Please contact Eric Silverberg at
e...@wordds.com

Best,
-Eric Silverberg
Creator, Wordds.com
e...@wordds.com

--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---