Re: [google-appengine] tracking url access

2012-04-09 Thread Wilson MacGyver
ironically, it was one of my initial "push back" on this that makes that not doable. I had offered that we'd offer stats instead of per file, just per customerId as a beginning point. so basically we'd have 1 entity per customerId. and just +1 the counter on a per customerId. So while a customer

Re: [google-appengine] tracking url access

2012-04-09 Thread Wilson MacGyver
That's one possibility I haven't considered. Since we just need to provide the stats of the past 24 hours, it doesn't need to be very up-to-date. And in the greater scheme of things, we can probably afford to lose a few event counts. So this certainly points to saving this to memcache and uses ta

Re: [google-appengine] tracking url access

2012-04-09 Thread Jeff Schnitzer
FWIW, I don't like sharded counters for this application either. But it boils down to two questions: 1) How up-to-date do you need the count to be? 2) How accurate does the count need to be? Can you afford losing a few counts now and then? One solution is simply log access records yourself, eac

Re: [google-appengine] tracking url access

2012-04-09 Thread Barry Hunter
>> >> If worried about performance, defer the updates using the task queue. >> (so the actual increment is done by a task after the actual request >> has finished to the user) > > because the current system it's replacing, has at least 60 files access per > sec > during working hours. so that tran

Re: [google-appengine] tracking url access

2012-04-09 Thread Wilson MacGyver
On Mon, Apr 9, 2012 at 5:03 PM, Barry Hunter wrote: > On Mon, Apr 9, 2012 at 9:39 PM, Wilson MacGyver wrote: >> Hi, >> >> This is more of a design question, so I thought this would be more >> suited here instead of stackoverflow. >> >> I have a bunch of files in google storage. I want to track th

Re: [google-appengine] tracking url access

2012-04-09 Thread Barry Hunter
On Mon, Apr 9, 2012 at 9:39 PM, Wilson MacGyver wrote: > Hi, > > This is more of a design question, so I thought this would be more > suited here instead of stackoverflow. > > I have a bunch of files in google storage. I want to track the access > to those files. So one approach > I came up with i

[google-appengine] tracking url access

2012-04-09 Thread Wilson MacGyver
Hi, This is more of a design question, so I thought this would be more suited here instead of stackoverflow. I have a bunch of files in google storage. I want to track the access to those files. So one approach I came up with is, mark all files as private, gave GAE read only access. and the url p