On Feb 6, 2005, at 11:04 AM, Perrin Harkins wrote:
Have you ever used an inverted word index? This is what full-text
search usually is based on. Searching a million documents efficiently
should be no big deal. You also only have to do this as part of the
job of creating a new node. You don't
ben syverson wrote:
That's not how it works. The entire cache IS invalidated when a new node
is added.
What I'm saying is that you only invalidate the entire cache right now
because you have no way of telling which nodes are affected by the
change. If you had a full-text index, you could effici
On Feb 4, 2005, at 6:51 PM, Christian Hansen wrote:
1) Use a reverse proxy/cache and send proper Cache-Control and
Etag/Content-Length headers, eg:
2) Use a 307 Temporary Redirect and let thttpd serve it.
I tested this, and it works wonderfully. Thanks Christian! I'm still
trying to figure out wh
On Feb 5, 2005, at 5:38 PM, Perrin Harkins wrote:
It sounds like the problem is not so much that mod_perl is serving
cached HTML, since that is easily improved with a reverse proxy
server, but rather that your entire cache gets invalidated whenever
anyone creates a new node, and mod_perl has to
ben syverson wrote:
The way the system works now, it is live. Every time a page is
generated, it stores the most recent node ID along with the cached file.
The next time the page is viewed, it checks to see what node is the most
recent, and compares it against what was the newest when the file w
ben syverson wrote:
[...]
The problem with this is that 99% of the time, the document won't
contain any of the new node names, so mod_perl is wasting most of its
time serving up cached HTML.
I have two suggestions,
1) Use a reverse proxy/cache and send proper Cache-Control and
Etag/Content-Lengt
First of all, thanks for the suggestions, everyone! It's giving me a
lot to chew on. I now realize (sound of hand smacking forehead) that
the main problem is not the list of links and tracking users, but
rather the inline Wiki links:
On Feb 4, 2005, at 8:58 AM, Malcolm J Harwood wrote:
What are
On Friday 04 February 2005 3:13 am, ben syverson wrote:
> I'm curious how the "pros" would approach an interesting system design
> problem I'm facing. I'm building a system which keeps track of user's
> movements through a collection of information (for the sake of
> argument, a Wiki). For example
H
On 4 Feb 2005, at 08:13, ben syverson wrote:
Hello,
I'm curious how the "pros" would approach an interesting system design
problem I'm facing. I'm building a system which keeps track of user's
movements through a collection of information (for the sake of
argument, a Wiki). For example, if
