Eric Wong wrote:
> I've unleashed the bots again and let them run rampant on the
> https://80x24.org/lore/ HTML pages. Will need to add malloc
> tracing on my own to generate reproducible results to prove it's
> worth adding to glibc malloc...
Unfortunately, mwrap w/ tracing is expensive enough
Konstantin Ryabitsev wrote:
> On Mon, Apr 01, 2024 at 01:21:45PM +, Eric Wong wrote:
> > Performance is still slow, and crawler traffic patterns tend to
> > do bad things with caches at all levels, so I've regretfully had
> > to experiment with robots.txt to mitigate performance problems.
>
>
On Mon, Apr 01, 2024 at 01:21:45PM +, Eric Wong wrote:
> Performance is still slow, and crawler traffic patterns tend to
> do bad things with caches at all levels, so I've regretfully had
> to experiment with robots.txt to mitigate performance problems.
This has been the source of grief for us
