[FFmpeg-devel] [PATCH 1/2] avcodec/g2meet: Check if adjusted pixel was on the stack

2019-09-09 Thread Michael Niedermayer
This basically checks if a pixel that was coded with prediction and residual could have been stored using a previous case. This avoids basically a string of 0 symbols stored in less than 50 bytes to hit a O(n²) codepath. Fixes: Timeout (too slow to wait -> immedeatly) Fixes: 8668/clusterfuzz-test

Re: [FFmpeg-devel] [PATCH 1/2] avcodec/g2meet: Check if adjusted pixel was on the stack

2019-09-09 Thread Tomas Härdin
mån 2019-09-09 klockan 22:16 +0200 skrev Michael Niedermayer: > This basically checks if a pixel that was coded with prediction > and residual could have been stored using a previous case. > This avoids basically a string of 0 symbols stored in less than > 50 bytes to hit a O(n²) codepath. > > Fix

Re: [FFmpeg-devel] [PATCH 1/2] avcodec/g2meet: Check if adjusted pixel was on the stack

2019-09-10 Thread Michael Niedermayer
On Mon, Sep 09, 2019 at 11:03:48PM +0200, Tomas Härdin wrote: > mån 2019-09-09 klockan 22:16 +0200 skrev Michael Niedermayer: > > This basically checks if a pixel that was coded with prediction > > and residual could have been stored using a previous case. > > This avoids basically a string of 0 sy