Re: [libav-devel] [PATCH] checkasm: Test sub-idcts for hevc

2017-04-12 Thread Martin Storsjö
On Wed, 12 Apr 2017, Martin Storsjö wrote: This allows testing and benchmarking use of the col_limit parameter in the idct implementations. --- I can't say I really understand the logic for setting the col_limit parameter based on the range on where non-zero coefficients are set, but this set

Re: [libav-devel] [PATCH] checkasm: Test sub-idcts for hevc

2017-04-12 Thread Luca Barbato
On 12/04/2017 13:53, Martin Storsjö wrote: > This allows testing and benchmarking use of the col_limit parameter > in the idct implementations. > --- > I can't say I really understand the logic for setting the col_limit > parameter based on the range on where non-zero coefficients are set, > but

[libav-devel] [PATCH] checkasm: Test sub-idcts for hevc

2017-04-12 Thread Martin Storsjö
This allows testing and benchmarking use of the col_limit parameter in the idct implementations. --- I can't say I really understand the logic for setting the col_limit parameter based on the range on where non-zero coefficients are set, but this set up at least works with the reference C version