Re: Benchmark tests for the Beam RunInference API

Appreciate the super clear summary of the different benchmark experiments! This will add lots of value to potential users, especially when we integrate GPU benchmarks. Thanks Anand! Best, Andy On Thu, Aug 18, 2022 at 10:22 AM Danny McCormick via dev < dev@beam.apache.org> wrote: > I left a few c

Re: Benchmark tests for the Beam RunInference API

I left a few comments, but overall this sounds like a good plan to me - thanks for the writeup! On Tue, Aug 16, 2022 at 9:36 AM Anand Inguva via dev wrote: > Hi, > > I created a doc > [1] > which outlines the

Benchmark tests for the Beam RunInference API

Hi, I created a doc [1] which outlines the plan for the RunInference API[2] benchmark/performance tests. I would appreciate feedback on the following, - Models used for the benchmark tests. - Metrics calc