> -----Original Message----- > From: Srikanth Yalavarthi <[email protected]> > Sent: Tuesday, February 7, 2023 9:20 PM > To: Srikanth Yalavarthi <[email protected]> > Cc: [email protected]; Shivah Shankar Shankar Narayan Rao > <[email protected]>; Jerin Jacob Kollanukkaran > <[email protected]>; Anup Prabhu <[email protected]>; Prince Takkar > <[email protected]>; Parijat Shukla <[email protected]> > Subject: [PATCH v4 06/12] app/mldev: add test case to interleave inferences > > Added test case to interleave inference requests from multiple models. > Interleaving would load and start all models and launch inference requests > for the models using available queue-pairs > > Operations sequence when testing with N models and R reps, > > (load + start) x N -> (enqueue + dequeue) x N x R ... > -> (stop + unload) x N > > Test can be executed by selecting "inference_interleave" test. > > Signed-off-by: Srikanth Yalavarthi <[email protected]> > --- > app/test-mldev/meson.build | 1 + > app/test-mldev/ml_options.c | 3 +- > app/test-mldev/test_inference_common.c | 12 +-- > app/test-mldev/test_inference_interleave.c | 118 > +++++++++++++++++++++ > 4 files changed, 127 insertions(+), 7 deletions(-) create mode 100644 > Acked-by: Anup Prabhu <[email protected]>
<<attachment: winmail.dat>>
