Hi everyone, I've written up a design doc <https://docs.google.com/document/d/1l40rOTOEqrQAkto3r_AYq8S_L06dDgoZu-4RLKAE6bo/edit#> [1] on controlling batching in RunInference. I'd appreciate any feedback. Thanks!
Summary: Add a custom stacking function to RunInference to enable users to control how they want their data to be stacked. This addresses issues regarding data that have existing batching dimensions, or different sizes. Best, Andy [1] https://docs.google.com/document/d/1l40rOTOEqrQAkto3r_AYq8S_L06dDgoZu-4RLKAE6bo/edit#
