yeandy opened a new issue, #22240:
URL: https://github.com/apache/beam/issues/22240

   ### What happened?
   
   Some model inferences produce Dict[str, Tensor], but RunInference currently 
expects List[Any]. A workaround is to create a wrapper.
   
   The PredictionResult challenge is a known quirk due to the current 
design/implementation of RunInference. We have [a 
sample](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/pytorch_language_modeling.py#L49)
 that does something similar by creating a wrapper class. We should support 
both tensors and dictionary of tensors. Currently, it only works for the 
former, and that is baked into the logic. We should figure out how to natively 
support results that are a dict type.
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: sdk-py-core


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to