JyunSheng Kao created SPARK-61503:
-------------------------------------
Summary: Add tests for invalid input shape to the
predict_batch_udf in pyspark/ml/functions.py
Key: SPARK-61503
URL: https://issues.apache.org/jira/browse/SPARK-61503
Project: Spark
Issue Type: Improvement
Components: PySpark, Tests
Affects Versions: 4.4.0
Reporter: JyunSheng Kao
Several code paths in {{python/pyspark/ml/functions.py}} (predict_batch_udf)
are not covered by tests:
1. Scalar input with misconfigured tensor_input_shape
2. Single tensor input shape
- Misconfigured tensor_input_shape, leading reshape size mismatch original
input
3. Multi-tensor input shape
- Misconfigured less tensor_input_shapes
- Mismatch the model (predict function) expect shape
- Misconfigured tensor_input_shape; leading reshape size mismatch original
input
This ticket adds tests for these paths in
{{python/pyspark/ml/tests/test_functions.py}}.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]