Ruifeng Zheng created SPARK-58633:
-------------------------------------
Summary: Use integer label indexes in StringIndexerModel
Key: SPARK-58633
URL: https://issues.apache.org/jira/browse/SPARK-58633
Project: Spark
Issue Type: Sub-task
Components: ML
Affects Versions: 5.0.0
Reporter: Ruifeng Zheng
StringIndexerModel currently stores label indexes as Double values in an
OpenHashMap. Store them as Int values instead to reduce the model closure
memory footprint, and cast indexed values to Double only when producing the
output column.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
