zhengruifeng opened a new pull request, #57367:
URL: https://github.com/apache/spark/pull/57367

   ### What changes were proposed in this pull request?
   
   This patch extends the parameter-metadata accounting from #57322 to 
`DecisionTreeRegressionModel`, `RandomForestRegressionModel`, and 
`GBTRegressionModel`. Their custom `estimatedSize` implementations now include 
the existing parameter/default maps and UID in addition to learned tree state.
   
   The existing Spark Connect early-stop test limits are raised to reflect the 
classifier metadata accounting introduced by #57322.
   
   ### Why are the changes needed?
   
   Spark Connect uses a model's estimated size for ML cache accounting and 
tree-training early stopping. The tree regression models override the general 
estimate but previously omitted their parameter metadata, undercounting the 
memory charged to cached models. This keeps the regression models consistent 
with the classifier counterparts.
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes. Spark Connect reports a larger estimated size for tree regression 
models, so ML cache accounting and model-size-based early stopping include 
model parameter metadata.
   
   ### How was this patch tested?
   
   Updated the existing Connect tree-model early-stop limits to account for 
metadata. `git diff --check` passed. The relevant test suite was not run.
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   Generated-by: Codex (GPT-5)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to