Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/17324#discussion_r108157034 --- Diff: docs/ml-features.md --- @@ -1284,6 +1284,64 @@ for more details on the API. </div> + +## Imputer + +The `Imputer` transformer completes missing values in the dataset, either using the mean or the +median of the columns in which the missing value are located. The input columns should be of +`DoubleType` or `FloatType`. Currently `Imputer` does not support categorical features and possibly +creates incorrect values for a categorical feature. + +**Note** all `null` values in the input columns are treated as missing, and so are also imputed. + +**Examples** + +Suppose that we have a DataFrame with the column `a` and `b`: + +~~~ + a | b +------------|----------- + 1.0 | Double.NaN + 2.0 | Double.NaN + Double.NaN | 3.0 + 4.0 | 4.0 + 5.0 | 5.0 +~~~ + +In this example, Imputer will replace all occurrences of Double.NaN (the default for the missing value) --- End diff -- backticks around `Double.NaN`
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org