Hi DB Tsai, Thank you very much for your interest and comment.
1) feature sub-sample is per-node, like random forest. 2) The current code heavily exploits the tree structure to speed up the learning (such as processing multiple learning node in one pass of the training data). So a generic GBM is likely to be a different codebase. Do you have any nice reference of efficient GBM? I am more than happy to look into that. 3) The algorithm accept training data as a DataFrame with the featureCol indexed by VectorIndexer. You can specify which variable is categorical in the VectorIndexer. Please note that currently all categorical variables are treated as ordered. If you want some categorical variables as unordered, you can pass the data through OneHotEncoder before the VectorIndexer. I do have a plan to handle unordered categorical variable using the approach in RF in Spark ML (Please see roadmap in the README.md) Thanks, Meihua On Mon, Oct 26, 2015 at 4:06 PM, DB Tsai <dbt...@dbtsai.com> wrote: > Interesting. For feature sub-sampling, is it per-node or per-tree? Do > you think you can implement generic GBM and have it merged as part of > Spark codebase? > > Sincerely, > > DB Tsai > ---------------------------------------------------------- > Web: https://www.dbtsai.com > PGP Key ID: 0xAF08DF8D > > > On Mon, Oct 26, 2015 at 11:42 AM, Meihua Wu > <rotationsymmetr...@gmail.com> wrote: >> Hi Spark User/Dev, >> >> Inspired by the success of XGBoost, I have created a Spark package for >> gradient boosting tree with 2nd order approximation of arbitrary >> user-defined loss functions. >> >> https://github.com/rotationsymmetry/SparkXGBoost >> >> Currently linear (normal) regression, binary classification, Poisson >> regression are supported. You can extend with other loss function as >> well. >> >> L1, L2, bagging, feature sub-sampling are also employed to avoid overfitting. >> >> Thank you for testing. I am looking forward to your comments and >> suggestions. Bugs or improvements can be reported through GitHub. >> >> Many thanks! >> >> Meihua >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
