Re: Grid search with Random Forest
Thanks for the clarification. Gonna test that and give you feedbacks. Ndjido On Tue, 1 Dec 2015 at 19:29, Joseph Bradley wrote: > You can do grid search if you set the evaluator to a > MulticlassClassificationEvaluator, which expects a prediction column, not a > rawPrediction column. There's a JIRA for making > BinaryClassificationEvaluator accept prediction instead of rawPrediction. > Joseph > > On Tue, Dec 1, 2015 at 5:10 AM, Benjamin Fradet > wrote: > >> Someone correct me if I'm wrong but no there isn't one that I am aware of. >> >> Unless someone is willing to explain how to obtain the raw prediction >> column with the GBTClassifier. In this case I'd be happy to work on a PR. >> On 1 Dec 2015 8:43 a.m., "Ndjido Ardo BAR" wrote: >> >>> Hi Benjamin, >>> >>> Thanks, the documentation you sent is clear. >>> Is there any other way to perform a Grid Search with GBT? >>> >>> >>> Ndjido >>> On Tue, 1 Dec 2015 at 08:32, Benjamin Fradet >>> wrote: >>> Hi Ndjido, This is because GBTClassifier doesn't yet have a rawPredictionCol like the. RandomForestClassifier has. Cf: http://spark.apache.org/docs/latest/ml-ensembles.html#output-columns-predictions-1 On 1 Dec 2015 3:57 a.m., "Ndjido Ardo BAR" wrote: > Hi Joseph, > > Yes Random Forest support Grid Search on Spark 1.5.+ . But I'm getting > a "rawPredictionCol field does not exist exception" on Spark 1.5.2 for > Gradient Boosting Trees classifier. > > > Ardo > On Tue, 1 Dec 2015 at 01:34, Joseph Bradley > wrote: > >> It should work with 1.5+. >> >> On Thu, Nov 26, 2015 at 12:53 PM, Ndjido Ardo Bar >> wrote: >> >>> >>> Hi folks, >>> >>> Does anyone know whether the Grid Search capability is enabled since >>> the issue spark-9011 of version 1.4.0 ? I'm getting the >>> "rawPredictionCol >>> column doesn't exist" when trying to perform a grid search with Spark >>> 1.4.0. >>> >>> Cheers, >>> Ardo >>> >>> >>> >>> >>> - >>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> For additional commands, e-mail: user-h...@spark.apache.org >>> >>> >> >
Re: Grid search with Random Forest
You can do grid search if you set the evaluator to a MulticlassClassificationEvaluator, which expects a prediction column, not a rawPrediction column. There's a JIRA for making BinaryClassificationEvaluator accept prediction instead of rawPrediction. Joseph On Tue, Dec 1, 2015 at 5:10 AM, Benjamin Fradet wrote: > Someone correct me if I'm wrong but no there isn't one that I am aware of. > > Unless someone is willing to explain how to obtain the raw prediction > column with the GBTClassifier. In this case I'd be happy to work on a PR. > On 1 Dec 2015 8:43 a.m., "Ndjido Ardo BAR" wrote: > >> Hi Benjamin, >> >> Thanks, the documentation you sent is clear. >> Is there any other way to perform a Grid Search with GBT? >> >> >> Ndjido >> On Tue, 1 Dec 2015 at 08:32, Benjamin Fradet >> wrote: >> >>> Hi Ndjido, >>> >>> This is because GBTClassifier doesn't yet have a rawPredictionCol like >>> the. RandomForestClassifier has. >>> Cf: >>> http://spark.apache.org/docs/latest/ml-ensembles.html#output-columns-predictions-1 >>> On 1 Dec 2015 3:57 a.m., "Ndjido Ardo BAR" wrote: >>> Hi Joseph, Yes Random Forest support Grid Search on Spark 1.5.+ . But I'm getting a "rawPredictionCol field does not exist exception" on Spark 1.5.2 for Gradient Boosting Trees classifier. Ardo On Tue, 1 Dec 2015 at 01:34, Joseph Bradley wrote: > It should work with 1.5+. > > On Thu, Nov 26, 2015 at 12:53 PM, Ndjido Ardo Bar > wrote: > >> >> Hi folks, >> >> Does anyone know whether the Grid Search capability is enabled since >> the issue spark-9011 of version 1.4.0 ? I'm getting the "rawPredictionCol >> column doesn't exist" when trying to perform a grid search with Spark >> 1.4.0. >> >> Cheers, >> Ardo >> >> >> >> >> - >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> >> >
Re: Grid search with Random Forest
Someone correct me if I'm wrong but no there isn't one that I am aware of. Unless someone is willing to explain how to obtain the raw prediction column with the GBTClassifier. In this case I'd be happy to work on a PR. On 1 Dec 2015 8:43 a.m., "Ndjido Ardo BAR" wrote: > Hi Benjamin, > > Thanks, the documentation you sent is clear. > Is there any other way to perform a Grid Search with GBT? > > > Ndjido > On Tue, 1 Dec 2015 at 08:32, Benjamin Fradet > wrote: > >> Hi Ndjido, >> >> This is because GBTClassifier doesn't yet have a rawPredictionCol like >> the. RandomForestClassifier has. >> Cf: >> http://spark.apache.org/docs/latest/ml-ensembles.html#output-columns-predictions-1 >> On 1 Dec 2015 3:57 a.m., "Ndjido Ardo BAR" wrote: >> >>> Hi Joseph, >>> >>> Yes Random Forest support Grid Search on Spark 1.5.+ . But I'm getting a >>> "rawPredictionCol field does not exist exception" on Spark 1.5.2 for >>> Gradient Boosting Trees classifier. >>> >>> >>> Ardo >>> On Tue, 1 Dec 2015 at 01:34, Joseph Bradley >>> wrote: >>> It should work with 1.5+. On Thu, Nov 26, 2015 at 12:53 PM, Ndjido Ardo Bar wrote: > > Hi folks, > > Does anyone know whether the Grid Search capability is enabled since > the issue spark-9011 of version 1.4.0 ? I'm getting the "rawPredictionCol > column doesn't exist" when trying to perform a grid search with Spark > 1.4.0. > > Cheers, > Ardo > > > > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
Re: Grid search with Random Forest
Hi Benjamin, Thanks, the documentation you sent is clear. Is there any other way to perform a Grid Search with GBT? Ndjido On Tue, 1 Dec 2015 at 08:32, Benjamin Fradet wrote: > Hi Ndjido, > > This is because GBTClassifier doesn't yet have a rawPredictionCol like > the. RandomForestClassifier has. > Cf: > http://spark.apache.org/docs/latest/ml-ensembles.html#output-columns-predictions-1 > On 1 Dec 2015 3:57 a.m., "Ndjido Ardo BAR" wrote: > >> Hi Joseph, >> >> Yes Random Forest support Grid Search on Spark 1.5.+ . But I'm getting a >> "rawPredictionCol field does not exist exception" on Spark 1.5.2 for >> Gradient Boosting Trees classifier. >> >> >> Ardo >> On Tue, 1 Dec 2015 at 01:34, Joseph Bradley >> wrote: >> >>> It should work with 1.5+. >>> >>> On Thu, Nov 26, 2015 at 12:53 PM, Ndjido Ardo Bar >>> wrote: >>> Hi folks, Does anyone know whether the Grid Search capability is enabled since the issue spark-9011 of version 1.4.0 ? I'm getting the "rawPredictionCol column doesn't exist" when trying to perform a grid search with Spark 1.4.0. Cheers, Ardo - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org >>>
Re: Grid search with Random Forest
Hi Ndjido, This is because GBTClassifier doesn't yet have a rawPredictionCol like the. RandomForestClassifier has. Cf: http://spark.apache.org/docs/latest/ml-ensembles.html#output-columns-predictions-1 On 1 Dec 2015 3:57 a.m., "Ndjido Ardo BAR" wrote: > Hi Joseph, > > Yes Random Forest support Grid Search on Spark 1.5.+ . But I'm getting a > "rawPredictionCol field does not exist exception" on Spark 1.5.2 for > Gradient Boosting Trees classifier. > > > Ardo > On Tue, 1 Dec 2015 at 01:34, Joseph Bradley wrote: > >> It should work with 1.5+. >> >> On Thu, Nov 26, 2015 at 12:53 PM, Ndjido Ardo Bar >> wrote: >> >>> >>> Hi folks, >>> >>> Does anyone know whether the Grid Search capability is enabled since the >>> issue spark-9011 of version 1.4.0 ? I'm getting the "rawPredictionCol >>> column doesn't exist" when trying to perform a grid search with Spark 1.4.0. >>> >>> Cheers, >>> Ardo >>> >>> >>> >>> >>> - >>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> For additional commands, e-mail: user-h...@spark.apache.org >>> >>> >>
Re: Grid search with Random Forest
Hi Joseph, Yes Random Forest support Grid Search on Spark 1.5.+ . But I'm getting a "rawPredictionCol field does not exist exception" on Spark 1.5.2 for Gradient Boosting Trees classifier. Ardo On Tue, 1 Dec 2015 at 01:34, Joseph Bradley wrote: > It should work with 1.5+. > > On Thu, Nov 26, 2015 at 12:53 PM, Ndjido Ardo Bar > wrote: > >> >> Hi folks, >> >> Does anyone know whether the Grid Search capability is enabled since the >> issue spark-9011 of version 1.4.0 ? I'm getting the "rawPredictionCol >> column doesn't exist" when trying to perform a grid search with Spark 1.4.0. >> >> Cheers, >> Ardo >> >> >> >> >> - >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> >> >
Re: Grid search with Random Forest
It should work with 1.5+. On Thu, Nov 26, 2015 at 12:53 PM, Ndjido Ardo Bar wrote: > > Hi folks, > > Does anyone know whether the Grid Search capability is enabled since the > issue spark-9011 of version 1.4.0 ? I'm getting the "rawPredictionCol > column doesn't exist" when trying to perform a grid search with Spark 1.4.0. > > Cheers, > Ardo > > > > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
