Re: [ML] Machine Learning Pipeline Improvement

Dear Manu it could be a great idea! Could you please provide any examples of Apache Arrow integration for speed up ML computation in another ML frameworks, it would be very helpful! Sincerely yours Alexey Zinovyev -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: [ML] Machine Learning Pipeline Improvement

Hi, all! Could be viable to integrate Apache Arrow to improve ML computation using GPU? Out of this thread, could be viable to integrate Apache Arrow to improve Indexing computation using GPU? Regards https://rapids.ai https://arrow.apache.org

Re: [ML] Machine Learning Pipeline Improvement

The prototype of the API will look like that PipelineMdl mdl = new Pipeline () .addFeatureExtractor(featureExtractor) .addLabelExtractor(lbExtractor) .addStage(new EncoderTrainer()

Re: [ML] Machine Learning Pipeline Improvement

Sure, https://issues.apache.org/jira/browse/IGNITE-9158. Regards, Yury -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: [ML] Machine Learning Pipeline Improvement

Could you please create a ticket for this task? 2018-07-20 16:47 GMT+06:00 Yury Babak : > Alexey, > > I like this idea, this should improve usability of our ML module. > > Regards, > Yury > > > > -- > Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/ >

Re: [ML] Machine Learning Pipeline Improvement

Alexey, I like this idea, this should improve usability of our ML module. Regards, Yury -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: [ML] Machine Learning Pipeline Improvement

Yes, it make the prerocessing easy and clear for reading and understanding. In API it will looks like Model mdl = Pipeline.of(reading, featureExctracting, labelExtracting, normalizing, encoding, scaling, logisticRegression) where in .of(...) we can see the sequence of ML stages.

Re: [ML] Machine Learning Pipeline Improvement

Hi Alexey, I can't name myself an ML expert but heard that our ML component is missing some essential data preprocessing APIs. Are these pipelines part of our intention to bring in the preprocessing APIs to Ignite? -- Denis On Thu, Jul 19, 2018 at 5:29 AM Alexey Zinoviev wrote: > Hi

[ML] Machine Learning Pipeline Improvement

Hi Igniters, I suggest to add and implement by myself sequential pipeline of machine learning operations including all preprocessing stages like Pipeline object in Python library scikit-learn (look here http://scikit-learn.org/stable/modules/generated/sklearn.pipeline.Pipeline.html for the