[ML] Deployment of user-defined preprocessors

2019-05-31 Thread Алексей Платонов
Hi, Igniters! Currently we don't have an ability to deploy automatically user-defined preprocessors and vectorizers. Client's code should be deployed manually to Ignite server nodes. I have an idea how to fix it. If we pass user's classloader and one of user-defined classes from fit-level to Compu

Re: [ML] Deployment of user-defined preprocessors

2019-05-31 Thread Alexey Zinoviev
It sounds great, could you please explain what are you going to change in the main Vectorizer/Preprocessor API to support it? пт, 31 мая 2019 г. в 14:20, Алексей Платонов : > Hi, Igniters! > Currently we don't have an ability to deploy automatically user-defined > preprocessors and vectorizers. C

Re: [ML] Deployment of user-defined preprocessors

2019-05-31 Thread Алексей Платонов
No, I won't change them. In context of this architecture we should pass learning environment to ComputeUtils and this concerns just DatasetBuilders and ComputeUtils APIs. APIs of Preprocessors and Trainers won't be changed. We just set DeploymentContext in fit method but it doens't require to chang

Re: [ML] Deployment of user-defined preprocessors

2019-05-31 Thread Alexey Zinoviev
I'd like this approach, can't wait to review your PR! пт, 31 мая 2019 г. в 15:33, Алексей Платонов : > No, I won't change them. > In context of this architecture we should pass learning environment to > ComputeUtils and this concerns just DatasetBuilders and ComputeUtils APIs. > APIs of Preproces

Re: [ML] Deployment of user-defined preprocessors

2019-06-03 Thread dmitrievanthony
It's an amazing idea! I faced this problem several times and it's really annoying, I'd be glad to this problem fixed. Best regards, Anton Dmitriev. -- Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

Re: [ML] Deployment of user-defined preprocessors

2019-06-05 Thread Yuriy Babak
Alexey, This is a cool change, do you create a ticket for it? If no I can create one. Best regards, Yuriy Babak пт, 31 мая 2019 г. в 14:20, Алексей Платонов : > Hi, Igniters! > Currently we don't have an ability to deploy automatically user-defined > preprocessors and vectorizers. Client's co

Re: [ML] Deployment of user-defined preprocessors

2019-09-08 Thread Алексей Платонов
Hi, Igniters! I've prepared a PR with fixes to correct peer class loading for ML-lambdas. Here it is: https://github.com/apache/ignite/pull/6853 It will be great if someone reviews my PR. Alexey, Yuriy, could you please to see this contribution. Thanks! Best regards. Alexey Platonov ср, 5 июн.

Re: [ML] Deployment of user-defined preprocessors

2019-09-08 Thread Alexey Zinoviev
Thank you for the contribution, will make a review this week вс, 8 сент. 2019 г., 10:05 Алексей Платонов : > Hi, Igniters! > I've prepared a PR with fixes to correct peer class loading for ML-lambdas. > Here it is: https://github.com/apache/ignite/pull/6853 > > It will be great if someone reviews