Flink ML

Hello, I'm a cs student currently working on my Bachelor's thesis. I've used Flink to extract features out of some datasets, and I would like to use them together with another dataset of (1,0) (Node exists or doesn't) to perform a logistic regresssion. I have found that FLIP-39 has been accepted a

Re: Flink ML

Hi, It looks like FLIP-39 is only partially implemented as for now [1], so I’m not sure which features are already done. I’m including Shaoxuan Wang in this thread, maybe he will be able to better answer your question. Piotrek [1] https://issues.apache.org/jira/browse/FLINK-12470

Re: Flink ML

Currently, FLIP-39 is mainly driven by Becket and his team. I'm including him, maybe he can answer your question. Best, Jark On Wed, 17 Jun 2020 at 23:00, Piotr Nowojski wrote: > Hi, > > It looks like FLIP-39 is only partially implemented as for now [1], so I’m > not sure which features are alr

Flink ML feature

Hello Community, Can you please give me some pointers for implementing Machine Learning using Flink. I see Flink ML libraries were dropped in v1.9. It looks like ML feature in Flink going to be enhanced. What is the recommended approach for implementing production grade ML based apps using

flink-ml algorithms

Hi, I am running OnlineKmeans from flink-ml repo on a small dataset. I've noticed that I don't get consistent results, assignments to clusters, across different runs. I have set both parallelism and globalBatchSize to 1. I am doing simple fit and transform on each data point ingest

flink-ml onlinekmeans

implementation of flink-ml similar to spark's streamingKmeans? Should I expect similar results when running the same dataset through both? I am getting very different results. spark is learning much better. Does the rate of feature ingestion affect the results? Is it supposed to do `fit` on every point? Is

[SURVEY] Usage of flink-ml and [DISCUSS] Delete flink-ml

Hi Flink community, We plan to delete/deprecate the legacy flink-libraries/flink-ml package in Flink1.9, and replace it with the new flink-ml interface proposed in FLIP39 (FLINK-12470). Before we remove this package, I want to reach out to you and ask if there is any active project still uses

Re: [SURVEY] Usage of flink-ml and [DISCUSS] Delete flink-ml

continue to work by virtue of working against @Stable APIs. On 22/05/2019 12:08, Shaoxuan Wang wrote: Hi Flink community, We plan to delete/deprecate the legacy flink-libraries/flink-ml package in Flink1.9, and replace it with the new flink-ml interface proposed in FLIP39 (FLINK-12470). Before we

Re: [SURVEY] Usage of flink-ml and [DISCUSS] Delete flink-ml

Hi Chesnay, Yes, you are right. There is not any active commit planned for the legacy Flink-ml package. It does not matter delete it now or later. I will open a PR and remove it. Shaoxuan On Wed, May 22, 2019 at 7:05 PM Chesnay Schepler wrote: > I believe we can remove it regardless si

Re: [SURVEY] Usage of flink-ml and [DISCUSS] Delete flink-ml

any active commit planned for the legacy > Flink-ml package. It does not matter delete it now or later. I will open a > PR and remove it. > > Shaoxuan > > On Wed, May 22, 2019 at 7:05 PM Chesnay Schepler > wrote: > >> I believe we can remove it regardless since users

Re: [SURVEY] Usage of flink-ml and [DISCUSS] Delete flink-ml

+1 for remove it! And we also plan to delete the `flink-libraries/flink-ml-uber`, right? Best, Jincheng Rong Rong 于2019年5月24日周五 上午1:18写道： > +1 for the deletion. > > Also I think it also might be a good idea to update the roadmap for the > plan of removal/development since we&#x

Re: [SURVEY] Usage of flink-ml and [DISCUSS] Delete flink-ml

+1 for removal. Personally I'd prefer marking it as deprecated and remove the module in the next release, just to follow the established procedure. And +1 on removing the `flink-libraries/flink-ml-uber` as well. Thanks, Jiangjie (Becket) Qin On Mon, May 27, 2019 at 5:07 PM jincheng sun

Re: [SURVEY] Usage of flink-ml and [DISCUSS] Delete flink-ml

58 PM Becket Qin wrote: > +1 for removal. Personally I'd prefer marking it as deprecated and remove > the module in the next release, just to follow the established procedure. > > And +1 on removing the `flink-libraries/flink-ml-uber` as well. > > Thanks, > > Jiangjie (Becke

Re: [SURVEY] Usage of flink-ml and [DISCUSS] Delete flink-ml

gt;> the module in the next release, just to follow the established procedure. >> >> And +1 on removing the `flink-libraries/flink-ml-uber` as well. >> >> Thanks, >> >> Jiangjie (Becket) Qin >> >> On Mon, May 27, 2019 at 5:07 PM jincheng sun >&g

flink ml - k-means

hi flink community, at the time I write my master thesis in the field machine learning. My main task is to evaluated different k-means variants for large data sets (BigData). I would like test flink ml against Apache Mahout and Apache Hadoop MapReduce in areas of scalability and performance(time

Flink-ML as Dependency

ompile 'org.scala-lang:scala-library:2.10.5' compile 'org.scala-lang:scala-compiler:2.10.5' compile 'org.scalanlp:breeze_2.10:0.11.2' compile group: 'org.apache.flink', name: 'flink-clients', version: '0.9-SNAPSHOT' compile group: &#

Re: Flink ML feature

You may try Spark ML, which is a production ready library for ML stuff. regards. On Tue, Dec 10, 2019 at 1:04 PM chandu soa wrote: > Hello Community, > > Can you please give me some pointers for implementing Machine Learning > using Flink. > > I see Flink ML libraries were d

Re: Flink ML feature

ML, which is a production ready library for ML stuff. > > regards. > > On Tue, Dec 10, 2019 at 1:04 PM chandu soa wrote: > >> Hello Community, >> >> Can you please give me some pointers for implementing Machine Learning >> using Flink. >> >> I see Fli

Re: Flink ML feature

regards. >> >> On Tue, Dec 10, 2019 at 1:04 PM chandu soa wrote: >> >>> Hello Community, >>> >>> Can you please give me some pointers for implementing Machine Learning >>> using Flink. >>> >>> I see Flink ML libraries were dropp

Re: Flink ML feature

On Tue, Dec 10, 2019 at 1:04 PM chandu soa wrote: >>> >>>> Hello Community, >>>> >>>> Can you please give me some pointers for implementing Machine Learning >>>> using Flink. >>>> >>>> I see Flink ML libraries were

Re: Flink ML feature

Hi guys, it is true that we dropped Flink-ML with 1.9. The reason is that the community started working on a new ML library which you can find under flink-ml-parent [1]. This module contains the framework for building ML pipelines but not yet too many algorithms iirc. The plan is to extend this

Re: Flink ML feature

] will be based on the Table API [3], instead of depending on the dataset/datastream API. I've cc-ed @Xu Yang , who has been a major contributor to the Alink project to provide more information. -- Rong [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-39+Flink+ML+pipeline+and+ML+li

Alink and Flink ML

Hi to all, since Alink has been open sourced, is there any good reason to keep both Flink ML and Alink? >From what I understood Alink already contains the best ML implementation available for Flink..am I wrong? Maybe it could make sense to replace the current Flink ML with that of Alink..or

Random forest - Flink ML

HI , According to Tills comment <https://issues.apache.org/jira/browse/FLINK-1728?focusedCommentId=16780468&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16780468> I understand that flink-ml is going to be ditched. What will be the alternative ? Loo

Flink ML Use cases

I was looking forward to using Flink ML for my project where I think I can use SVM. I have been able to run a bath job using flink ML and trained and tested my data. Now I want to do the following:- 1. Applying the above-trained model to a stream of events from Kafka (Using Data Streams

Flink ML with DataStream

Hello - I've been successful working with Flink in Java, but have some trouble trying to leverage the ML library, specifically with KNN. >From my understanding, this is easier in Scala [1] so I've been converting my >code. One issue I've encountered is - How do I get a DataSet[Vector] from a Da

Re: flink-ml algorithms

hia...@gmail.com> wrote: > Hi, > > I am running OnlineKmeans from flink-ml repo on a small dataset. I've > noticed that I don't get consistent results, assignments to clusters, > across different runs. I have set both parallelism and globalBatchSize to 1. > I am doin

Re: flink-ml algorithms

Hi Natia, As I understand, the processing order of onlineKmeans is the same the input data. Are you running OnlineKmeans with using one data point with random initial KmeansModel? Could you use a fixed initial model following [1] and try out? [1] https://github.com/apache/flink-ml/blob

Re: flink-ml algorithms

t; Are you running OnlineKmeans with using one data point with random initial > KmeansModel? Could you use a fixed initial model following [1] and try out? > > [1] > https://github.com/apache/flink-ml/blob/239788f2b1f1f3a4e55ca112517980b598705a15/flink-ml-lib/src/test/java/org/apache/flink/ml/cl

Re: flink-ml algorithms

Hi, I have another question. Is the implementation of kmeans in flink-ml same as Spark's StreamingKmeans? Should the accuracy/results from the same dataset be comparable between the two? On Sun, Jun 5, 2022 at 8:14 PM Natia Chachkhiani < natia.chachkhia...@gmail.com> wrote: >

Re: flink ml - k-means

Yes, I expect to have one in the next few weeks (the code is actually there, but we need to port it to the Flink ML API). I suggest to follow the JIRA issue in the next weeks to check when this is done: https://issues.apache.org/jira/browse/FLINK-1731 Regards, Alexander PS. Bear in mind that we

Re: flink ml - k-means

Alexandrov" < alexander.s.alexand...@gmail.com> wrote: > Yes, I expect to have one in the next few weeks (the code is actually > there, but we need to port it to the Flink ML API). I suggest to follow the > JIRA issue in the next weeks to check when this is done: > > https://issu

Re: flink ml - k-means

Hi Alexander and Till, thanks for your informations, I look forward to the release. I'm curious how well is flink ml against mahout und spark ml. best regerds Paul 2015-04-27 9:23 GMT+02:00 Till Rohrmann : > Hi Paul, > > if you can't wait, a vanilla implementation is alread

flink ml k means relase

hi, now i want implement kmeans with flink, maybe you know a release date for flink ml kmeans? best regards paul

Re: flink ml - k-means

hi, now i want implement kmeans with flink, maybe you know a release date for flink ml kmeans? best regards paul 2015-04-27 9:36 GMT+02:00 Pa Rö : > Hi Alexander and Till, > > thanks for your informations, I look forward to the release. > I'm curious how well is flink ml a

Re: flink ml - k-means

implement kmeans with flink, > maybe you know a release date for flink ml kmeans? > > best regards > paul > > 2015-04-27 9:36 GMT+02:00 Pa Rö : > >> Hi Alexander and Till, >> >> thanks for your informations, I look forward to the release. >> I'

Re: flink ml - k-means

>> now i want implement kmeans with flink, >> maybe you know a release date for flink ml kmeans? >> >> best regards >> paul >> >> 2015-04-27 9:36 GMT+02:00 Pa Rö : >> >>> Hi Alexander and Till, >>> >>> thanks for your infor

Re: Flink-ML as Dependency

Hi Max, I think the reason is that the flink-ml pom contains as a dependency an artifact with artifactId breeze_${scala.binary.version}. The variable scala.binary.version is defined in the parent pom and not substituted when flink-ml is installed. Therefore gradle tries to find a dependency with

Re: Flink-ML as Dependency

Hi Till, Thanks for the quick help! Cheers, Max On Wed, Jun 10, 2015 at 5:50 PM, Till Rohrmann wrote: > Hi Max, > > I think the reason is that the flink-ml pom contains as a dependency an > artifact with artifactId breeze_${scala.binary.version}. The variable > scala.binary.ver

Re: Flink-ML as Dependency

Hi Max, I just tested a build using gradle (with your build.gradle file) and some flink-ml algorithms. And it was completed without the problem of the unresolved breeze dependency. I use the version 2.2.1 of Gradle. Which version are you using? Since you’re using Flink’s snapshots and have

Re: Flink-ML as Dependency

Hi Till, I use the standard one for Ubuntu 15.04, which is 1.5. That did not make any difference. Thanks and Cheers, Max On Thu, Jun 11, 2015 at 11:22 AM, Till Rohrmann wrote: > Hi Max, > > I just tested a build using gradle (with your build.gradle file) and some > flink-ml alg

Re: Flink-ML as Dependency

; Max > > On Thu, Jun 11, 2015 at 11:22 AM, Till Rohrmann > wrote: > >> Hi Max, >> >> I just tested a build using gradle (with your build.gradle file) and some >> flink-ml algorithms. And it was completed without the problem of the >> unresolved breeze dependen

Re: Flink-ML as Dependency

>> Hi Till, >> >> I use the standard one for Ubuntu 15.04, which is 1.5. >> >> That did not make any difference. >> >> Thanks and Cheers, >> Max >> >> On Thu, Jun 11, 2015 at 11:22 AM, Till Rohrmann >> wrote: >> >>> Hi Ma

Re: Alink and Flink ML

Hi Flavio, I am looping in Becket (cc'ed) who might be able to answer your question. Best, Gary On Tue, Mar 3, 2020 at 12:19 PM Flavio Pompermaier wrote: > Hi to all, > since Alink has been open sourced, is there any good reason to keep both > Flink ML and Alink? > From

Re: Alink and Flink ML

Hi, Flavio. Indeed, Becket is the best person to answer this question, but as far as I understand the idea is that Alink will be contributed back to Flink in the form of a refactored Flink ML library (sitting on top of the Table API) [1]. You can follow the progress of these efforts by tracking

Re: Alink and Flink ML

Thanks Marta for the clarification! On Mon, Mar 9, 2020 at 3:26 PM Marta Paes Moreira wrote: > Hi, Flavio. > > Indeed, Becket is the best person to answer this question, but as far as I > understand the idea is that Alink will be contributed back to Flink in the > form of a refa

Re: Random forest - Flink ML

I know there's an outgoing promising effort on improving Flink ML in the Streamline project [1] but I don't know why it's not very considered/advertised. Best, Flavio [1] https://h2020-streamline-project.eu/apache-flink/ Il Lun 11 Mar 2019, 15:40 Avi Levi ha scritto: > HI

Re: Random forest - Flink ML

2019 at 10:01 PM Flavio Pompermaier wrote: > I know there's an outgoing promising effort on improving Flink ML in the > Streamline project [1] but I don't know why it's not very > considered/advertised. > > Best, > Flavio > > [1] https://h2020-streamline-pr

Re: Random forest - Flink ML

There has been some developments at Apache SAMOA for a forest of decision trees. This is not regular Random Forest, but a form of trees that can be incrementally learned fast. If I recall correctly they also have adaptive algorithms as well. Here are some r

Re: Flink ML Use cases

If you can save the model as a PMML file you can apply it on a stream using one of the java pmml libraries. Sent from my iPhone > On May 14, 2019, at 4:44 PM, Abhishek Singh wrote: > > I was looking forward to using Flink ML for my project where I think I can > use SVM. >

Re: Flink ML Use cases

Wadkar wrote: > If you can save the model as a PMML file you can apply it on a stream > using one of the java pmml libraries. > > Sent from my iPhone > > On May 14, 2019, at 4:44 PM, Abhishek Singh wrote: > > I was looking forward to using Flink ML for my project where

Re: Flink ML Use cases

at 4:44 PM Sameer Wadkar wrote: > >> If you can save the model as a PMML file you can apply it on a stream >> using one of the java pmml libraries. >> >> Sent from my iPhone >> >> On May 14, 2019, at 4:44 PM, Abhishek Singh wrote: >> >> I was l

Re: Flink ML Use cases

Thanks again for the above resources. I went through the project and also ran the example on my system to get a grasp of the architecture. However, this project does not use Flink ML in it at all. Also, after having done enough research on Flink ML, I also found that it does not let us persist

Re: Flink ML Use cases

Hi Abhishek, Your observation is correct. Right now, the Flink ML module is in a half-baked state and is only supported in batch mode. It is not integrated with the DataStream API. FLIP-23 proposes a feature that allows to evaluated an externally trained model (stored as PMML) on a stream of data

Re: Flink ML Use cases

Thanks for the confirmation, Fabian. *Regards,* *Abhishek Kumar Singh* *Search Engine Engineer* *Mob :+91 7709735480 * *...* On Sat, May 25, 2019 at 8:55 PM Fabian Hueske wrote: > Hi Abhishek, > > Your observation is correct. Right now, the Flink ML module is in a > half-bak

Using Flink Ml with DataStream

Hi, Is there a way to use Stochastic Outlier Selection (SOS) and/or SVM using CoCoA with streaming data. Please suggest and give pointers. Regards, Adarsh ‌

Anomaly Detection with Flink-ML

Hello - I'm working on an anomaly detector for some time series monitoring data. I've setup an example project with Flink that reads from Kafka to get the monitoring data. Unfortunately, I'm not sure what to do next. The goal is to perform some clustering on the metric values that Flink is recei

Re: Flink ML with DataStream

Hi, unfortunately, it is not possible to convert a DataStream into a DataSet. Flink's DataSet and DataStream APIs are distinct APIs that cannot be used together. The FlinkML library is only available for the DataSet API. There is some ongoing work to add a machine learning library for streaming u

RE: Flink ML with DataStream

] Sent: Wednesday, July 19, 2017 2:12 PM To: Branham, Jeremy [IT] Cc: user@flink.apache.org Subject: Re: Flink ML with DataStream Hi, unfortunately, it is not possible to convert a DataStream into a DataSet. Flink's DataSet and DataStream APIs are distinct APIs that cannot be used together.

Re: Flink ML with DataStream

could produce something reusable for the community. > > > > > > *From:* Fabian Hueske [mailto:fhue...@gmail.com] > *Sent:* Wednesday, July 19, 2017 2:12 PM > *To:* Branham, Jeremy [IT] > *Cc:* user@flink.apache.org > *Subject:* Re: Flink ML with DataStream > >

Re: flink ml k means relase

Hi, the community didn't decide on a plan for releasing Flink 0.9 yet. Here, you can track the progress for the Flink ML variant of KMeans: https://issues.apache.org/jira/browse/FLINK-1731 There is also a KMeans implementation in the examples of Flink. Maybe that is sufficient for now? --R

Flink-ml multiple linear regression fit

Hey Guys need your help again, I am currently having problems with the multiple linear regression from the flink-ml on the HDFS. Locally it works fine with the 0.9-SNAPSHOT. The cluster runs with the 0.10-SNAPSHOT. The code is the following: // set linear regression with parameters: val mlr

Re: Using Flink Ml with DataStream

I don't believe this to be possible. The ML library works exclusively with the Batch API. On 30.10.2017 12:52, Adarsh Jain wrote: Hi, Is there a way to use Stochastic Outlier Selection (SOS) and/or SVM using CoCoA with streaming data. Please suggest and give pointers. Regards, Adarsh ‌

Re: Using Flink Ml with DataStream

Hi Chesnay, Thanks for the reply, do you know how to serve using the trained model? Where is the model saved? Regards, Adarsh ‌ On Wed, Nov 1, 2017 at 4:46 PM, Chesnay Schepler wrote: > I don't believe this to be possible. The ML library works exclusively with > the Batch API. > > > On 30.

Re: Anomaly Detection with Flink-ML

.n4.nabble.com/Anomaly-Detection-with-Flink-ML-tp14149p14151.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Anomaly Detection with Flink-ML

Great information! Thanks Jonas! -- Original message-- From: Jonas Gröger Date: Fri, Jul 7, 2017 4:12 PM To: user@flink.apache.org; Cc: Subject:Re: Anomaly Detection with Flink-ML Hello Jeremy, it looks like what you are looking for is map (1 in, 1 out) / flatmap (1 in, 0-n out) for

[ANNOUNCE] Apache Flink ML 2.0.0 released

The Apache Flink community is very happy to announce the release of Apache Flink ML 2.0.0. Apache Flink ML provides API and infrastructure that simplifies implementing distributed ML algorithms, and it also provides a library of off-the-shelf ML algorithms. Please check out the release blog

Examples / Documentation for Flink ML 2

Dear List, We are in the process of evaluating Flink ML version 2.0 in the context of some ML task mainly concerned with classification and clustering. While algorithms for this 2 domains are already present, although in a limited form (perhaps) in the latest release of Flink ML, we did not

[ANNOUNCE] Apache Flink ML 2.1.0 released

The Apache Flink community is excited to announce the release of Flink ML 2.1.0! This release focuses on improving Flink ML's infrastructure, such as Python SDK, memory management, and benchmark framework, to facilitate the development of performant, memory-safe, and easy-to-use algo

Re: Flink-ml multiple linear regression fit

> I am currently having problems with the multiple linear regression from > the flink-ml on the HDFS. > Locally it works fine with the 0.9-SNAPSHOT. The cluster runs with the > 0.10-SNAPSHOT. The code is the following: > > // set linear regression with parameters: > val mlr =

Re: Flink-ml multiple linear regression fit

), ... (1.0,1.0) ) val list_JoinPredictionAndOriginal = JoinPredictionAndOriginal.collect The line causes the errors (see below). Maybe I am still missing some libraries. The jar is packed now with the breeze, netlib, flink-ml, flink-core kryo and minlog libraries. Thank you for any help and your

Re: Flink-ml multiple linear regression fit

), ... (1.0,1.0) ) > val list_JoinPredictionAndOriginal = JoinPredictionAndOriginal.collect > > The line causes the errors (see below). Maybe I am still missing some > libraries. The jar is packed now with the breeze, netlib, flink-ml, > flink-core kryo and minlog libraries. > Than

Re: [ANNOUNCE] Apache Flink ML 2.0.0 released

Great job! <3 Thanks Dong and Yun for managing the release and big thanks to everyone who has contributed! Best, D. On Fri, Jan 7, 2022 at 2:27 PM Yun Gao wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink ML 2.0.0. > > > > Apache

Re: [ANNOUNCE] Apache Flink ML 2.0.0 released

D. > > On Fri, Jan 7, 2022 at 2:27 PM Yun Gao wrote: > >> The Apache Flink community is very happy to announce the release of >> Apache Flink ML 2.0.0. >> >> >> >> Apache Flink ML provides API and infrastructure that simplifies >> implementing d

Re: Examples / Documentation for Flink ML 2

I am adding a couple of people who worked on it. Hopefully, they will be able to answer you. On 17/01/2022 13:39, Bonino Dario wrote: > > Dear List, > > We are in the process of evaluating Flink ML version 2.0 in the > context of some ML task mainly concerned with classification a

Re: Examples / Documentation for Flink ML 2

Hi Bonino, Thanks for your interest! Flink ML is currently ready for experienced algorithm developers to try it out because we have setup the basic APIs and infrastructure to develop algorithms. Five algorithms (i.e. kmeans, naive bays, knn, logistic regression and one-hot encoder) has been

Re: Examples / Documentation for Flink ML 2

Hi Dong, Thank you for the reply. Since we are actually experimenting with the Flink ML libraries, If you think it's worth, we may contribute some documentation, e.g., tutorial based on what we learn while setting up our test project with Flink ML. Is it something that might be of int

Re: Examples / Documentation for Flink ML 2

Hi Bonino, Definitely, it will be great to build up the Flink ML docs together based on your experience. Thanks! Dong On Wed, Jan 19, 2022 at 4:32 PM Bonino Dario wrote: > Hi Dong, > > Thank you for the reply. Since we are actually experimenting with the > Flink ML libraries,

Re: Examples / Documentation for Flink ML 2

Hi Dong, We assembled a first, very small, Markdown document providing a jump-start description using a kMeans example. I could already share it with you to check if we are pointing in the right direction. I had a look at the Flink contribution guidelines, however the flink-ml project is

Re: Examples / Documentation for Flink ML 2

Hey Bonino, Sounds great. Since we have not set up the website for Flink ML yet, how about we create PRs for https://github.com/apache/flink-ml and put those Markdown files under flink-ml/docs? Best Regards, Dong On Sat, Jan 22, 2022 at 12:25 AM Bonino Dario wrote: > Hi Dong, > > We

Flink-ML: Sink model data in online training

Hi, I want sink the model data (coefficient from the logsitic regression model in my case) from the flink.ml.api.Model to print or file. I figure out the way to sink it in the batch training mode but face the following exception when the Estimator takes an UNBOUNDED datastream. ``` Caused by:

Re: Flink-ML: Sink model data in online training

Hi thekingofcity, Thanks for your interest! Unfortunately we don't have an example for online learning for now. We are working on an online machine learning example. Hopefully it will be added here [1] in the next three weeks. [1] https://github.com/apache/flink-ml thekingofcity 于2022年1

How to define the termination criteria for iterations in Flink ML?

what exactly is the syntax (in Java) to define the number of epochs in the code? Or any other termination criteria inside the iteration body? I’m using Flink v1.17.2, Flink ML v.2.3.0 Thanks in advance, Komal

Fwd: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

Hi, I am getting an error when adding flink-ml to the libraryDependencies on my build.sbt file: [error] (*:update) sbt.ResolveException: unresolved dependency: org.scalanlp#breeze_${scala.binary.version};0.11.2: not found My libraryDependencies is: libraryDependencies ++= Seq("org.apache.

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

din.com/pub/devan-m-s/17/373/574> On Wed, Oct 28, 2015 at 3:04 PM, Frederick Ayala wrote: > Hi, > > I am getting an error when adding flink-ml to the libraryDependencies on > my build.sbt file: > > [error] (*:update) sbt.ResolveException: unresolved dependency: > org.sc

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

uot;org.scalanlp" %% "breeze-natives" % "0.11.2", "org.scalanlp" %% "breeze-viz" % "0.11.2" ) resolvers ++= Seq("Sonatype Releases" at " https://oss.sonatype.org/content/repositories/releases/";) But it doesn't wor

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

;, "org.apache.flink" % "flink-clients" % "0.9.1" ,"org.apache.flink" % "flink-ml" % "0.9.1" exclude("org.scalanlp", "breeze_${scala.binary.version}")) libraryDependencies += "org.scalanlp" % "breeze

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

try something like: > > libraryDependencies ++= Seq("org.apache.flink" % "flink-scala" % "0.9.1", > "org.apache.flink" % "flink-clients" % "0.9.1" ,"org.apache.flink" % > "flink-ml" % "0.9.1"

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

This sounds similar to this problem: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-ML-as-Dependency-td1582.html The reason is (quoting Till, replace gradle with sbt here): the flink-ml pom contains as a dependency an artifact with artifactId > bree

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

uot;breeze-viz" % "0.11.2" ) libraryDependencies ++= Seq("org.apache.flink" % "flink-scala" % "0.9.1", "org.apache.flink" % "flink-streaming-scala" % "0.9.1", "org.apache.flink" % "flink-clients" % &quo

Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

Flinksters, Is there an example of saving a Trained Model, loading a Trained Model and then scoring one or more feature vectors using Flink ML? All of the examples I've seen have shown only sequential fit and predict. Thank you. -Gna -- *Gna Phetsarath*System Architect // AOL Plat

Re: Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

> > Is there an example of saving a Trained Model, loading a Trained Model and > then scoring one or more feature vectors using Flink ML? > > All of the examples I've seen have shown only sequential fit and predict. > > Thank you. > > -Gna > -- > > >

Re: Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

ading a Trained Model >> and then scoring one or more feature vectors using Flink ML? >> >> All of the examples I've seen have shown only sequential fit and predict. >> >> Thank you. >> >> -Gna >> -- >> >> >> *Gna Phetsarath*System

Re: Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

;> and dirty solution, it's not that hard to serialize the model into a file. >> >> 2016-03-28 17:59 GMT+02:00 Sourigna Phetsarath < >> gna.phetsar...@teamaol.com>: >> >>> Flinksters, >>> >>> Is there an example of saving a Trained

Re: Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

t supported in any >>> form and there's no custom saving format yet. If you really need a quick >>> and dirty solution, it's not that hard to serialize the model into a file. >>> >>> 2016-03-28 17:59 GMT+02:00 Sourigna Phetsarath < >>> g

Re: Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

MML is not supported in >>>> any form and there's no custom saving format yet. If you really need a >>>> quick and dirty solution, it's not that hard to serialize the model into a >>>> file. >>>> >>>> 2016-03-28 17:59 GMT+02:00 Sourign

Re: Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

;>>> Cheers, >>>> Till >>>> ​ >>>> >>>> On Tue, Mar 29, 2016 at 10:46 AM, Simone Robutti < >>>> simone.robu...@radicalbit.io> wrote: >>>> >>>>> To my knowledge there is nothing like that. PMML

Re: Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

gt; "path") >>>>> >>>>> // read the serialized model from disk >>>>> val model = env.readFile(new SerializedInputFormat[WeightVector], "path") >>>>> >>>>> // set the read model for the MLR algorithm >>>>

Re: Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

t;>> >>>>>> // write model to disk using the SerializedOutputFormat >>>>>> mlr.weightsOption.get.write(new SerializedOutputFormat[WeightVector], >>>>>> "path") >>>>>> >>>>>> // read the serialize

Re: Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

gt;>>>> some file. Upon reading this DataSet you simply have to give it to > >>>>>> your algorithm to be used as the model. The following code snippet > >>>>>> illustrates this approach: > >>>>>> > >>>>>&g

  1   2   >