RE: Aggregation problem.

2017-04-17 Thread Kürşat Kurt
il 13, 2017 5:07 PM To: Kürşat Kurt Cc: user@flink.apache.org Subject: Re: Aggregation problem. I failed to reproduce your error. How did you set up your project: SBT, Maven? Maybe its dependency management is referring to an old version of flink? Maybe different versions of scala are mixed? In

Index conversion

2017-04-17 Thread Kürşat Kurt
Hi; I have label index DataSet and final DataSet that i want to convert its indexes to labels. ixDS: DataSet[(Long, String)] (1,Car) (2,Sports) (3,Home) ... finalDS:DataSet[(Long, String, Double, String, Double)] (1,x,1,y,4) (2,z,3,t,5) ... If i want to convert finalDS's inde

RE: Aggregation problem.

2017-04-11 Thread Kürşat Kurt
, 2017 3:34 PM To: user@flink.apache.org Cc: Kürşat Kurt Subject: Re: Aggregation problem. maxBy() is still a member of org.apache.flink.api.scala.GroupedDataSet in the current sources - what did you upgrade flink to? Also please make sure the new version is used, or - if compiled from sources - try

RE: Aggregation problem.

2017-04-08 Thread Kürşat Kurt
Hi; I have just upgraded flink and cant use maxBy on grouped dataset. I am getting the error below. value maxBy is not a member of org.apache.flink.api.scala.GroupedDataSet From: Kürşat Kurt [mailto:kur...@kursatkurt.com] Sent: Sunday, February 19, 2017 1:28 AM To: user

RE: Aggregation problem.

2017-02-18 Thread Kürşat Kurt
having the maximum value, maxBy() should be used instead of max(). See this answer for more details : http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Wrong-and-non-consistent-behavior-of-max-tp484p488.html Best, Yassine On Feb 18, 2017 12:28, "Kürşat Kurt"

RE: Aggregation problem.

2017-02-18 Thread Kürşat Kurt
bug to me. Can you open a JIRA and maybe a small testcase to reproduce the issue? Thank you, Fabian 2017-02-18 1:06 GMT+01:00 Kürşat Kurt mailto:kur...@kursatkurt.com> >: Hi; I have a Dataset like this: (0,Auto,0.4,1,5.8317538999854194E-5) (0,Computer,0.2,1,4.8828125E-5) (0,

Aggregation problem.

2017-02-17 Thread Kürşat Kurt
Hi; I have a Dataset like this: (0,Auto,0.4,1,5.8317538999854194E-5) (0,Computer,0.2,1,4.8828125E-5) (0,Sports,0.4,2,1.7495261699956258E-4) (1,Auto,0.4,1,1.7495261699956258E-4) (1,Computer,0.2,1,4.8828125E-5) (1,Sports,0.4,1,5.8317538999854194E-5) This code; ds.groupBy(0).max(4).pr

Multiclass classification example

2016-10-18 Thread Kürşat Kurt
Hi; I am trying to learn Flink Ml lib. Where can i find detailed multiclass classification example?

SVM Multiclass classification

2016-10-13 Thread Kürşat Kurt
Hi; I am trying to classify documents. When i try to predict (same of training set) there is only 1 and -1 predictions. Accuracy is 0%. Can you help me please? val env = ExecutionEnvironment.getExecutionEnvironment val training = Seq( new LabeledVector(1.0, new SparseV

RE: Wordindex conversation.

2016-10-10 Thread Kürşat Kurt
1).equalTo(1).with(...) 3) Group by Label: DataSet> labelsWithIdx = joined.groupBy(0).reduceGroup(...) // collect all indexes in list / array Best, Fabian 2016-10-10 23:49 GMT+02:00 Kürşat Kurt mailto:kur...@kursatkurt.com> >: Hi; I have MainDataset (Label,WordList) : (0,Lis

Wordindex conversation.

2016-10-10 Thread Kürşat Kurt
Hi; I have MainDataset (Label,WordList) : (0,List(a, b, c, d, e, f, g)) (1,List(b, c, f, a, g)) ..and, wordIndex dataset(created with .zipWithIndex) : wordIndex> (0,a) wordIndex> (1,b) wordIndex> (2,c) wordIndex> (3,d) wordIndex> (4,e) wordIndex> (5,f) wordIndex> (6,g) H

SVM classification problem.

2016-09-30 Thread Kürşat Kurt
Hi; I am trying to train and predict with the same set. I expect that accuracy shuld be %100, am i wrong? If i try to predict with the same set; it is failing, also it classifies like "-1" which is not in the training set. What is wrong with this code? Code: def main(args: Array[String])