Re: Flink Scala performance

2015-07-16 Thread Vinh June
I ran it on local, from terminal. And it's the Word Count example so it's small -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Scala-performance-tp2065p2074.html Sent from the Apache Flink User Mailing List archive. mailing list

Re: Flink Scala performance

2015-07-16 Thread Vinh June
Hi Max, When I call 'flink run', it doesn't show any information like that -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Scala-performance-tp2065p2083.html Sent from the Apache Flink User Mailing List archive. mailing list archive

Re: Flink Scala performance

2015-07-16 Thread Vinh June
I found it in JobManager log 21:16:54,986 INFO org.apache.flink.runtime.taskmanager.TaskManager - Using 25 MB for Flink managed memory. is there a way to explicitly assign this for local ? -- View this message in context:

Re: Flink Scala performance

2015-07-16 Thread Vinh June
Here are my logs http://pastebin.com/AJwiy2D8 http://pastebin.com/K05H3Qur from client log, it seems to take ~2s, but with time flink run ..., actual time is ~18s -- View this message in context:

Re: Flink Scala performance

2015-07-16 Thread Vinh June
I just checked on web job manager, it says that runtime for flink job is 349ms, but actually it takes 18s using time command in terminal Should I care more about the latter timing ? -- View this message in context:

passing variable to filter function

2015-06-16 Thread Vinh June
Hello, How do you pass a parameter to a filter function? With Map, Join, I can use withBroadcastSet to pass to RichMapFunction or RichJoinFunction, but with filter, how can I pass it ? I would like to pass the variable to be able to use as in line 60 here http://pastebin.com/cFZVCLGZ Thanks

Re: Get 1 element of DataSet

2015-02-05 Thread Vinh June
Hi Stefan, DataSet.first(n) produces a child DataSet, while I need the element Specifically, I have a CSV with header line and I want to make the maps of each (header,value) pair for each line -- View this message in context:

Re: CSV input with unknown # of fields and Custom output format

2015-02-04 Thread Vinh June
Thanks, I just tried and it works with scala also. Small notice for anyone who mights interested is that the constructor of TypeSerializerInputFormat needs a TypeSerializer, not a TypeInformation. So this would work in Scala: [SCALA] val readback = env