Re: remote debugging

2016-05-17 Thread Stefano Baghino
FLINK/Remote+Debugging+of+Flink+Clusters > > (it is linked from the front page > > https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home ) > > > > Greetings, > > Stephan > > > > > > On Tue, May 17, 2016 at 4:26 AM, Vijay Srinivas

Re: remote debugging

2016-05-17 Thread Stefano Baghino
gging+of+Flink+Clusters > > (it is linked from the front page > > https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home ) > > > > Greetings, > > Stephan > > > > > > On Tue, May 17, 2016 at 4:26 AM, Vijay Srinivasaraghavan <

Re: remote debugging

2016-05-17 Thread Stefano Baghino
It's there, I've left the Eclipse paragraph empty, unfortunately I have no experience with remote debugging using it. On Tue, May 17, 2016 at 12:29 PM, Stephan Ewen <se...@apache.org> wrote: > Super, thanks! > > On Tue, May 17, 2016 at 11:32 AM, Stefano Baghino < > stefano.

Re: remote debugging

2016-05-17 Thread Stefano Baghino
FLINK/Apache+Flink+Home ) > > Greetings, > Stephan > > > On Tue, May 17, 2016 at 4:26 AM, Vijay Srinivasaraghavan < > vijikar...@yahoo.com.invalid> wrote: > > > Awesome, thanks Stefano!! > > > > On Monday, May 16, 2016 9:57 AM, Stefano Baghino &l

Re: groupBy on a Dataset of Maps

2016-04-29 Thread Stefano Baghino
ot;ga_dateHour").get.toString().length()-2))) }}} > > val k=j.groupBy(_.get("ga_date")) > > But when I execute this, it throws an exception saying: > > org.apache.flink.api.common.InvalidProgramException: Return type > Option[String] of KeySelector class > org.apache.flink.ap

Re: Backporting a patch to a release branch

2016-04-27 Thread Stefano Baghino
; On Wed, Apr 27, 2016 at 3:03 PM, Stefano Baghino < > stefano.bagh...@radicalbit.io> wrote: > > > Hi Ufuk, > > > > thanks for getting back to me, I understand. > > The problem with this patch in particular is that the code would be > > slightly different be

[jira] [Created] (FLINK-3699) Allow per-job Kerberos authentication

2016-04-05 Thread Stefano Baghino (JIRA)
Stefano Baghino created FLINK-3699: -- Summary: Allow per-job Kerberos authentication Key: FLINK-3699 URL: https://issues.apache.org/jira/browse/FLINK-3699 Project: Flink Issue Type

[jira] [Created] (FLINK-3678) Make Flink logs directory configurable

2016-03-29 Thread Stefano Baghino (JIRA)
Stefano Baghino created FLINK-3678: -- Summary: Make Flink logs directory configurable Key: FLINK-3678 URL: https://issues.apache.org/jira/browse/FLINK-3678 Project: Flink Issue Type

[jira] [Created] (FLINK-3675) YARN ship folder incosistent behavior

2016-03-29 Thread Stefano Baghino (JIRA)
Stefano Baghino created FLINK-3675: -- Summary: YARN ship folder incosistent behavior Key: FLINK-3675 URL: https://issues.apache.org/jira/browse/FLINK-3675 Project: Flink Issue Type: Bug

Re: Behavior of lib directory shipping on YARN

2016-03-29 Thread Stefano Baghino
arnClient) and have been moved to a > separate class (YarnConfigKeys). > > Cheers, > Max > > > > On Wed, Mar 23, 2016 at 10:06 AM, Stefano Baghino < > stefano.bagh...@radicalbit.io> wrote: > > > Thanks for pointing out Max's work (awesome PR, btw). It act

Re: Proposal: YARN session per-job Kerberos authentication

2016-03-25 Thread Stefano Baghino
e > > contained in separate classes which can be integrated even when code > > changes. Let's just stay in sync. > > > > If you like, you could start off by opening an issue and submitting a > > short design document. > > > > Cheers, > > Max > > &g

Behavior of lib directory shipping on YARN

2016-03-22 Thread Stefano Baghino
run. Let me know what you think, thank you for your attention. -- BR, Stefano Baghino Software Engineer @ Radicalbit

[jira] [Created] (FLINK-3653) recovery.zookeeper.storageDir is not documented on the configuration page

2016-03-22 Thread Stefano Baghino (JIRA)
Stefano Baghino created FLINK-3653: -- Summary: recovery.zookeeper.storageDir is not documented on the configuration page Key: FLINK-3653 URL: https://issues.apache.org/jira/browse/FLINK-3653 Project

Re: [streaming, scala] Scala DataStream#addSink returns Java DataStreamSink

2016-03-14 Thread Stefano Baghino
t; >> any > > >>>>> APIs > > >>>>>> in the 1.x.y series of Flink. We can fix those issues with a 2.x > > >>> release. > > >>>>>> > > >>>>>> On Sun, Mar 13, 2016 at 5:27 AM, Márton Balassi < > > >>>>> balassi.mar...@gmail.com> > > >>>>>> wrote: > > >>>>>> > > >>>>>>> The JIRA issue is FLINK-3610. > > >>>>>>> > > >>>>>>> On Sat, Mar 12, 2016 at 8:39 PM, Márton Balassi < > > >>>>>> balassi.mar...@gmail.com> > > >>>>>>> wrote: > > >>>>>>> > > >>>>>>>> I have just come across a shortcoming of the streaming Scala > API: > > >> it > > >>>>>>>> completely lacks the Scala implementation of the DataStreamSink > > and > > >>>>>>>> instead the Java version is used. [1] > > >>>>>>>> > > >>>>>>>> I would regard this as a bug that needs a fix for 1.0.1. > > >>>>> Unfortunately > > >>>>>>>> this is also api-breaking. > > >>>>>>>> > > >>>>>>>> Will post it to JIRA shortly - but issues.apache.org is > > >> unresponsive > > >>>>>> for > > >>>>>>>> me currently. Wanted to raise the issue here as it might affect > > the > > >>>>>> api. > > >>>>>>>> [1] > > >>>>> https://github.com/apache/flink/blob/master/flink-streaming-scala > > >>>>>>>> > > >> /src/main/scala/org/apache/flink/streaming/api/scala/DataStream.scala > > >>>>>>>> #L928-L929 > > >>>>>>>> > > >>> > > >>> > > >> > > > > > -- BR, Stefano Baghino Software Engineer @ Radicalbit

Re: [VOTE] Release Apache Flink 1.0.0 (RC5)

2016-03-04 Thread Stefano Baghino
> I thought this problem arose because neither the flag was specified, nor > > the script run. > > > > On Fri, Mar 4, 2016 at 11:43 AM, Ufuk Celebi <u...@apache.org> wrote: > > > >> @Stefano: Yes, would be great to have a fix in the docs and pointers >

Re: [VOTE] Release Apache Flink 1.0.0 (RC5)

2016-03-04 Thread Stefano Baghino
.@apache.org> wrote: > > > @Stefano: Yes, would be great to have a fix in the docs and pointers > > on how to improve the docs for this. > > > > On Fri, Mar 4, 2016 at 11:41 AM, Stefano Baghino > > <stefano.bagh...@radicalbit.io> wrote: > > > Bui

Re: [VOTE] Release Apache Flink 1.0.0 (RC5)

2016-03-04 Thread Stefano Baghino
Build successful, thank you. On Fri, Mar 4, 2016 at 11:24 AM, Stefano Baghino < stefano.bagh...@radicalbit.io> wrote: > I'll try it immediately, thanks for the quick feedback and sorry for the > intrusion. Should I add this to the docs? The flag seem to be > -Dscala.version

Re: [VOTE] Release Apache Flink 1.0.0 (RC5)

2016-03-04 Thread Stefano Baghino
g. > > Otherwise the 2.11 specific build profiles will not get properly > activated. > > > > Can you try that again? > > > > Thanks, > > Stephan > > > > > > On Fri, Mar 4, 2016 at 11:17 AM, Stefano Baghino < > > stefano.bagh...@radica

Re: [VOTE] Release Apache Flink 1.0.0 (RC5)

2016-03-04 Thread Stefano Baghino
> > > >> > > > >> Changes since RC4: > > > >> > > > >> commit a79521fba60407ff5a800ec78fcfeee750d826d6 > > > >> Author: Robert Metzger <rmetz...@apache.org> > > > >> Date: Thu Mar 3 09:

[jira] [Created] (FLINK-3518) Stale docs for quickstart setup

2016-02-26 Thread Stefano Baghino (JIRA)
Stefano Baghino created FLINK-3518: -- Summary: Stale docs for quickstart setup Key: FLINK-3518 URL: https://issues.apache.org/jira/browse/FLINK-3518 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-3438) ExternalProcessRunner fails to detect ClassNotFound exception because of locale settings

2016-02-17 Thread Stefano Baghino (JIRA)
Stefano Baghino created FLINK-3438: -- Summary: ExternalProcessRunner fails to detect ClassNotFound exception because of locale settings Key: FLINK-3438 URL: https://issues.apache.org/jira/browse/FLINK-3438

Re: Case style anonymous functions not supported by Scala API

2016-02-09 Thread Stefano Baghino
nly thing is that it is not > complete. For example, the filter, mapPartition, coGroup and join functions > are missing. > > Cheers, > Till > ​ > > On Tue, Feb 9, 2016 at 1:18 AM, Stefano Baghino < > stefano.bagh...@radicalbit.io> wrote: > > > What do you think of something like this

Re: Case style anonymous functions not supported by Scala API

2016-02-09 Thread Stefano Baghino
org> wrote: > Not the DataSet but the JoinDataSet and the CoGroupDataSet do in the form > of an apply function. > ​ > > On Tue, Feb 9, 2016 at 11:09 AM, Stefano Baghino < > stefano.bagh...@radicalbit.io> wrote: > > > Sure, it was just a draft. I agree th

Re: Case style anonymous functions not supported by Scala API

2016-02-09 Thread Stefano Baghino
cits as well. IMHO > though this should be the default > behavior, without the need to add another import. > > On Tue, Feb 9, 2016 at 1:29 PM, Stefano Baghino < > stefano.bagh...@radicalbit.io> wrote: > > > I see, thanks for the tip! I'll work on it; meanw

Re: Case style anonymous functions not supported by Scala API

2016-02-09 Thread Stefano Baghino
plemented it always entails rewriting > the code if you change the API in a breaking manner. This can be really > annoying for users. > > Cheers, > Till > ​ > > On Tue, Feb 9, 2016 at 2:51 PM, Stefano Baghino < > stefano.bagh...@radicalbit.io> wrote: > >

Re: Tips for testing

2016-02-08 Thread Stefano Baghino
vely, change to the flink-runtime directory and run "mvn > verify" from there. > > This assumes Flink has been built and installed locally before. If > not, Maven will try to download the artifacts. > > Cheers, > Max > > On Mon, Feb 8, 2016 at 9:55 AM, Stefano

Re: Case style anonymous functions not supported by Scala API

2016-02-07 Thread Stefano Baghino
on to the DataSet. An implicit conversion from DataSet to >> DataSetExtended (which implements the mapWith, reduceWith, ...) methods >> could help there... >> >> What do you think? >> >> Greetings, >> Stephan >> >> >> On Thu, Jan 28, 2016 at

Tips for testing

2016-02-06 Thread Stefano Baghino
:]` each time to make sure I have a fresh build to test. Would this be the right path or is there a quicker way to have a fresh build and running the tests on them? Feel free to point me to any relevant documentation, if you wish. Thank you in advance for any tip. :) -- BR, Stefano Baghino Software

[jira] [Created] (FLINK-3353) CSV-related tests may fail depending on locale

2016-02-06 Thread Stefano Baghino (JIRA)
Stefano Baghino created FLINK-3353: -- Summary: CSV-related tests may fail depending on locale Key: FLINK-3353 URL: https://issues.apache.org/jira/browse/FLINK-3353 Project: Flink Issue Type

Re: Case style anonymous functions not supported by Scala API

2016-01-28 Thread Stefano Baghino
s, but add a second variant of > each function to the DataSet. An implicit conversion from DataSet to > DataSetExtended (which implements the mapWith, reduceWith, ...) methods > could help there... > > What do you think? > > Greetings, > Stephan > > > On Thu, Jan 28, 20

Case style anonymous functions not supported by Scala API

2016-01-28 Thread Stefano Baghino
s? Thank you all in advance for your feedback. -- BR, Stefano Baghino Software Engineer @ Radicalbit

[jira] [Created] (FLINK-3289) Double reference to flink-contrib

2016-01-25 Thread Stefano Baghino (JIRA)
Stefano Baghino created FLINK-3289: -- Summary: Double reference to flink-contrib Key: FLINK-3289 URL: https://issues.apache.org/jira/browse/FLINK-3289 Project: Flink Issue Type: Bug

Re: Feedback welcome: reworking the examples with ParameterTools

2016-01-22 Thread Stefano Baghino
changes to the KMeans example look good so far. About moving > > > > everything to external classes, IMHO we should do it, but I can also > > see > > > > why it is nice to have the whole example contained in one file. So > > let’s > > > > see what the

Re: Suggestions on contributions

2016-01-22 Thread Stefano Baghino
en the job is over. With that, we could persist that information. > > > On Wed, Jan 20, 2016 at 5:29 PM, Stefano Baghino < > stefano.bagh...@radicalbit.io> wrote: > > > Hi Aljoscha, > > > > thank you for your tip as well. I've started working on an issue on the &g

Feedback welcome: reworking the examples with ParameterTools

2016-01-21 Thread Stefano Baghino
ors without having to scroll through the file to reach the code you're interested in. -- BR, Stefano Baghino Software Engineer @ Radicalbit

Re: Suggestions on contributions

2016-01-20 Thread Stefano Baghino
e as part of Flink or > in some other repository. This way users can learn by studying from more > and more complex examples. > > Cheers, > Aljoscha > > On 20 Jan 2016, at 15:12, Stefano Baghino <stefano.bagh...@radicalbit.io> > wrote: > > > > Thank you very much

Suggestions on contributions

2016-01-20 Thread Stefano Baghino
Hello everyone, I’m Stefano Baghino and I’m a Software Engineer at Radicalbit ( www.radicalbit.io). Our company is working on a brand new OSS distribution focused on distributed, low-latency processing (“Fast Data”). Flink will play a pivotal role on our platform and we’re starting to work

Re: Suggestions on contributions

2016-01-20 Thread Stefano Baghino
hat > knowledge to the Flink community. > > Regards, > Robert > > > On Wed, Jan 20, 2016 at 11:55 AM, Stefano Baghino < > stefano.bagh...@radicalbit.io> wrote: > > > Hello everyone, > > > > I’m Stefano Baghino and I’m a Software Engineer at Radicalbit (

Re: Suggestions on contributions

2016-01-20 Thread Stefano Baghino
abble.com/Sink-Cassandra-td4107.html > In that thread you'll also find this repository: > > https://github.com/rzvoncek/flink/tree/2b281120f4206c4fd66bec22090e0b6d62ebb8ad/flink-staging/flink-cassandra > > > > > > On Wed, Jan 20, 2016 at 2:20 PM, Stefano Baghino < &

Re: Why does Flink copy code from Spark?

2015-12-28 Thread Stefano Baghino
generation. A few files have > attribution, but most of them do not. > > I thought Flink was more advanced. Why? > -- BR, Stefano Baghino Software Engineer @ Radicalbit