[jira] [Created] (FLINK-3092) Scala API quick start word count example is broken

2015-11-30 Thread madhukara phatak (JIRA)
madhukara phatak created FLINK-3092: --- Summary: Scala API quick start word count example is broken Key: FLINK-3092 URL: https://issues.apache.org/jira/browse/FLINK-3092 Project: Flink Issue

FOSDEM 2016 - take action by 4th of December 2015

2015-11-30 Thread Roman Shaposhnik
As most of you probably know FOSDEM 2016 (the biggest, 100% free open source developer conference) is right around the corner: https://fosdem.org/2016/ We hope to have an ASF booth and we would love to see as many ASF projects as possible present at various tracks (AKA Developer rooms): htt

RE: The null in Flink

2015-11-30 Thread Li, Chengxiang
Stephen, For the 3rd topic, you mentioned that "If the boolean expressions are monotonous (have no NOT), then the UNKNOWN value can be the same as FALSE ", as UNKNOWN means it could be TRUE as well, does it a proper way to handle it just as FALSE? Aljoscha, I agree with you, Table can only be

Re: Task Parallelism in a Cluster

2015-11-30 Thread Ufuk Celebi
> On 30 Nov 2015, at 17:47, Kashmar, Ali wrote: > Do the parallel instances of each task get distributed across the cluster or > is it possible that they all run on the same node? Yes, slots are requested from all nodes of the cluster. But keep in mind that multiple tasks (forming a local pipe

Task Parallelism in a Cluster

2015-11-30 Thread Kashmar, Ali
Hello, I’m trying to wrap my head around task parallelism in a Flink cluster. Let’s say I have a cluster of 3 nodes, each node offering 16 task slots, so in total I’d have 48 slots for processing. Do the parallel instances of each task get distributed across the cluster or is it possible that t

Re: Either not NotSerializableException and InvalidTypesException

2015-11-30 Thread Vasiliki Kalavri
Hi, thanks a lot for your answers :) @Timo: sure, I can open an issue, but I'm not sure I understand the problem to describe it properly. The with() method calls the getFlatJoinReturnTypes() with the allowMissing parameter set to false. Is this what you're referring to? What does this parameter d

Re: Either not NotSerializableException and InvalidTypesException

2015-11-30 Thread Till Rohrmann
I checked the code and the MapFunction InitializeWorkSet contains indeed two instances of type Either. Since we use Java serialization to ship the operators to the cluster, the MapFunction has to be serializable. Either you make the Either type serializable or you create these instances in the open

Re: Either not NotSerializableException and InvalidTypesException

2015-11-30 Thread Aljoscha Krettek
It seems there is an Either.Left stored somewhere in the Object. Could that be? > On 28 Nov 2015, at 20:18, Vasiliki Kalavri wrote: > > org.apache.flink.util.InstantiationUtil.serializeObject(InstantiationUtil.java:307)

[jira] [Created] (FLINK-3091) Provide ZooKeeper root path in startup scripts

2015-11-30 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3091: -- Summary: Provide ZooKeeper root path in startup scripts Key: FLINK-3091 URL: https://issues.apache.org/jira/browse/FLINK-3091 Project: Flink Issue Type: Improvem

Re: Tagging Flink classes with InterfaceAudience and InterfaceStability

2015-11-30 Thread Robert Metzger
Hi Max, classes in flink-scala are annotated as well, and its also in the list :) I considered classes in flink-core, flink-runtime, flink-scala, flink-streaming-java, flink-streaming-scala, flink-connector-kafka, flink-connector-filesystem, flink-avro and flink-hadoop-compatibility. I think ther

Re: Tagging Flink classes with InterfaceAudience and InterfaceStability

2015-11-30 Thread Maximilian Michels
Thank for your getting us started on annotating the API. The list looks good so far. I have the feeling it could even be extended a bit. Just curious, how did you choose which classes you annotate? Did you go through all the classes in flink-core, flink-java, and flink-clients Maven projects? What