Writing the results of the stream onto a CSV File

Hi, I am trying to write the results of my stream into a CSV format using the following code and it has compilation issues: DataStream objectStream = windowedStream.flatMap(new WindowObjectStreamTransformer()); objectStream.writeAsText("H:\\data.csv", new TextFormatter() { pub

Regarding exception relating to FlinkKafkaConsumer09

Hi, I am using 1.2-SNAPSHOT of Apache Flink and 1.3-SNAPSHOT of flink-connector-kafka-0.9_2.11. It was executing without any errors before but it is giving the following exception at the moment: ​java.lang.NoSuchMethodError: org.apache.flink.util.PropertiesUtil.getBoolean(Ljava/util/Properties;L

Re: Applying the same operator twice on a windowed stream

ollowing FlatMapFucntion. > If that does not work, you would need to define another window. > > Best, Fabian > > > 2017-01-27 21:27 GMT+01:00 Abdul Salam Shaikh > : > >> Hi everyone, >> >> I have a window definition like this at the moment in snapshot version

Applying the same operator twice on a windowed stream

Hi everyone, I have a window definition like this at the moment in snapshot version 1.2.0: final StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime); env.setParallelism(1); Da

Re: Expected behaviour of windows

It was an exception because I had missed the clear() function within my CustomTrigger. It works as expected now. Thanks for all the help :) On Tue, Jan 24, 2017 at 12:23 AM, Abdul Salam Shaikh < abd.salam.sha...@gmail.com> wrote: > This is my definiton of the trigger for more clarity

Re: Expected behaviour of windows

> currentTimeInCycle) { lastKnownCurrentTimeInCycle = 0; return TriggerResult.FIRE_AND_PURGE; } lastKnownCurrentTimeInCycle = currentTimeInCycle; return TriggerResult.CONTINUE; } On Mon, Jan 23, 2017 at 10:02 PM, Abdul Salam Sha

Re: Expected behaviour of windows

-windows- > tp11200p11205.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. > -- Thanks & Regards, *Abdul Salam Shaikh*

Expected behaviour of windows

Hi, I needed some clarity on the behaviour of the windows for my use case. I have defined my stream as follows: env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime); * env.setParallelism(1);* DataStream live = env.addSource(new JsonTestSource()); DataStre

Re: Regarding ordering of events

t1 to t2 can be processed on a different machine from the window for "key2" in time t1 to t2. Cheers, Aljoscha On Thu, 5 Jan 2017 at 21:56 Kostas Kloudas wrote: > Hi Abdul, > > Every window is handled by a single machine, if this is what you mean by > “partition”. > >

Regarding caching the evicted elements and re-emitting them to the next window

Hi, I am using 1.2-Snapshot version of Apache Flink which provides the new enhanced Evictor functionality and using customized triggers for Global Window. I have a use case where I am evicting the unwanted event(element) for the current window before it is evaluated. However, I am looking for opti

Re: Regarding ordering of events

ow-2 (assuming that window-1 >> precedes window-2). >> >> Thanks, >> Kostas >> >> On Jan 5, 2017, at 11:57 AM, Abdul Salam Shaikh < >> abd.salam.sha...@gmail.com> wrote: >> >> Hi, >> >> I am using a JSON file as the source for th

Regarding ordering of events

Hi, I am using a JSON file as the source for the streaming (in the ascending order of the field Umlaufsekunde)which has events as follows: {"event":[{"*Umlaufsekunde*":115}]} {"event":[{"*Umlaufsekunde*":135}]} {"event":[{"*Umlaufsekunde*":135}]} {"event":[{"*Umlaufsekunde*":145}]} {"event":[{"*U

Regarding windows and custom trigger

my computation. Is there any way I can exclude the last event which fires the trigger to be a part of the next window. ​ -- Thanks & Regards, *Abdul Salam Shaikh*

Regarding dividing the streams using keyby

ger()) .apply(new WindowCrossingCalculator()); Is it possible to further create a keyed stream from this already created keyedStream using some other field for the keyBy function ? -- Thanks & Regards, *Abdul Salam Shaikh*

Re: Regarding time window based on the values received in the stream

cts/flink/flink-docs- > release-1.1/apis/streaming/windows.html > [2] http://flink.apache.org/news/2015/12/04/Introducing-windows.html > > 2016-11-18 1:04 GMT+01:00 Abdul Salam Shaikh : > >> Hi, >> >> I have a requirement for my thesis project where I need to set the time

Regarding time window based on the values received in the stream

ely new in flink so I would like to have ideas on how to proceed. -- Thanks & Regards, *Abdul Salam Shaikh*

Executing a flink program

ger.JobManager$$anonfun$org$apache$flink$runtime$jobmanager$JobManager$$submitJob$1.apply(JobManager.scala:962)... 8 more -- Thanks & Regards, *Abdul Salam Shaikh*

Processing events through web socket

I am trying to read data over a websocket from a source(For example wss:// brisbane.unipulse.com.au:443/OutboundInterfaces/outbound/statements). But at the moment the implementation of env.socketTextStream only supports plain TCP and has no support for TLS or higher level protocols​. Is there any o