Flink SQL

2018-11-29 Thread Steve Bistline
Hi, I have a silly question about Flink SQL that I cannot seem to find a clear answer to. If I have the following code. Will the "result" from the sql SELECT statement only return and the data then be written to S3 if and only if the statement returns data that matches the criteria? Does

CEP Dynamic Patterns

2018-11-23 Thread Steve Bistline
Have dynamic patterns been introduced yet? Steve

Exception occurred while processing valve output watermark & NullPointerException

2018-11-20 Thread Steve Bistline
Any guidance would be most appreciated. Thx Steve === java.lang.RuntimeException: Exception occurred while processing valve output watermark: at

Kinesis Connector - NoClassDefFoundError

2018-11-19 Thread Steve Bistline
Hey all... upgrade from Flink 1.5.0 to 1.6.2 and for some reason cannot figure out what I missed in setting up the new environment. I am gettin this error: java.lang.NoClassDefFoundError: Could not initialize class org.apache.flink.kinesis.shaded.com.amazonaws.partitions.PartitionsLoader

Re: Could not find previous entry with key.

2018-11-16 Thread Steve Bistline
ink.streaming.runtime.io.StreamInputProcessor$ForwardingValveOutputHandler.handleWatermark(StreamInputProcessor.java:262) ... 7 more On Thu, Nov 15, 2018 at 8:13 AM Chesnay Schepler wrote: > Does the issue persist if you implement hashCode() in IoTEvent like this: > > @Overri

Null Pointer Exception

2018-11-16 Thread Steve Bistline
mark(InternalTimeServiceManager.java:108) at org.apache.flink.streaming.api.operators.AbstractStreamOperator.processWatermark(AbstractStreamOperator.java:734) at org.apache.flink.streaming.runtime.io.StreamInputProcessor$ForwardingValveOutputHandler.handleWatermark(StreamInputProcessor.java:262) ... 7 more Caused by: java.lang.NullPointerException Steve

Re:

2018-11-15 Thread Steve Bistline
Thread.run(ForkJoinWorkerThread.java:107) java.lang.OutOfMemoryError: Java heap space On Thu, Nov 15, 2018 at 8:23 PM Steve Bistline wrote: > > Well, hopefully the last problem with this project. > > Any thoughts would be appreciated > > = &g

[no subject]

2018-11-15 Thread Steve Bistline
Well, hopefully the last problem with this project. Any thoughts would be appreciated = java.lang.RuntimeException: Exception occurred while processing valve output watermark: at

Re: Writing to S3

2018-11-15 Thread Steve Bistline
> > Which makes me think you’re not excluding those properly. > > — Ken > > > On Nov 15, 2018, at 3:58 PM, Steve Bistline > wrote: > > I am trying to write out to S3 from Flink with the following code and > getting the error below. Tried adding the parser as a dependency

Writing to S3

2018-11-15 Thread Steve Bistline
I am trying to write out to S3 from Flink with the following code and getting the error below. Tried adding the parser as a dependency, etc. Any help would be appreciated Table result = tableEnv.sql("SELECT 'Alert ',t_sKey, t_deviceID, t_sValue FROM SENSORS WHERE t_sKey='TEMPERATURE' AND

Could not find previous entry with key.

2018-11-14 Thread Steve Bistline
Any thoughts on where to start with this error would be appreciated. Caused by: java.lang.IllegalStateException: Could not find previous entry with key: first event, value: {"DEVICE_ID":f8a395a0-d3e2-11e8-b050-9779854d8172,"TIME_STAMP":11/15/2018 02:29:30.343

Flink Question

2018-11-09 Thread Steve Bistline
I am having problems with the Flink Kinesis adapter. I have some native KCL code that works fine. I want to replace the .addSource with the CSV String data that is coming in from my KCL code. How can I do that? // Consume the data streams from AWS Kinesis stream DataStream dataStream =

FLINK Kinesis Connector Error - ProvisionedThroughputExceededException

2018-11-09 Thread Steve Bistline
I am getting this error from the Flink Kinesis Connector. I have a native KCL app running in parallel with no problems. Any help would be appreciated Thanks so much!! Steve flink-sbistl919-taskexecutor-0-CACSVML-15736.log:2018-11-09 07:46:11,579 WARN

ProvisionedThroughputExceededException

2018-11-09 Thread Steve Bistline
I am trying to use the Kinesis Connector and getting the following error message. I am not getting any data at all because of this. I have a native KCL client running in parallel and it is receiving data fine. Any thoughts? flink-sbistl919-taskexecutor-0-CACSVML-15736.log:2018-11-09

Kinesis Connector

2018-11-02 Thread Steve Bistline
I have tried just about everything to get a simple Flink application to consume from Kinesis. The application appears to connect ( I think ), no complaints... never receives any data. Even a very simple JAVA app see attached. Any help would be very much appreciated. Thanks -- Sent from: