a bit more details about your
> setup
> and the code of your job or a minimal example that can reproduce it.
>
> Thanks,
> Kostas
>
> On Sep 12, 2018, at 9:59 AM, Till Rohrmann wrote:
>
> Hi Joe,
>
> what is the current problem you are facing?
>
> Cheers,
any local address. Now you need to build your own Flink distribution by
>> running `mvn clean package -DskipTests` and then go to either build-target
>> or flink-dist/target/flink-1.7-SNAPSHOT-bin/flink-1.7-SNAPSHOT to find the
>> distribution.
>>
>> Cheers,
>>
I'm having a problem with querying state on Flink 1.6.
I put a project in Github that is my best representation of the very simple
client example outlined in the 'querying state' section of the 1.6
documentation at
https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/queryable_s
When running Flink in high availability mode, I've been seeing a high number of
UnknownKvStateKeyGroupLocation errors being returned when using queryable state
calls.
If I put a simple getKvState call into a loop executing every second, and call
it repeatedly, sometimes I will get the expected
cumulator results, etc.), perhaps that is something you’re
looking for?
As of now, I think querying the REST interface would be the way to go.
Cheers,
Gordon
On 9 May 2017 at 11:47:43 AM, Joe Olson
(jo4...@outlook.com<mailto:jo4...@outlook.com>) wrote:
I've got a job name, and need t
I've got a job name, and need the job id. Is there a way to get this via the
java API? I know I can get it via the rest interface. Is there an equivalent
API call in the streaming API?
If not, I'll continue to use the rest interface.
If I am processing a stream in the following manner:
val stream = env.addSource(consumer).name("KafkaStream")
.keyBy(x => (x.obj.ID1(),x.obj.ID2(),x.obj.ID3())
.flatMap(new FlatMapProcessor)
and the IDs bomb out because of deserialization issues, my job crashes with a
'Could not extract key'
If I have a keyed stream going in to a N node Flink stream processor, and I had
a job that was keeping a count using a ValueStateDescriptor (per key), would
that descriptor be synchronized among all the nodes?
i.e. Are the state descriptors interfaces (ValueStateDescriptor,
ListStateDescriptor
>From what I've read in the documentation, and from the examples I've seen, in
>order to make state queryable externally to Flink, the state descriptor
>variables need access to the Flink runtime context.
This means the stream processor has to have access to the 'Rich' level objects
- 'RichFla
Suppose my goal is to answer the question: "Show me all the continuous time
intervals a stock price was over X between times T1 and T2".
The response I am looking for is an array of Tuple2s, each of which represent a
start / end timestamp when the stock was above price X. There might be a lot o
10 matches
Mail list logo
