Hi all
When DataStream is converted to table, eventTime is
converted to rowTime. Rowtime is 8 hours slow. How to solve this problem?
Thanks
Jiazhi
Hi everyone!
I'm using Flink 1.12.0 with SQL API.
I'm developing a streaming job with join and insertion into postgreSQL.
There is two tables in join:
1. Dynamic table based on kafka topic
2. Small lookup JDBC table
>From what I can see Flink job reads data from JDBC table only on startup and
mar
Hi Le,
You can attach many different functions in a single StateFun builder, and
let them message each other.
In your example, you can make the "Greet" function message Greet2 directly
(in addition to emitting a message as an egress).
Embedding multiple copies of StateFun within a Datastream appli
Hello :-)
It seems like in your attached pom you are not bundling the dependencies.
Check out the docs here [1].
[1]
https://ci.apache.org/projects/flink/flink-statefun-docs-release-2.2/deployment-and-operations/packaging.html#flink-jar
On Wed, Dec 23, 2020 at 3:07 AM Le Xu wrote:
> Hello!
>
Hey,
I would like to create a dynamic StreamingFileSink for my Streaming pipeline.
By dynamic, I mean that it will write to a different directory based on the
input.
For example, redirect the row to a different directory based on the first 2
characters of the input, so if the content I'm writing
Thanks Igal! I might be missing something here. I did place
statefun-flink-distribution as part of my dependency in the pom (see line
46 at [1]). Is there a correct way to include the jar? I'm having the same
problem across many examples I'm running.
[1]
https://gist.github.com/flint-stone/059f00
Thank you both very much!
Happy holidays!
Aljoscha Krettek 于2020年12月24日周四 下午4:00写道：
> Thanks for reporting this! This is not the expected behaviour, I created
> a Jira Issue: https://issues.apache.org/jira/browse/FLINK-20764.
>
> Best,
> Aljoscha
>
> On 23.12.20 22:26, David Anderson wrote:
> >
Hi Igal:
Thanks for the suggestion -- I changed the implementation based on your
suggestion by attaching the second function right after the first one using
the same builder. The only difference is that except the first function
send to egress -- it now sends to the the second function and then th
I apologize -- I meant to point out line 152, where context.send was used.
On Sat, Dec 26, 2020 at 11:21 PM Le Xu wrote:
> Hi Igal:
>
> Thanks for the suggestion -- I changed the implementation based on your
> suggestion by attaching the second function right after the first one using
> the same
Hello!
I seem to wire the wrong function by attaching the first function's output
to the remote reply function of the second function. The process works
great now. Thanks!
Le
On Sat, Dec 26, 2020 at 11:23 PM Le Xu wrote:
> I apologize -- I meant to point out line 152, where context.send was us
Hi Sidney,
Have a look at implementing a BucketAssigner for StreamingFileSink:
https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/streamfile_sink.html#bucket-assignment
Rafi
On Sat, Dec 26, 2020 at 11:48 PM Sidney Feiner
wrote:
> Hey,
> I would like to create a dynamic Stre
Hi
any idea?
is it a bug?
regards'
nick
בתאריך יום ד׳, 23 בדצמ׳ 2020 ב-11:10 מאת nick toker <
nick.toker@gmail.com>:
> Hello
>
> We noticed the following behavior:
> If we enable the flink checkpoints, we saw that there is a delay between
> the time we write a message to the KAFKA
Hi,
Hi, We think we are using the default values unless we are missing
something.
So this doesn't explain the problem we are facing.
Could you please tell us how to choose synchronous or asynchronous
checkpoints just to be sure we are using the correct configuration ?
BR,
Nick
בתאריך יום ה׳, 24
13 matches
Mail list logo
