Fink 1.17 vs 1.18

2023-11-08 Thread Amir Hossein Sharifzadeh
Hello Flink dev team, This question might have been answered already but I want to ask again after the official release 1.18. What are the major differences between Fink 1.17 and 1.18? Is 1.18 faster for streaming processing? Thank you very much. Best, Amir

Re: [VOTE] Release 1.18.0, release candidate #3

2023-10-21 Thread Amir Hossein Sharifzadeh
Does the 1.18 version support the Kafka connector? On Wed, Oct 18, 2023 at 8:26 PM Jing Ge wrote: > Hi everyone, > > Please review and vote on the release candidate #3 for the version > 1.18.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specifi

A few questions regarding Docker

2023-05-31 Thread Amir Hossein Sharifzadeh
Hi Flink Dev Team, I am trying to create a Docker image. Before asking my question, I will explain to you about my application. My main (command) jar file: 1) Has dependencies on other jar files (they are all in the same directory) 2) It Needs to read some arguments from a config file. 3) Genera

Re: How to figure out what's the size of ListState?

2023-05-27 Thread Amir Hossein Sharifzadeh
c64a808484cab78c8bd7b74a287edf7d1f3b01/flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBListState.java#L131 > > Best > Yun Tang > ____ > From: Amir Hossein Sharifzadeh > Sent: Tuesday, May 23, 2

How to figure out what's the size of ListState?

2023-05-23 Thread Amir Hossein Sharifzadeh
Dear Flink Dev team, It's about a while since I am dealing with an issue that can't figure out myself. I spent quite a lot of time trying to solve the problem myself, but I feel stuck. I explained the problem statement and the issue here: https://stackoverflow.com/questions/76308686/how-to-figure

Re: Need help how to use Table API to join two Kafka streams

2023-02-07 Thread Amir Hossein Sharifzadeh
Thanks. If you look at the code, I am defining/creating the table as: create_kafka_source_ddl = """ CREATE TABLE payment_msg( createTime VARCHAR, orderId BIGINT, payAmount DOUBLE, payPlatform INT, provinceId INT ) WITH (

Re: Need help how to use Table API to join two Kafka streams

2023-02-07 Thread Amir Hossein Sharifzadeh
d.java:1168) Caused by: java.lang.RuntimeException: Python process exits with code: 1 at org.apache.flink.client.python.PythonDriver.main(PythonDriver.java:130) ... 13 more Thanks a lot, Best, Amir On Tue, Feb 7, 2023 at 10:48 AM Amir Hossein Sharifzadeh < amirsharifza...@gmail.com&g

Re: Need help how to use Table API to join two Kafka streams

2023-02-07 Thread Amir Hossein Sharifzadeh
ot cause. Maybe > you can post the full error message . > > Best regards, > Yuxia > > -- > *发件人: *"Amir Hossein Sharifzadeh" > *收件人: *"yuxia" > *抄送: *"dev" > *发送时间: *星期二, 2023年 2 月 07日 上午 10:39:25 > *主题: *Re: Need help how to us

Re: Need help how to use Table API to join two Kafka streams

2023-02-06 Thread Amir Hossein Sharifzadeh
tImpl.java:884) ... 13 more Best, Amir On Sun, Feb 5, 2023 at 8:20 PM yuxia wrote: > Hi, thanks for reaching me out. > For your question, you don't need to cosume data in my cosumer class > seperately and then insert them into those tables. The data will > be c

Re: Need help how to use Table API to join two Kafka streams

2023-02-03 Thread Amir Hossein Sharifzadeh
re for more detail[1]. > [1] > https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/tableapi/#joins > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Amir Hossein Sharifzadeh" > 收件人: "dev" > 发送时间: 星期五, 2023年 2 月 03日 上午 4:45:

Need help how to use Table API to join two Kafka streams

2023-02-02 Thread Amir Hossein Sharifzadeh
Hello, I have a Kafka producer and a Kafka consumer that produces and consumes multiple data respectively. You can think of two data sets here. Both datasets have a similar structure but carry different data. I want to implement a Table API to join two Kafka streams while I consume them. For exam

Py4JJavaError

2023-01-19 Thread Amir Hossein Sharifzadeh
Hi developers: I am trying to run a sample Flink consumer ( https://nightlies.apache.org/flink/flink-docs-release-1.16/api/python//examples/datastream/connectors.html) but I get these error messages (I am running the program on Mac M1, and downgraded my java to jdk 8: java version "1.8.0_351"):