Are the Table API Connectors production ready?

2023-02-26 Thread ravi_suryavanshi.yahoo.com via user
Hi Team, In Flink 1.16.0, we would like to use some of the Table API Connectors for production. Kindly let me know if the below connectors are production ready or only for testing purposes. | Name | Version | Source | Sink | | Filesystem | | Bounded and Unbounded Scan, Lookup | Streaming Sink,

Re: Are the Table API Connectors production ready?

2023-03-09 Thread ravi_suryavanshi.yahoo.com via user
Hi,Can anyone help me here? Thanks and regards,Ravi On Monday, 27 February, 2023 at 09:33:18 am IST, ravi_suryavanshi.yahoo.com via user wrote: Hi Team, In Flink 1.16.0, we would like to use some of the Table API Connectors for production. Kindly let me know if the below connectors ar

Re: Are the Table API Connectors production ready?

2023-03-09 Thread Yaroslav Tkachenko
Hi Ravi, All of them should be production ready. I've personally used half of them in production. Do you have any specific concerns? On Thu, Mar 9, 2023 at 9:39 AM ravi_suryavanshi.yahoo.com via user < user@flink.apache.org> wrote: > Hi, > Can anyone help me here? > > Thanks and regards, > Ravi

Re: Are the Table API Connectors production ready?

2023-03-09 Thread Shammon FY
Hi Ravi Agree with Yaroslav and if you find any problems in use, you can create an issue in jira https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK . I have used kafka/jdbc/hive in production too, they work well. Best, Shammon On Fri, Mar 10, 2023 at 1:42 AM Yaroslav Tkachenko wro

Re: Are the Table API Connectors production ready?

2023-03-12 Thread ravi_suryavanshi.yahoo.com via user
Thanks a lot, Yaroslav and Shammon.I want to use the Filesystem Connector.  I tried it works well till it is running. If the job is restarted. It processes all the files again. Could not find the move or delete option after collecting the files. Also, I could not find the filtering using patter

Re: Are the Table API Connectors production ready?

2023-03-12 Thread Shammon FY
Hi ravi Do you read streaming data with filesystem connector? By default, the file system is bound. If you need to read streaming data, you can look at the configuration `source.monitor.interval` in https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/filesystem/#directory-wa

Re: Are the Table API Connectors production ready?

2023-03-12 Thread yuxia
sues.apache.org/jira/browse/FLINK-17398 Best regards, Yuxia 发件人: "User" 收件人: "Yaroslav Tkachenko" , "Shammon FY" 抄送: "User" 发送时间: 星期一, 2023年 3 月 13日 上午 12:36:46 主题: Re: Are the Table API Connectors production ready? Thanks a lot, Yaroslav and Shammo

Re: Are the Table API Connectors production ready?

2023-03-13 Thread Hang Ruan
kachenko" , "Shammon FY" < > zjur...@gmail.com> > *抄送: *"User" > *发送时间: *星期一, 2023年 3 月 13日 上午 12:36:46 > *主题: *Re: Are the Table API Connectors production ready? > > Thanks a lot, Yaroslav and Shammon. > I want to use the Filesystem Connector. I tr

Re: Are the Table API Connectors production ready?

2023-03-13 Thread Maryam Moafimadani via user
Best regards, >> Yuxia >> >> -- >> *发件人: *"User" >> *收件人: *"Yaroslav Tkachenko" , "Shammon FY" < >> zjur...@gmail.com> >> *抄送: *"User" >> *发送时间: *星期一, 2023年 3 月 13日 上午 12:36:46 &

Re: Are the Table API Connectors production ready?

2023-03-13 Thread yuxia
Thanks Hang for taking it. Assigned to you~ Best regards, Yuxia 发件人: "Hang Ruan" 收件人: "yuxia" 抄送: "ravi suryavanshi" , "Yaroslav Tkachenko" , "Shammon FY" , "User" 发送时间: 星期一, 2023年 3 月 13日 下午 8:54:49 主题: Re: Are the Table

Re: Are the Table API Connectors production ready?

2023-03-13 Thread yuxia
" , "ravi suryavanshi" , "Yaroslav Tkachenko" , "Shammon FY" , "User" 发送时间: 星期一, 2023年 3 月 13日 下午 10:07:57 主题: Re: Are the Table API Connectors production ready? Hi All, It's exciting to see file filtering in the plan for development. I am curious

Re: Are the Table API Connectors production ready?

2023-03-15 Thread ravi_suryavanshi.yahoo.com via user
人: "Maryam Moafimadani" 收件人: "Hang Ruan" 抄送: "yuxia" , "ravi suryavanshi" , "Yaroslav Tkachenko" , "Shammon FY" , "User" 发送时间: 星期一, 2023年 3 月 13日 下午 10:07:57 主题: Re: Are the Table API Connectors production ready? Hi All,It