Re: Issue with flink 1.16 and hive dialect

metastore,success-file'); [1] https://issues.apache.org/jira/browse/FLINK-27450 [2] https://issues.apache.org/jira/browse/HIVE-21584 [3] https://issues.apache.org/jira/browse/FLINK-32596 Best regards, Yuxia 发件人: "ramkrishna vasudevan" 收件人: "User" , "dev"

Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

Congratulations! Best regards, Yuxia 发件人: "Pushpa Ramakrishnan" 收件人: "Xintong Song" 抄送: "dev" , "User" 发送时间: 星期一, 2023年 7 月 03日 下午 8:36:30 主题: Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award Congratulations \uD83E\uDD73

Re: [Slack] Request to upload new invitation link

Hi, Stephen. Welcome to join Flink Slack channel. Here's my invitation link: https://join.slack.com/t/apache-flink/shared_invite/zt-1y7kmx7te-zUg1yfLdGu3Th9En_p4n~g Best regards, Yuxia 发件人: "Stephen Chu" 收件人: "User" 抄送: "Satyam Shanker" , "Vaib

Re: [DISCUSS] Hive dialect shouldn't fall back to Flink's default dialect

ct to users and more user-friendly, I'll remind users may use set table.sql-dialect = default to switch to Flink's default dialect in error message when fail to parse the sql in HiveParser. Best regards, Yuxia Best regards, Yuxia - 原始邮件 - 发件人: "Jingsong Li" 收件人: &qu

[DISCUSS] Hive dialect shouldn't fall back to Flink's default dialect

78370b18e1b6c4a23e5ce08f8efd05675a0cc17/flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/planner/delegation/hive/HiveParser.java#L348 [2]:https://issues.apache.org/jira/browse/FLINK-26681 [3]:https://issues.apache.org/jira/browse/FLINK-31413 [4]:https://issues.apache.org/jira/browse/FLINK-30064 Best regards, Yuxia

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

congratulations! Best regards, Yuxia 发件人: "Andrew Otto" 收件人: "Matthias Pohl" 抄送: "Jing Ge" , "Leonard Xu" , "Yu Li" , "dev" , "User" , "user-zh" 发送时间: 星期一, 2023年 3 月 27日 下午 8:57:50 主题: Re: [ANNOUNCE] F

Re: Are the Table API Connectors production ready?

The plan shows the filters has been pushed down. But remeber, although pused down, the filesystem table won't accept the filter. So, it'll be still like scan all files. Best regards, Yuxia 发件人: "Maryam Moafimadani" 收件人: "Hang Ruan" 抄送: "yuxia

Re: Are the Table API Connectors production ready?

Thanks Hang for taking it. Assigned to you~ Best regards, Yuxia 发件人: "Hang Ruan" 收件人: "yuxia" 抄送: "ravi suryavanshi" , "Yaroslav Tkachenko" , "Shammon FY" , "User" 发送时间: 星期一, 2023年 3 月 13日 下午 8:54:49 主题: Re: Are the Table

Re: Are the Table API Connectors production ready?

sues.apache.org/jira/browse/FLINK-17398 Best regards, Yuxia 发件人: "User" 收件人: "Yaroslav Tkachenko" , "Shammon FY" 抄送: "User" 发送时间: 星期一, 2023年 3 月 13日 上午 12:36:46 主题: Re: Are the Table API Connectors production ready? Thanks a lot, Yaroslav and Shammo

Re: CSV File Sink in Streaming Use Case

write data. As for the doc missing for CSV BulkFormat and not public in flink-csv, I really don't know why. I guess the reason maybe Flink won't expose it the datastream api, but only expose to table api. Best regards, Yuxia 发件人: "User" 收件人: "User" 发送时间: 星期二

Re: Example of dynamic table

ies.apache.org/flink/flink-docs-master/docs/dev/table/sourcessinks/ Best regards, Yuxia - 原始邮件 - 发件人: "Jie Han" 收件人: "User" 发送时间: 星期三, 2023年 3 月 08日 上午 7:54:06 主题: Example of dynamic table Hello community! I want to try the feature of dynamic table but do not find

Re: Is there any API method for dynamic loading of the UDF jar

to your need / perference. [1] https://issues.apache.org/jira/browse/FLINK-27660 [2]: https://github.com/apache/flink/blob/56b124bcfd661a295ab8772d265c12de25f690ab/flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/TableEnvironment.java#L541 Best regards, Yuxia 发件人

Re: Inconsistent data format of flink-training-repo and learn-flink doc

https://issues.apache.org/jira/projects/FLINK/issues Best regards, Yuxia 发件人: "Zhongpu Chen" 收件人: "User" 发送时间: 星期二, 2023年 2 月 21日 下午 8:49:13 主题: Inconsistent data format of flink-training-repo and learn-flink doc Hi, The data format specified in flink-training-repo ( [

Re: Flink SQL support array transform function

May be you can try with a non-lambda function. But TBH, I haven't seen any Flink UDF that accepts function as parameter in my previous experience. I'm afraid that it's no allowed to pass a function as parameter. Best regards, Yuxia 发件人: "Xuekui" 收件人: "yu

Re: Issue with de-serializing CompiledPlan and UNNEST_ROWS in Table API

]. [1] https://issues.apache.org/jira/projects/FLINK/issues/ [2] https://github.com/apache/flink/blob/bf342d2f67a46e5266c3595734574db270f1b48c/flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/plan/rules/logical/LogicalUnnestRule.scala Best regards, Yuxia 发件人

Re: Metrics or runtimeContext in global commit

It seems no other way to get the runtimeContext in a global commit. For me, I think it's reasoable to propose the fetature. I added flink-devs channel for more attention/discussion in flink devs. Best regards, Yuxia - 原始邮件 - 发件人: "Tobias Fröhlich" 收件人: "User"

Re: Flink SQL support array transform function

/functions/udfs/#type-inference ] Best regards, Yuxia 发件人: "Xuekui" 收件人: "fskmine" , "Caizhi Weng" 抄送: "User" 发送时间: 星期四, 2023年 2 月 16日 上午 10:54:05 主题: Re: Flink SQL support array transform function Hi Caizhi, I've tried to write UDF to su

Re: KafkaSink handling message size produce errors

Hi, Hatem. I think there is no way to catch the exception and then ignore it in current implementation for KafkaSink. You may also need to extend the KafkaSink. Best regards, Yuxia 发件人: "Hatem Mostafa" 收件人: "User" 发送时间: 星期四, 2023年 2 月 16日 下午 9:32:44 主题: KafkaSink h

Re: Non-Determinism in Table-API with Kafka and Event Time

t the records exceed the watermark, but there're still some records will arrive? If that's the case, every time, the records used to calculate result may well different and then result in non-determinism result. Best regards, Yuxia - 原始邮件 - 发件人: "Theodor Wübker" 收件人:

Re: Flink Hudi HMS Catalog problem

HI, Flink provides HiveCatalog which can store native Hive table and other type Flink table(more exactly, a DDL mapping), with which, Flink can access Hive table and other Flink tables. Does it meet you requirement? Best regards, Yuxia 发件人: "melin li" 收件人: "User"

Re: Seeking suggestions for ingesting large amount of data from S3

by memory lack or others. Btw, have ever tried with Flink SQL to ingeset the data. Does the OOM still happen? Best regards, Yuxia 发件人: "Yang Liu" 收件人: "User" 发送时间: 星期五, 2023年 2 月 10日 上午 5:10:49 主题: Seeking suggestions for ingesting large amount of data from S3 Hi

Re: Unsubscribe

Hi. To unsubscribe, you should send email to user-unsubscr...@flink.apache.org with any contents or subject. Please see more in the Flink Doc[1] [1] https://flink.apache.org/community.html#how-to-subscribe-to-a-mailing-list Best regards, Yuxia 发件人: "liang ji" 收件人: "Us

Re: Unsubscribe

Hi, All. To unsubscribe, you can send email to user-unsubscr...@flink.apache.org with any contents or subject. Please see more in the Flink Doc[1] [1] https://flink.apache.org/community.html#how-to-subscribe-to-a-mailing-list Best regards, Yuxia 发件人: "Ragini Manjaiah" 收件

Re: I want to subscribe users' questions

Maybe you will also be interested in joining Flink Slack, here is my invite link for joining Flink Slack: https://join.slack.com/t/apache-flink/shared_invite/zt-1obpql04h-R3o5XM8d~Siyl3KGldkl2Q Best regards, Yuxia - 原始邮件 - 发件人: "guanyuan chen" 收件人: "User" , "u

Re: Unable to do event time window aggregation with Kafka source

Hi, Lucas. What do you mean by saying "unable to do event time window aggregation with watermarkedStream"? What exception it will throw? Best regards, Yuxia 发件人: "wei_yuze" 收件人: "User" 发送时间: 星期二, 2023年 2 月 07日 下午 1:43:59 主题: Unable to do event time

Re: Design decisions around flink table store

LIP-188%3A+Introduce+Built-in+Dynamic+Table+Storage#FLIP188:IntroduceBuiltinDynamicTableStorage-UsingHudi | https://cwiki.apache.org/confluence/display/Flink/FLIP-188%3A+Introduce+Built-in+Dynamic+Table+Storage#FLIP188:IntroduceBuiltinDynamicTableStorage-UsingHudi ] Best regards, Yuxia 发件人: &

Re: How to add permission validation? flink reads and writes hive table。

HI, melin li. Could you please explain a bit more about unified access check in flink? Best regards, Yuxia 发件人: "melin li" 收件人: "User" 发送时间: 星期三, 2023年 2 月 01日 下午 2:39:15 主题: How to add permission validation? flink reads and writes hive table。 flink suppo

Re: Custom catalog implementation - getting table schema for computed columns

HI, > about the question can I assume that ResolvedCatalogTable will be always a > runtime type. Sorry for I don't really understand your question , why do you have such assumtion? Best regards, Yuxia 发件人: "Krzysztof Chmielewski" 收件人: "User" 发送时间: 星期

Re: Custom catalog implementation - getting table schema for computed columns

wse/FLINK-21396 ] Best regards, Yuxia 发件人: "Krzysztof Chmielewski" 收件人: "User" 发送时间: 星期六, 2023年 1 月 21日 上午 2:27:25 主题: Custom catalog implementation - getting table schema for computed columns Hi, I'm implementing a custom Catalog where for "create table" I

Re: request for link to join

Hi, all. Here is my invitation link: https://join.slack.com/t/apache-flink/shared_invite/zt-1obpql04h-R3o5XM8d~Siyl3KGldkl2Q Best regards, Yuxia 发件人: "P Singh" 收件人: "Tamir Sagi" , "Wai Chee Yau" , "User" 发送时间: 星期日, 2023年 1 月 29日 下午 7:35:21 主题:

Re: Detect Table options override by Query Dynamic options

Hi, Krzysztof Chmielewski. I'm afraid that there's no a way to detect in Table Factory as the passed catalog table has contained the overriden options by query dynamci option and seems we have no any flag to identify it in Table Factory. Best regards, Yuxia 发件人: "Krzysz

Re: Using TumblingEventTimeWindows on low traffic kafka topic

/kafka/#idleness [2] https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/dev/datastream/event-time/generating_watermarks/#dealing-with-idle-sources Best regards, Yuxia 发件人: "deepthi s" 收件人: "User" 发送时间: 星期四, 2022年 12 月 22日 上午 9:46:00 主题: Using TumblingEve

Re: unsubscribe

To unsubscribe, you should send an email to user-unsubscr...@flink.apache.org, which has been documented in Flink offical website[1]. [1] https://flink.apache.org/community.html#mailing-lists Best regards, Yuxia 发件人: "Ayush" 收件人: "User" 发送时间: 星期日, 2022年 12

Re: How to set disableChaining like streaming multiple INSERT statements in a StatementSet ?

Could you please post the image of the running job graph in Flink UI? Best regards, Yuxia 发件人: "hjw" 收件人: "User" 发送时间: 星期四, 2022年 12 月 08日 上午 12:05:00 主题: How to set disableChaining like streaming multiple INSERT statements in a StatementSet ? Hi, I create

Re: Registering serializer for RowData

Hi, what's the type of the input for the SortOperator? I mean what's the TypeInformation? For example, PojoTypeInfo or RowTypeInfo? Best regards, Yuxia 发件人: "Ken Krugler" 收件人: "User" 发送时间: 星期三, 2022年 12 月 07日 上午 9:11:17 主题: Registering serializer for RowDa

Re: Flink Table Kinesis sink not failing when sink fails

Which code line the error message happens? Maybe it will swallow the exception and then log the error message, in which case Flink job won't fail since it seems like no exception happens. Best regards, Yuxia 发件人: "Dan Hill" 收件人: "User" 发送时间: 星期三, 2022年 11 月

Re: Weird Flink SQL error

Hi, Dan. I'm wondering what type of error you expect. IMO, I think most engines throw parse error in such way which tell you encounter an unexpected token. Best regards, Yuxia 发件人: "Dan Hill" 收件人: "User" 发送时间: 星期三, 2022年 11 月 23日 下午 1:55:20 主题: Weird Flink SQ

Re: Flink SQL JSON

Hi! Maybe you can map it to Flink's BINARY / VARBINARY type [1]. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/formats/json/#data-type-mapping Best regards, Yuxia 发件人: "Timothy Bess" 收件人: "User" 发送时间: 星期六, 2022年 11 月 19日

Re: How to use lookup join sql hint

Could you please show us the detail exception? You can find it in FLINK_HOME/log Best regards, Yuxia 发件人: "Si-li Liu" 收件人: "User" 发送时间: 星期六, 2022年 11 月 12日 下午 4:27:54 主题: How to use lookup join sql hint I try to use this sql to insert my data to doris, and my Flin

Re: [blog article] Howto migrate a real-life batch pipeline from the DataSet API to the DataStream API

Wow, cool! Thanks for your work. It'll be definitely helpful for the users that want to migrate their batch job from DataSet API to DataStream API. Best regards, Yuxia - 原始邮件 - 发件人: "Etienne Chauchot" 收件人: "dev" , "User" 发送时间: 星期一, 2022年 11 月 07日 下

Re: Question about UDF randomly processed input row twice

n the StreamPhysicalCalc, as of result of which, it seems the one row will be processed for twice. Best regards, Yuxia 发件人: "Xinyi Yan" 收件人: "yuxia" 抄送: "User" 发送时间: 星期五, 2022年 11 月 04日 上午 5:28:30 主题: Re: Question about UDF randomly processed input row twice O

Re: Question about UDF randomly processed input row twice

The dategen may produce rows with same values. >From my side, in Flink, the udf shouldn't process one row for twice, >otherwise, it should be a critical bug. Best regards, Yuxia 发件人: "Xinyi Yan" 收件人: "User" 发送时间: 星期四, 2022年 11 月 03日 上午 6:59:20

Re: why select limit so slow on yarn cluster

plan. Best regards, Yuxia 发件人: "Si-li Liu" 收件人: "User" 发送时间: 星期三, 2022年 11 月 02日 上午 12:17:52 主题: why select limit so slow on yarn cluster I created a table using Flink SQL on yarn session. CREATE TEMPORARY TABLE `scrm_admin_role` ( > `id` bigint, > `r

Re: Could not find any factory for identifier 'filesystem'

the dependency flink-connector-files is needed. Best regards, Yuxia 发件人: "Pavel Penkov" 收件人: "User" 发送时间: 星期二, 2022年 11 月 01日 下午 6:06:43 主题: Could not find any factory for identifier 'filesystem' I'm trying to run a Flink job as a standalone progr

Re: SQL Lookup join on nested field

AFAK，there's no any plan/ticket for it. If you think it's needed to be supported, you can create a tiket in jira[1] for it. [1] https://issues.apache.org/jira/projects/FLINK/summary Best regards, Yuxia 发件人: "Krzysztof Chmielewski" 收件人: "User" 发送时间: 星期二,

Re: Flink 1.15 Interval Join error after Deduplicate

The view A try to do de-duplication using event time, which will still produce update rows. if you using proc time to do de-duplication.Then the view A should only produce append only rows. Best regards, Yuxia > 2022年10月15日 上午9:50，liebin...@whu.edu.cn 写道： > > I had a pro

Re: Flink 1.15 Interval Join error after Deduplicate

> view A should only produce insert rows No, the view A will still produce update/delete rows. Best regards, Yuxia > 2022年10月15日 上午9:50，liebin...@whu.edu.cn 写道： > > view A should only produce insert rows

Re: SQL Changes between 1.14 and 1.15?

.org/jira/browse/FLINK-26520> Best regards, Yuxia > 2022年10月14日 下午9:19，PACE, JAMES 写道： > > We’ve noticed the following difference in sql when upgrading from flink > 1.14.5 to 1.15.2 around characters that are escaped in an sql statement: > > This statement: > tableEnvi

Re: Sorting by source event time

bled__` to true. But remember it's just experimental, which may bring unexpect behavior. Best regards, Yuxia - 原始邮件 - 发件人: "Noel OConnor" 收件人: "User" 发送时间: 星期二, 2022年 9 月 27日 上午 2:10:36 主题: Sorting by source event time Hi, I have a temporary view created from a data

Re: Insert into JDBC table

tly. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/hive/hive_dialect/ [2] https://nightlies.apache.org/flink/flink-table-store-docs-master/ . Or Best regards, Yuxia - 原始邮件 - 发件人: "podunk" 收件人: "User" 发送时间: 星期一, 2022年 9 月 12日 下午 8:36:54

Re: Access to Table environent properties/Job arguents from DynamicTableFactory

Have you ever checked the DynamicTableFactory.Context#getConfiguration? Is it something that you're looking for? Best regards, Yuxia 发件人: "Krzysztof Chmielewski" 收件人: "User" 发送时间: 星期六, 2022年 9 月 10日 上午 12:51:09 主题: Access to Table environent pro

Re: get NoSuchMethodError when using flink flink-sql-connector-hive-2.2.0_2.11-1.14.4.jar

1.14.4.jar' `, and set 'org.apache.commons.' the to parent-first[1] But I think the better way is to relocate the class. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/config/#classloader-parent-first-patterns-default Best regards, Yuxia 发件人: &qu

Re: Failing to maven compile install Flink 1.15

which mvn version do you use? It's recommanded to use maven 3.2.5 Best regards, Yuxia 发件人: "hjw" <1010445...@qq.com> 收件人: "User" 发送时间: 星期四, 2022年 8 月 18日 下午 10:48:57 主题: Failing to maven compile install Flink 1.15 I try to maven clean install Flink

Re: Failing to compile Flink 1.9 with Scala 2.12

At least for Flink 1.15, it's recommended to use maven 3.2.5. So I guess maybe you can try use a lower version of maven. Best regards, Yuxia 发件人: "Milind Vaidya" 收件人: "Weihua Hu" 抄送: "User" 发送时间: 星期五, 2022年 8 月 19日 上午 1:26:45 主题: Re: Failing to com

Re: get state from window

Sorry for misleading. After some investigation, seems UDTAGG can only used in flink table spi. Best regards, Yuxia - 原始邮件 - 发件人: "yuxia" 收件人: "user-zh" 抄送: "User" 发送时间: 星期四, 2022年 8 月 18日 上午 10:21:12 主题: Re: get state from window > does flink s

Re: get state from window

> does flink sql support UDTAGG? Yes, Flink sql support UDTAGG. Best regards, Yuxia - 原始邮件 - 发件人: "曲洋" 收件人: "user-zh" , "User" 发送时间: 星期四, 2022年 8 月 18日 上午 10:03:24 主题: get state from window Hi dear engineers, I have one question: does flink stre

Re: without DISTINCT unique lines show up many times in FLINK SQL

Seems it's the same problem to the problem discussed in [1] [1]:https://lists.apache.org/thread/3lvkd8hryb1zdxs3o8z65mrjyoqzs88l Best regards, Yuxia - 原始邮件 - 发件人: "Marco Villalobos" 收件人: "User" 发送时间: 星期三, 2022年 8 月 17日 下午 12:56:44 主题: without DISTINCT unique

Re: Is this a Batch SQL Bug?

you please help create a jira to track it? Best regards, Yuxia - 原始邮件 - 发件人: "Marco Villalobos" 收件人: "User" 发送时间: 星期四, 2022年 8 月 18日 上午 6:08:33 主题: Is this a Batch SQL Bug? Given this program: ```java package mvillalobos.bug; import org.apache.flink.api.commo

Re: Metrics & Monitoring in Flink SQL

%3A+Standardize+Connector+Metrics Best regards, Yuxia 发件人: "casel.chen" 收件人: "yuxia" 抄送: "Salva Alcántara" , "User" 发送时间: 星期日, 2022年 7 月 17日 下午 12:00:11 主题: Re:Re: Metrics & Monitoring in Flink SQL How to get all metrics of those

Re: Metrics & Monitoring in Flink SQL

With Flink SQL, You can define your own source/sink metrics [1], but you can't define the metrics for the intermediate operators. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sourcessinks/ Best regards, Yuxia 发件人: "Salva Alcántara" 收件人: &qu

Re: Parsing a JSON array string as a Flink SQL Array data type

I'm afraid of there's no build-in function on the hand. But you can write a UDF[1] to convert the JSON array string to Flink's array. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/functions/udfs/ Best regards, Yuxia - 原始邮件 - 发件人: "Abhis

Re: Does Table API connector, csv, has some option to ignore some columns

write the all columns so that we can do the mapping. If there's a header, we can do the mapping, and it should meet your requirement. However, the current implementation haven't consider such case. Best regards, Yuxia 发件人: "podunk" 收件人: "User" 发送时间: 星

Re: How can I convert a DataSet into a Table?

k/flink-docs-master/docs/dev/table/common/#table-api | https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/common/#table-api ] Best regards, Yuxia 发件人: "podunk" 收件人: "User" 发送时间: 星期三, 2022年 7 月 06日 上午 5:09:54 主题: How can I convert a Da

Re: How can I convert a DataSet into a Table?

/java/BatchTableEnvironment.html#fromDataSet-org.apache.flink.api.java.DataSet-java.lang.String- Best regards, Yuxia 发件人: pod...@gmx.com 收件人: "User" 发送时间: 星期三, 2022年 7 月 06日 上午 5:09:54 主题: How can I convert a DataSet into a Table? My code is: package flinkTest2; import org.apache.flink.a

Re: ContinuousFileMonitoringFunction retrieved invalid state.

I'm not sure why it happened. But from the Flink source code, it seems try to restore from an invalid state. Seems the state actually contains more that one value, but Flink expected the state should contains one or zero value. Best regards, Yuxia 发件人: "Vishal Surana" 收件人

Re: StreamingFileSink & checkpoint tuning

gards, Yuxia 发件人: "Xin Ma" 收件人: "User" 发送时间: 星期四, 2022年 6 月 30日 下午 11:05:51 主题: StreamingFileSink & checkpoint tuning Hi, I recently encountered an issue while using StreamingFileSink. I have a flink job consuming records from various sources and write to s3 w

Re: The methodlogy behind the join in Table API and Datastream

> any way I can both receive the message of both update. I think you may need outer join[1] [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sql/queries/joins/#outer-equi-join Best regards, Yuxia 发件人: "lan tran" 收件人: "User" 发送时间: 星期三, 2

Re: Overhead on managing Timers with large number of keys

The short answer is yes. In any case, flink wil spend time/cpu to invoke the timer. Best regards, Yuxia 发件人: "Surendra Lalwani" 收件人: "User" 发送时间: 星期三, 2022年 6 月 29日 下午 3:52:32 主题: Overhead on managing Timers with large number of keys Hi Team, I am working on

Re: How to make current application cdc

[5] [ https://ververica.github.io/flink-cdc-connectors/ | https://ververica.github.io/flink-cdc-connectors/ ] Best regards, Yuxia 发件人: "Sid" 收件人: "User" 发送时间: 星期六, 2022年 6 月 25日 下午 6:32:22 主题: How to make current application cdc Hello, I have a current flow where the data fr

Re: Apache Flink - Reading data from Scylla DB

09/07/connector-table-sql-api-part1.html Best regards, Yuxia 发件人: "Himanshu Sareen" 收件人: "User" 发送时间: 星期二, 2022年 6 月 14日 上午 11:29:38 主题: Apache Flink - Reading data from Scylla DB Team, I'm looking for a solution to Consume/Read data from Scylla DB into Apache F

Re: Could not find a suitable table factory for 'org.apache.flink.table.planner.delegation.ParserFactory' in the classpath.

Have you ever unzip your project jar and make sure the class HiveParserFactory exist? Best regards, Yuxia 发件人: "顾斌杰" 收件人: luoyu...@alumni.sjtu.edu.cn 抄送: "User" 发送时间: 星期三, 2022年 6 月 08日 下午 5:11:33 主题: Re: Could not find a suitab

Re: Could not find a suitable table factory for 'org.apache.flink.table.planner.delegation.ParserFactory' in the classpath.

Have you ever put the flink-sql-connector-hive into you FLINK_HOME/lib? And make sure your JM/TM also contains the jar. Best regards, Yuxia 发件人: "顾斌杰" 收件人: "User" 发送时间: 星期三, 2022年 6 月 08日 下午 3:19:19 主题: Re: Could not find a suitab

Re: slack invite link

I have send the invitation to the email address shmily...@gmail.com. Please check you email! Look forward your joining. Best regards, Yuxia 发件人: "shmily" 收件人: "User" 发送时间: 星期日, 2022年 6 月 05日 下午 4:55:11 主题: slack invite link hi, can someone please send me a slack

Re: Can we resume a job from a savepoint from Java api?

/master/flink-tests/src/test/java/org/apache/flink/test/checkpointing/SavepointITCase.java#L1228 ] Best regards, Yuxia 发件人: "Qing Lim" 收件人: "User" 发送时间: 星期三, 2022年 6 月 01日 下午 7:46:59 主题: Can we resume a job from a savepoint from Java api? Hi, is it possible to

Re: Status of File Sink Common (flink-file-sink-common)

I'm afraid not. I can still find it in main repository[1]. [1] https://github.com/apache/flink/tree/master/flink-connectors/flink-file-sink-common Best regards, Yuxia - 原始邮件 - 发件人: "Jun Qin" 收件人: "User" 发送时间: 星期二, 2022年 5 月 31日 上午 5:24:10 主题: Status of Fil

Re: Large backpressure and slow checkpoints in StateFun

May be you can use jstack or flame graph to analyze what's the bottleneck. BTW, about generating flame graph, arthas[1] is a good tool. [1] https://github.com/alibaba/arthas Best regards, Yuxia 发件人: "Christopher Gustafson" 收件人: "User" 发送时间: 星期一, 2022年 5 月

Re: Exception when running Java UDF with Blink table planner

It seems an exception thrown when Flink try to deserialize the object outputed by your udf. So is the obejct produced by your udf serializable? Does it contain any lambda function in the object/class? Best regards, Yuxia 发件人: "Tom Thornton" 收件人: "User" 发送时间: 星期五, 2

Re: length value for some classes extending LogicalType.

IMO, the behaviors depends on how you convert your string data from extern system to Flink's intern data or, conversely. I think it's more like a hint to tell how to convert the string data between extern system including source and sink. Best regards, Yuxia 发件人: "Krzysz

Re: OutputTag alternative with pyflink 1.15.0

] [3] [ https://nightlies.apache.org/flink/flink-docs-master/docs/flinkdev/building/ | https://nightlies.apache.org/flink/flink-docs-master/docs/flinkdev/building/ ] Best regards, Yuxia 发件人: "Lakshya Garg" 收件人: "User" 发送时间: 星期一, 2022年 5 月 23日 下午 12:02:26 主题: Output

Re: Incorrect checkpoint id used when job is recovering

There's a simliar issue FLINK-19816[1] [1] [ https://issues.apache.org/jira/browse/FLINK-19816 | https://issues.apache.org/jira/browse/FLINK-19816 ] Best regards, Yuxia 发件人: "tao xiao" 收件人: "User" 发送时间: 星期四, 2022年 5 月 19日 下午 9:16:34 主题: Re: Incorrect check

Re: Incompatible data types while using firehose sink

Flink 1.15 or rewrite some code of Firehose connector to migrate it to sink1. Best regards, Yuxia 发件人: "Zain Haider Nemati" 收件人: "Martijn Visser" 抄送: "yu'an huang" , "User" 发送时间: 星期四, 2022年 5 月 12日 下午 3:36:46 主题: Re: Incompatible data typ

Re: http stream as input data source

k/flink-docs-master/docs/dev/table/sourcessinks/ [2]: https://issues.apache.org/jira/browse/FLINK-8047. Best regards, Yuxia 发件人: "Harald Busch" 收件人: "User" 发送时间: 星期四, 2022年 5 月 12日 上午 11:37:29 主题: http stream as input data source Hi, is there a http d

Re: unsubscribe

To unsubscribe, you can send email to user-unsubscr...@flink.apache.org with any object. Best regards, Yuxia 发件人: "Henry Cai" 收件人: "User" 发送时间: 星期四, 2022年 5 月 12日 上午 1:14:43 主题: unsubscribe unsubscribe

Re: How can I set job parameter in flink sql

.put(" black_list_path ", "") env.getConfig.setGlobalJobParameters(Configuration.fromMap(m)) Then, you can get the parameter using context.getJobParameter("black_list_path", "/config/list.properties"); in udf. Best regards, Yuxia 发件人: "wang" <24

Re: Unable to start sql-client when putting flink-table-planner_2.12-1.15.0.jar to lib folder

r opt folder and flink-table-planner-loader is under /lib. in such way, you can choose whaterever scala version you prefer. Also, you can swap flink-table-planner_2.12-1.15.0.jar and flink-table-planner-loader. But with such way, you are bind on Flink's 2.12. scala version, Best regar

Re: Unable to start sql-client when putting flink-table-planner_2.12-1.15.0.jar to lib folder

Hi, you can move the flink-table-planner-loader to the /opt. See more in [ https://issues.apache.org/jira/browse/FLINK-25128 | https://issues.apache.org/jira/browse/FLINK-25128 ] Best regards, Yuxia 发件人: "Jeff Zhang" 收件人: "User" 发送时间: 星期六, 2022年 5 月 07日 下午 10:

Re: How to return JSON Object from UDF

ay need to provide a class like JSONObject Serializer that extends TypeSerializerSingleton. Best regards, Yuxia 发件人: "Surendra Lalwani" 收件人: "User" 发送时间: 星期五, 2022年 5 月 06日 下午 4:40:19 主题: How to return JSON Object from UDF Hi Team, I am using Flink 1.13.6 and I