?????? ??????Flink SQL?????????????????

hi Jark Wu. ??table.exec.source.idle-timeoutwatermarkwatermarkwatermarkwatermark?? ??kafka??watermark??

?????? ??????Flink SQL?????????????????

   Jark??flink?? --  -- ??: "Jark Wu"https://ci.apache.org/projects/flink/flink-docs-master/dev/table/config.html#table-exec-source-idle-timeout > > On Tue, 7 Jul 2020 at 17:35, noake

?????? ??????Flink SQL?????????????????

  https://issues.apache.org/jira/browse/FLINK-18523 --  -- ??: "Jark Wu"https://ci.apache.org/projects/flink/flink-docs-master/dev/table/config.html#table-exec-source-idle-timeout > > >

?????? Flink SQL??????????????????????(??????)????????????

join --  -- ??: "godfrey he"

flink sql????????????

Hi     ??flink sql??   val config = tableConfig.getConfiguration()     config.setString("table.exec.mini-batch.enabled", "true")     config.setString("table.exec.mini-batch.allow-latency", "5s")     config.set

?????? flink sql????????????

??minIdleStateRetentionTime ?? val tConfig = tableEnv.getConfig tConfig.setIdleStateRetentionTime(Time.minutes(5), Time.minutes(10)) 1.11.0??sql??sessionid groupby count(*)??sessionid1 minibatch???

?????? ?????? flink sql????????????

hi grouby count(*)?? --  -- ??: "user-zh"

????????????flink sql ????????????????

Dear all: ??sql?? https://github.com/wuchong/flink-sql-submit https://github.com/springMoon/sqlSubmit

flink sql????????

hi ??flink sqlkafka??event time5s??5s??waterwark?? WATERMARK FOR ts AS ts  - INTERVAL '5' SECODND ??

?????? flink sql????????

er-zh" https://ci.apache.org/projects/flink/flink-docs-master/dev/table/streaming/query_configuration.html#idle-state-retention-time ang <806040...@qq.com> ??2020??9??23?? 4:24?? > hi???? >

flink sql??????????????????????

??     flink sql??percentile    

flink sql??????????????????????

??     flink sql??percentile    

??????flink sql????????????????

??Kafka??schemacsv??json??avro??schema?? --  -- ??:

flink sql ????????????

flink sql+8,??

flink sql????????

streamTableEnv.getConfig().setLocalTimeZone(ZoneId.of("+8"))

?????? flink sql????????

streamTableEnv.getConfig().setLocalTimeZone(ZoneId.of("+8")) .   ,??,  --  -- ??:

flink sql

hi, ?? ??1.12flink sql ??datastream?,

Flink??????????????????????sql????????????

     flink??sql??sql?              example:       tEnv.registerDataStream("tableName", dataStream, "id, name, age ,time");       Table result

?????? flink sql??????????????????

FlinkSql WebIDE?? FlinkSQLSQL??SqlCli?? https://github.com/DataLinkDC/dlink --  -- ??: "todd"https://github.com/todd5

?????? Flink sql ????????????????

??lookup??on??key,?? ??batch --  -- ??:

flink sql????????????

hi??kafkaflink sqlmysql??Aid??tsjoin

??????Flink sql ??????????

https://github.com/DataLinkDC/dlink ?? --  -- ??: "user-zh"

?????? Flink sql ??????????

?? --  -- ??: "user-zh"

flink sql

各位大佬，请教一下如何使用flink sql实现DataStreaming的disableOperatorChaining功能 | | 小昌同学 | | ccc0606fight...@163.com |

flink sql ????????

hi all?? flink sql  count(disitinct)  ??bitmap ? java??set??

FLINK SQL????????????????????

?? kafkajson?? {"id":5,"price":40,"timestamp":1584942626828,"type":"math"} {"id":2,"price":70,"timestamp":1584942629638,"type":"math"} {"id":2,"price":70,"timestamp":1584942634951,"type":"math"} timestamp??13SQL??   -

Flink SQL????????

` FOR SYSTEM_TIME AS OF `a1`.`proctime` AS `a2` ON `a1`.`rowkey_room` = `a2`.`rowkey`      ??SQL??Flink SQL??   Caused by: org.apache.flink.table.api.SqlParserException: SQL parse failed. Encountered "`side_room`" at line 7, column 19.   Was expecting one of:

?????? Flink SQL????????

1.10 --  -- ??: "Jark Wu"

??????flink sql ??????????????

Hi     group by select floor_day_hour_5minutes(timestamp), count(1) from source table group by floor_day_hour_5minutes(timestamp) sqlretract???

??????flink sql ??????????????

Hi            ??EventTime?? --  -- ??: "steven chen"

Flink SQL ??????????????

Hi all ?? Flink ??1.10 Planner??old planner / blink planner ??Flink SQL source??Tuple2.of(1, "{\"name\": \"a\"}"); query??select a.id, a.name, a.name from (select id, body_json_to_map(name) as name from d

Flink sql ????????????

hi?? .. val tConfig = bstEnv.getConfigconfg.withIdleStateRetentionTime(Time.minutes(10),Time.minutes(25))..val q1=bstEnv.sqlQuery( """select createTime,feedid from source |where circleName is not null |and circleName not in('','_') |and action = 'C_FEED_ED

??Flink Sql ????????????????????????????

Hi,all: Flink sql ,??A??c1,c2,c3c1c4c1,c4,c2,c3. .

?????? ??Flink Sql ????????????????????????????

Hi, ??c1,c2,c3??c4 alter tablec4c1,c4,c2,c3?? ??. --  -- ??: "Jark Wu"

????flink sql????

Hi ??     ??flink sqlsource??kafka??sink??mysql?? ??mysql??keymysqlflink1.10??

?????? ????flink sql????

sinksink   --  -- ??: "Benchao Li"

?????? ????flink sql????

blink-planner??temporal table?? sqlinsert into mysql_sink select C.log_id, C.vic from (select A.log_id, case when B.cnt>0 and A.server>0 then B.cnt+1 else A.server end as vic from (select log_id, server, PROCTIME() as proctime from ka

flink sql??????????????????

??sql??  select day,            count(id),            sum(v1) from ( select            day ,           id ,           sum(v1) v1 from source       group by day,                    id )t group by day tConfig.setIdleStateRetentionTime(Time.minutes(1440),Ti

??Flink sql 1.10.0??????

Hi,all: Flink 1.10.0  sql??? .

flink sql eos

大家好 请问目前flink sql是不是不能没有开启全局端到端精确一致性（eos）的方 式， 目前仅有kafka实现了TwoPhaseCommitSinkFunction，但kafka的ddl中也没有属性去设 置Semantic为EXACTLY_ONCE 我们是否可以去支持更多的事务性connector，并可以在flink sql维度支持开启全局的 端到端一致性，并为每个connector是否支持EXACTLY_ONCE进行验证， 当开启全局EXACTLY_ONCE并且所有使用的connector都支持EXACTLY_ONCE，是否整个应 用程序就可以做到端到端

flink sql count????

?? sqlcountcountcount ??hive??count(if(name like '%',1 , null))??????flink sql??count??null flink1.10.1 blink  

??????flink sql count????

??sum??mysql??   --  -- ??: "user-zh"

??????flink sql count????

--  -- ??: "user-zh"

??????flink sql count????

?? --  -- ??: "user-zh"

??????flink sql count????

?? --  -- ??: "user-zh"

flink sql ????mysql????

hi?? ??mysql??20??insert into??insert?? insert intomysql?? insert into mysql select a,b c from kafka

?????? flink sql count????

count0 flinkcount??ifwhere?? ?? select count(if(name like '%',1 , null)) where name like '%'  or name

????????flink sql???????? result????????

?? ?? https://paste.ubuntu.com/p/Mx96MWjQ83/ result1?? ??

????????flink sql???????? result????????

?? ?? https://paste.ubuntu.com/p/Mx96MWjQ83/ result1?? ??

flink sql ????mysql ??????????

Hi All,     Ideaflink-jdbc-connectormysql, env.executeSql("select * from my_table").print() flink1.11.2

??????flink sql ????mysql ??????????

mysql --  -- ??: "??"

?????? flink sql ????mysql ??????????

Hi,   ??execute?? StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); EnvironmentSettings settings = EnvironmentSettings.newInstance().useAnyPlanner().inStreamingMode().build(); StreamTableEnvironment bsTableEnv = Stre

?????? flink sql ????mysql ??????????

Hi DEBUG??mysql --  -- ??: "user-zh"

flink sql 1.11.1

遇到的问题如下， flink版本1.11.1，sql client 中使用flink sql sql语句如下： CREATE TABLE sls_log_sz_itsp ( request STRING, http_bundleId STRING, upstream_addr STRING, http_appid STRING, bodyUserId STRING, http_sequence STRING, http_version STRING, response_body STRING, uri STRING, bytes_sent STRING, http_userId

Flink SQL????source ????

hi?? ??source table??topic??6??sinkinsert mysqlinsert source tablekafkakafka topic?

flink sql????????UpsertStreamTableSink

??     flink1.10??hbase Exception in thread "main" org.apache.flink.table.api.TableException: UpsertStreamTableSink requires that Table has a full primary keys if it is updated.     s""" |INSERT INTO ${databaseName}.response_time_sink |SE

flink sql????????UpsertStreamTableSink

??     flink1.10??hbase Exception in thread "main" org.apache.flink.table.api.TableException: UpsertStreamTableSink requires that Table has a full primary keys if it is updated.     s""" |INSERT INTO ${databaseName}.response_time_sink |SE

flink-sql????-??????????state

?? flink sql??cdccdc??state??  state?? val config: TableConfig = tabEnv.getConfig

??????????flink-sql????????????????????????????State????

flink??flink-on-yarn??jobTimeStamp>current_dateenv.setStateBackend(new MemoryStateBackend

flink sql hop????????????????????

??         flink1.10.1,??=-??

flink sql hop????????????????????

??         flink1.10.1,??=-?? SELECT |DATE_FORMAT(TIMESTAMPADD(HOUR, 8, HOP_START(proctime, INTERVAL '$slide' SECOND, INTERVAL '$size' MI

Re: flink sql

我做了。。 添加了一个sql语法类似 "select " + "msg," + "count(1) cnt" + " from test" + " where msg = 'hello' " + " group by TUMBLE(rowtime, INTERVAL '30' SECOND), msg " + " EMIT \n" + " WITH DELAY

?????? flink sql??????????????io??????????

https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/table/streaming/legacy.html#temporal-table-function-join flink sql?? temporal-table join io casel.chen

Flink SQL CodeGenException

Flink version: 1.12.0 在使用 Flink 执行 Flink SQL 流表 join 维表, 运行报错(流表SQL 和维表SQL单独运行都没有问题), 错误堆栈信息如下: Exception in thread "main" java.lang.RuntimeException: org.apache.flink.table.planner.codegen.CodeGenException: Unable to find common type of GeneratedExpression(field$18,isNull$17,,S

??????Flink SQL ????????????DynamoDB

https://flink-packages.org/packages/streaming-flink-dynamodb-connector --  -- ??: "user-zh"

Re:?????? flink sql??????????????????

thub.com/DataLinkDC/dlink > > > > >--  -- >??: "todd": 2021??6??16??(??) 5:48 >??: "user-zh": Re: flink sql?? > > > >?

?????? flink sql streaming????????????????????????

?? --  -- ??: "user-zh"

flink??sql??hdfs????????????????

flinksql??HDFS:part-c4a19762-bde3-4f37-8b3c-b92d182b450c-task-0-file-0 ??,flink??sql??hdfs ??  

??????flink-sql??????kafka ??????????????????????

--  -- ??: "user-zh"

flink sql????????????GroupWindowAggregate????????????????

HI???6?7??flink1.12??Sql??GroupWindowAggregateSql??GroupWindowAggregate CREATE TEMPORARY TABLE RawSource ( `key` STRING, `accessNum` INT, `status` STRING, rowTime TIMESTAMP(3), WATERMARK FOR rowTime AS rowTi

Re: flink sql

sonLee Replied Message | From | 小昌同学 | | Date | 03/3/2023 15:50 | | To | user-zh | | Subject | flink sql | 各位大佬，请教一下如何使用flink sql实现DataStreaming的disableOperatorChaining功能 | | 小昌同学 | | ccc0606fight...@163.com |

??Flink SQL??????????env.yaml

??Flink SQL ??yaml, hive??'\036' [root@server2 bin]# /home/hadoop/flink-1.7.2/bin/sql-client.sh embedded -e /home/hadoop/flink_tes

?????? ??Flink SQL??????????env.yaml

-- -- ??: "Zhenghua Gao"; : 2019??4??1??(??) 3:40 ??: "user-zh"; ????: Re: ??Flink SQL??env.yaml yaml?? ??yaml [1] yaml?

?????? ??Flink SQL??????????env.yaml

?? -- -- ??: "Zhenghua Gao"; : 2019??4??1??(??) 3:40 ??: "user-zh"; ????: Re: ??Flink SQL??env.yaml yaml?? ??yaml [1] yaml??

?????? ??Flink SQL??????????env.yaml

trategy type: fallback # "fallback" to global restart strategy by default # Deployment properties allow for describing the cluster to which table programsare submitted to. deployment: response-timeout: 5000

Flink sql count ??????????????

??:         flink??count         count([all] Expression | distinct Expression1 [, Expression2])         distinct?? select count(distinct a, b) from mytable

??????Flink sql count ??????????????

?? count(distinct ) , distinct a,b count(distinct concat(a,b)) | | apache22 | | apach...@163.com | ?? ??2020??2??26?? 18:21 ?? ??:         flink??count         coun

flink SQL ??OverWindow

Flink SQLOverWindow

Flink SQL????????????proctime()????????????????

Flink??1.10.0 ??BlinkPlanner??java??CSVproctime?? ??         tableEnv.connect(new FileSystem()                 .path("file:///Users/test/csv/demo.csv")         )                 .withFormat(new Csv())                 .withSchema(          

Flink SQL????????????proctime()????????????????

Flink??1.10.0 ??BlinkPlanner??java??CSVproctime?? ?? tableEnv.connect(new FileSystem() .path("file:///Users/test/csv/demo.csv") ) .withFormat(new Csv()) .withSchema(

?????????????? Flink SQL State ????????

hi! Flink SQL job state SQL??source ?? sink kafka ??5 server,reason role_id state

?????? ?????????????? Flink SQL State ????????

Hi, ?? --  -- ??: "Benchao Li"https://issues.apache.org/jira/browse/FLINK-17942 LakeShen

??????Flink SQL UDF ????????

Hi pbpb??schema(descriptor)??TypeInformationenv.addSource().returns()??TypeInformation??TypeInformation?? ??udfudf?

?????? Flink SQL UDF ????????

Hi +1??avro??json??formatpb??flink-protobuf??formats??git https://github.com/yangyichao-mango/flink-protobuf pb format Best, Yichao Yang --  -- ??: "Jark W

?????? Flink SQL UDF ????????

udfudf --  -- ??: "Benchao Li"

?????? Flink SQL UDF ????????

Hi Map Best, Yichao Yang --  -- ??: "kcz"<573693...@qq.com>; : 2020??6??9??(??) 4:49 ??: "user-zh"

?????? Flink SQL UDF ????????

map ??tks?? --  -- ??: "1048262223"<1048262...@qq.com>; : 2020??6??9??(??) 4:51 ??: "user-zh"

??Flink SQL????NULL??????????????????

Hi,all: Flink sql ??<>!=nullhive? hive. .

????????Flink SQL????NULL??????????????????

Hi ?? [1]http://apache-flink.147419.n8.nabble.com/flink-sql-null-false-td3640.html#a3658 Best, Yichao Yang --  -- ??: ""<153488...@qq.com>; : 2020??6??25??(??) 11:31 ??: "user-zh"

flink sql if ????????????

flink-1.10.1 blink_planner if Cannot apply 'IF' to arguments of type 'IF(

?????? flink sql if ????????????

tks  --  -- ??: "Benchao Li"

flink sql ??????kafka??????????????????????key??

hi??   flink sql ??kafka??key kafka connectorkey??  

?????? flink sql ??????kafka??????????????????????key??

tebackwithkey,value.Allfieldsofthekeyarepresentinthevalueaswell.>; > ?? 2020??7??717:01??op <520075...@qq.com> ?? > > hi?? > &nbsp; flink sql ??kafka??key > kafka connectorkey?? > > &nbsp;

Flink Sql 问题

你好

Re: flink sql eos

Hi > 目前仅有kafka实现了TwoPhaseCommitSinkFunction，但kafka的ddl中也没有属性去设 > 置Semantic为EXACTLY_ONCE 除了Kafka还有filesystem connector也是支持 EXACTLY ONCE的，kafka 的已经在1.12支持了[1] > 当开启全局EXACTLY_ONCE并且所有使用的connector都支持EXACTLY_ONCE，是否整个应 > 用程序就可以做到端到端的精确一致性 是的。 祝好 Leonard [1] https://issues.apache.org/jira/browse/F

Flink SQL No Watermark

大家好，请教一个问题 我有一条进行 session window 的 sql。这条 sql 消费较少数据量的 topic 的时候，是可以生成 watermark。消费大量的数据的时候，就无法生成watermark。 一直是No Watermark。 暂时找不到排查问题的思路。 Flink 版本号是 1.10，kafka 中消息是有时间的，其他的任务是可以拿到这个时间生成watermark。同时设置了 EventTime mode 模式，Blink Planner。 | No Watermark |

Flink SQL 问题;

你好 我用idea本地运行的jdbc sink没有问题。但是在服务器上运行报错如下 麻烦帮忙看下什么问题 是1.11 版本的 'connector'='jdbc' 'password'='' 'sink.buffer-flush.interval'='10s' 'sink.buffer-flush.max-rows'='500' 'table-name'='flink_test3' 'url'='jdbc:mysql://**:4000/test' 'username'='root' at org.apache.flink.table.factori

flink-sql 1.11??????????????????checkpoint??

enableCheckpointing??checkpoint??

?????? flink-sql 1.11??????????????????checkpoint??

savapoint??cancel?? --  -- ??: "user-zh"

Flink sql权限

请问，flink sql支持元数据的权限校验吗？例如使用hive catalog时，支持hive的权限检查？如果目前不支持，未来是否会考虑？

  1   2   3   4   5   6   7   8   9   10   >