Flink1.14 table api & sql针对递增维度聚合 ttl是如何处理的

2021-12-10 文章 guanyq
请大佬指导下: 需求: 通过flink sql 统计每天各个省份的订单受理量,显然这种维度统计时递增,如何设置ttl,只想让维度存储1周的数据。 维度递增很可能会导致内存溢出,请教下flink sql ttl 配置在官网哪里有说明么。

Re:flink本地编译卡住

2021-12-10 文章 Yuepeng Pan
图片挂掉了,可以放到图床或者附带一些原提示信息。 在 2021-12-11 11:19:51,"Jeff" 写道: 根据官方建议的maven打包命令: mvm install -Dfast -DskipTests -Dscalla-2.12 -T 1C ,但我在本地编译打包总是卡在flink-table-runtim-blink这里,也没有错误提示,如下图: 请问有什么处理方法么?

flink本地编译卡住

2021-12-10 文章 Jeff
根据官方建议的maven打包命令: mvm install -Dfast -DskipTests -Dscalla-2.12 -T 1C ,但我在本地编译打包总是卡在flink-table-runtim-blink这里,也没有错误提示,如下图: 请问有什么处理方法么?

flinksql????????

2021-12-10 文章 ??????
??      flinksqlA_now:AA_now??A?? //sql StatementSet stmtSet = tenv.createStatementSet () ; stmtSet.addInsertSql ( insertSqlMongoDB ) ; stmtSet.addInsertSql ( insertSql ) ;

Re: [DISCUSS] Change some default config values of blocking shuffle

2021-12-10 文章 刘建刚
Glad to see the suggestion. In our test, we found that small jobs with the changing configs can not improve the performance much just as your test. I have some suggestions: - The config can affect the memory usage. Will the related memory configs be changed? - Can you share the tpcds resu

Re: [DISCUSS] Change some default config values of blocking shuffle

2021-12-10 文章 Yun Gao
Hi Yingjie, Very thanks for drafting the FLIP and initiating the discussion! May I have a double confirmation for taskmanager.network.sort-shuffle.min-parallelism that since other frameworks like Spark have used sort-based shuffle for all the cases, does our current circumstance still have dif

Re: [DISCUSS] Change some default config values of blocking shuffle

2021-12-10 文章 Yingjie Cao
Hi dev & users: I have created a FLIP [1] for it, feedbacks are highly appreciated. Best, Yingjie [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-199%3A+Change+some+default+config+values+of+blocking+shuffle+for+better+usability Yingjie Cao 于2021年12月3日周五 17:02写道: > Hi dev & users, >