[jira] [Commented] (FLINK-30321) Upgrade ZLIB of FRocksDB to 1.2.13
[ https://issues.apache.org/jira/browse/FLINK-30321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17707079#comment-17707079 ] songwenbin commented on FLINK-30321: Thank you very much for your answer. In flink1.16.1 , upgrade the frocksdbjni of the pom.xml of the flick-statebackend-rocksdb to 6.20.3-veverica-2.0 ,is is ok ? [~Yanfei Lei] > Upgrade ZLIB of FRocksDB to 1.2.13 > -- > > Key: FLINK-30321 > URL: https://issues.apache.org/jira/browse/FLINK-30321 > Project: Flink > Issue Type: Bug > Components: Runtime / State Backends >Affects Versions: 1.17.0 >Reporter: Yanfei Lei >Assignee: Yanfei Lei >Priority: Major > Fix For: 1.17.0 > > > In FRocksDB, the ZLIB version is 1.2.11, which may result in memory > corruption, see > [cve-2018-25032|https://nvd.nist.gov/vuln/detail/cve-2018-25032#vulnCurrentDescriptionTitle] > https://lists.apache.org/thread/rm40f45qfw6rls70k35o2dt0k4tz9bsr -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-30321) Upgrade ZLIB of FRocksDB to 1.2.13
[ https://issues.apache.org/jira/browse/FLINK-30321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17706669#comment-17706669 ] songwenbin commented on FLINK-30321: How do you solve the problem with cve-2018-25032 in Flink rockdb? [~Yanfei Lei] > Upgrade ZLIB of FRocksDB to 1.2.13 > -- > > Key: FLINK-30321 > URL: https://issues.apache.org/jira/browse/FLINK-30321 > Project: Flink > Issue Type: Bug > Components: Runtime / State Backends >Affects Versions: 1.17.0 >Reporter: Yanfei Lei >Assignee: Yanfei Lei >Priority: Major > Fix For: 1.17.0 > > > In FRocksDB, the ZLIB version is 1.2.11, which may result in memory > corruption, see > [cve-2018-25032|https://nvd.nist.gov/vuln/detail/cve-2018-25032#vulnCurrentDescriptionTitle] > https://lists.apache.org/thread/rm40f45qfw6rls70k35o2dt0k4tz9bsr -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-28672) properties.allow.auto.create.topics disable
[
https://issues.apache.org/jira/browse/FLINK-28672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
songwenbin updated FLINK-28672:
---
Description:
# 配置了'properties.allow.auto.create.topics' =
'false'，但job执行后都会创建出mocktest27的topic
CREATE TABLE interval_source7 (
item STRING,
val DOUBLE,
is_energy BIGINT,
ts BIGINT,
event_time AS TO_TIMESTAMP_LTZ(ts, 3),
process_time AS PROCTIME(),
WATERMARK FOR event_time AS event_time)
WITH ('connector' = 'kafka', 'topic' = 'daily-consumption',
'properties.bootstrap.servers' = 'broker:9092','properties.group.id' =
'l3_daily-consumption_mocktest','value.format' =
'avro-confluent','value.avro-confluent.schema-registry.url' =
'http://schema-registry:8081','value.fields-include' = 'EXCEPT_KEY',
'scan.startup.mode' = 'earliest-offset');
CREATE TABLE interval_consumption_sink7 (
item STRING,
val DOUBLE,
ts BIGINT,
isEnergy BIGINT,
nodeId INTEGER,
siteId INTEGER,
shiftId INTEGER,
shiftTime BIGINT,
PRIMARY KEY (item, ts) NOT ENFORCED)
WITH ('connector' = 'upsert-kafka','topic' =
'mocktest27','properties.allow.auto.create.topics' = 'false'
,'properties.bootstrap.servers' = 'broker:9092', 'key.format' =
'avro-confluent', 'key.avro-confluent.schema-registry.url' =
'http://schema-registry:8081','value.format' = 'avro-confluent',
'value.avro-confluent.schema-registry.url' = 'http://schema-registry:8081');
INSERT INTO interval_consumption_sink7
SELECT
item,
val,
ts,
1 AS is_energy,
2,
3,
4,
1
FROM interval_source7 ;
was:
配置了'properties.allow.auto.create.topics' = 'false'，但job执行后都会创建出mocktest27的topic
CREATE TABLE interval_source7 (
item STRING,
val DOUBLE,
is_energy BIGINT,
ts BIGINT,
event_time AS TO_TIMESTAMP_LTZ(ts, 3),
process_time AS PROCTIME(),
WATERMARK FOR event_time AS event_time)
WITH ('connector' = 'kafka', 'topic' = 'daily-consumption',
'properties.bootstrap.servers' = 'broker:9092','properties.group.id' =
'l3_daily-consumption_mocktest','value.format' =
'avro-confluent','value.avro-confluent.schema-registry.url' =
'http://schema-registry:8081','value.fields-include' = 'EXCEPT_KEY',
'scan.startup.mode' = 'earliest-offset');
CREATE TABLE interval_consumption_sink7 (
item STRING,
val DOUBLE,
ts BIGINT,
isEnergy BIGINT,
nodeId INTEGER,
siteId INTEGER,
shiftId INTEGER,
shiftTime BIGINT,
PRIMARY KEY (item, ts) NOT ENFORCED)
WITH ('connector' = 'upsert-kafka','topic' =
'mocktest27','properties.allow.auto.create.topics' = 'false'
,'properties.bootstrap.servers' = 'broker:9092', 'key.format' =
'avro-confluent', 'key.avro-confluent.schema-registry.url' =
'http://schema-registry:8081','value.format' = 'avro-confluent',
'value.avro-confluent.schema-registry.url' = 'http://schema-registry:8081');
INSERT INTO interval_consumption_sink7
SELECT
item,
val,
ts,
1 AS is_energy,
2,
3,
4,
1
FROM interval_source7 ;
> properties.allow.auto.create.topics disable
> ---
>
> Key: FLINK-28672
> URL: https://issues.apache.org/jira/browse/FLINK-28672
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Runtime
>Affects Versions: 1.13.6
>Reporter: songwenbin
>Priority: Major
>
> # 配置了'properties.allow.auto.create.topics' =
> 'false'，但job执行后都会创建出mocktest27的topic
> CREATE TABLE interval_source7 (
> item STRING,
> val DOUBLE,
> is_energy BIGINT,
> ts BIGINT,
> event_time AS TO_TIMESTAMP_LTZ(ts, 3),
> process_time AS PROCTIME(),
> WATERMARK FOR event_time AS event_time)
> WITH ('connector' = 'kafka', 'topic' = 'daily-consumption',
> 'properties.bootstrap.servers' = 'broker:9092','properties.group.id' =
> 'l3_daily-consumption_mocktest','value.format' =
> 'avro-confluent','value.avro-confluent.schema-registry.url' =
> 'http://schema-registry:8081','value.fields-include' = 'EXCEPT_KEY',
> 'scan.startup.mode' = 'earliest-offset');
> CREATE TABLE interval_consumption_sink7 (
> item STRING,
> val DOUBLE,
> ts BIGINT,
> isEnergy BIGINT,
> nodeId INTEGER,
> siteId INTEGER,
> shiftId INTEGER,
> shiftTime BIGINT,
> PRIMARY KEY (item, ts) NOT ENFORCED)
> WITH ('connector' = 'upsert-kafka','topic' =
> 'mocktest27','properties.allow.auto.create.topics' = 'false'
[jira] [Updated] (FLINK-28672) properties.allow.auto.create.topics disable
[
https://issues.apache.org/jira/browse/FLINK-28672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
songwenbin updated FLINK-28672:
---
Summary: properties.allow.auto.create.topics disable (was:
properties.allow.auto.create.topics无效)
> properties.allow.auto.create.topics disable
> ---
>
> Key: FLINK-28672
> URL: https://issues.apache.org/jira/browse/FLINK-28672
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Runtime
>Affects Versions: 1.13.6
>Reporter: songwenbin
>Priority: Major
>
> 配置了'properties.allow.auto.create.topics' =
> 'false'，但job执行后都会创建出mocktest27的topic
> CREATE TABLE interval_source7 (
> item STRING,
> val DOUBLE,
> is_energy BIGINT,
> ts BIGINT,
> event_time AS TO_TIMESTAMP_LTZ(ts, 3),
> process_time AS PROCTIME(),
> WATERMARK FOR event_time AS event_time)
> WITH ('connector' = 'kafka', 'topic' = 'daily-consumption',
> 'properties.bootstrap.servers' = 'broker:9092','properties.group.id' =
> 'l3_daily-consumption_mocktest','value.format' =
> 'avro-confluent','value.avro-confluent.schema-registry.url' =
> 'http://schema-registry:8081','value.fields-include' = 'EXCEPT_KEY',
> 'scan.startup.mode' = 'earliest-offset');
> CREATE TABLE interval_consumption_sink7 (
> item STRING,
> val DOUBLE,
> ts BIGINT,
> isEnergy BIGINT,
> nodeId INTEGER,
> siteId INTEGER,
> shiftId INTEGER,
> shiftTime BIGINT,
> PRIMARY KEY (item, ts) NOT ENFORCED)
> WITH ('connector' = 'upsert-kafka','topic' =
> 'mocktest27','properties.allow.auto.create.topics' = 'false'
> ,'properties.bootstrap.servers' = 'broker:9092', 'key.format' =
> 'avro-confluent', 'key.avro-confluent.schema-registry.url' =
> 'http://schema-registry:8081','value.format' = 'avro-confluent',
> 'value.avro-confluent.schema-registry.url' = 'http://schema-registry:8081');
> INSERT INTO interval_consumption_sink7
> SELECT
> item,
> val,
> ts,
> 1 AS is_energy,
> 2,
> 3,
> 4,
> 1
> FROM interval_source7 ;
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (FLINK-28672) properties.allow.auto.create.topics无效
songwenbin created FLINK-28672:
--
Summary: properties.allow.auto.create.topics无效
Key: FLINK-28672
URL: https://issues.apache.org/jira/browse/FLINK-28672
Project: Flink
Issue Type: Bug
Components: Table SQL / Runtime
Affects Versions: 1.13.6
Reporter: songwenbin
配置了'properties.allow.auto.create.topics' = 'false'，但job执行后都会创建出mocktest27的topic
CREATE TABLE interval_source7 (
item STRING,
val DOUBLE,
is_energy BIGINT,
ts BIGINT,
event_time AS TO_TIMESTAMP_LTZ(ts, 3),
process_time AS PROCTIME(),
WATERMARK FOR event_time AS event_time)
WITH ('connector' = 'kafka', 'topic' = 'daily-consumption',
'properties.bootstrap.servers' = 'broker:9092','properties.group.id' =
'l3_daily-consumption_mocktest','value.format' =
'avro-confluent','value.avro-confluent.schema-registry.url' =
'http://schema-registry:8081','value.fields-include' = 'EXCEPT_KEY',
'scan.startup.mode' = 'earliest-offset');
CREATE TABLE interval_consumption_sink7 (
item STRING,
val DOUBLE,
ts BIGINT,
isEnergy BIGINT,
nodeId INTEGER,
siteId INTEGER,
shiftId INTEGER,
shiftTime BIGINT,
PRIMARY KEY (item, ts) NOT ENFORCED)
WITH ('connector' = 'upsert-kafka','topic' =
'mocktest27','properties.allow.auto.create.topics' = 'false'
,'properties.bootstrap.servers' = 'broker:9092', 'key.format' =
'avro-confluent', 'key.avro-confluent.schema-registry.url' =
'http://schema-registry:8081','value.format' = 'avro-confluent',
'value.avro-confluent.schema-registry.url' = 'http://schema-registry:8081');
INSERT INTO interval_consumption_sink7
SELECT
item,
val,
ts,
1 AS is_energy,
2,
3,
4,
1
FROM interval_source7 ;
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] songwenbin updated FLINK-27888: --- Description: In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it execute error : Cannot determine simple type name 'org' . But in Flink1.14 or flink1.15 ,it 's fine. was: In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it execute error : Cannot determine simple type name 'org' . Flink1.14 or flink1.15 is fine. > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: flink-demo-1.0-SNAPSHOT.jar, > flink_demo_jar_content_list.jpg, flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > But in Flink1.14 or flink1.15 ,it 's fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] songwenbin updated FLINK-27888: --- Description: In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it execute error : Cannot determine simple type name 'org' . But in Flink1.14 or flink1.15 ,it 's ok. was: In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it execute error : Cannot determine simple type name 'org' . But in Flink1.14 or flink1.15 ,it 's fine. > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: flink-demo-1.0-SNAPSHOT.jar, > flink_demo_jar_content_list.jpg, flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > But in Flink1.14 or flink1.15 ,it 's ok. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Comment Edited] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17551641#comment-17551641 ] songwenbin edited comment on FLINK-27888 at 6/8/22 1:58 PM: !flink_demo_jar_content_list.jpg! I updated new flink-demo-1.0-SNAPSHOT.jar to attachment. Thank you . was (Author: JIRAUSER290361): I updated new flink-demo-1.0-SNAPSHOT.jar to attachment. Thank you . > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: flink-demo-1.0-SNAPSHOT.jar, > flink_demo_jar_content_list.jpg, flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > Flink1.14 or flink1.15 is fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Comment Edited] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17551641#comment-17551641 ] songwenbin edited comment on FLINK-27888 at 6/8/22 1:58 PM: I updated new flink-demo-1.0-SNAPSHOT.jar to attachment. Thank you . !flink_demo_jar_content_list.jpg! was (Author: JIRAUSER290361): !flink_demo_jar_content_list.jpg! I updated new flink-demo-1.0-SNAPSHOT.jar to attachment. Thank you . > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: flink-demo-1.0-SNAPSHOT.jar, > flink_demo_jar_content_list.jpg, flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > Flink1.14 or flink1.15 is fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] songwenbin updated FLINK-27888: --- Attachment: flink_demo_jar_content_list.jpg > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: flink-demo-1.0-SNAPSHOT.jar, > flink_demo_jar_content_list.jpg, flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > Flink1.14 or flink1.15 is fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Comment Edited] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17551641#comment-17551641 ] songwenbin edited comment on FLINK-27888 at 6/8/22 1:57 PM: I updated new flink-demo-1.0-SNAPSHOT.jar to attachment. Thank you . was (Author: JIRAUSER290361): I updated new flink-demo-1.0-SNAPSHOT.jar to attachment. Thank you . !6.jpg! > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: flink-demo-1.0-SNAPSHOT.jar, > flink_demo_jar_content_list.jpg, flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > Flink1.14 or flink1.15 is fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] songwenbin updated FLINK-27888: --- Attachment: (was: 6.jpg) > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: flink-demo-1.0-SNAPSHOT.jar, flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > Flink1.14 or flink1.15 is fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Commented] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17551641#comment-17551641 ] songwenbin commented on FLINK-27888: I updated new flink-demo-1.0-SNAPSHOT.jar to attachment. Thank you . !6.jpg! > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: 6.jpg, flink-demo-1.0-SNAPSHOT.jar, > flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > Flink1.14 or flink1.15 is fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] songwenbin updated FLINK-27888: --- Attachment: 6.jpg > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: 6.jpg, flink-demo-1.0-SNAPSHOT.jar, > flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > Flink1.14 or flink1.15 is fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] songwenbin updated FLINK-27888: --- Attachment: flink-demo-1.0-SNAPSHOT.jar > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: flink-demo-1.0-SNAPSHOT.jar, flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > Flink1.14 or flink1.15 is fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] songwenbin updated FLINK-27888: --- Attachment: (was: flink-sql-demo-1.0-SNAPSHOT.jar) > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: flink_not_contain_jar.png > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > Flink1.14 or flink1.15 is fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (FLINK-27888) SQL Error in Flink1.15
[
https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
songwenbin updated FLINK-27888:
---
Docs Text:
In Flink1.15
1. put attachment jar to directory: ./flink-release-1.15/build-target/lib/ ,
eg: ./flink-release-1.15/build-target/lib/flink-demo-1.0-SNAPSHOT.jar
2. start flink local cluster:
./flink-release-1.15/build-target/start-cluster.sh
3. start sql-client：./flink-release-1.15/build-target/sql-client.sh
4. step by step exec below sql script in sql-client:
CREATE FUNCTION ddd AS 'org.example.SumHopWindowUpsertVal';
CREATE TABLE monthly_source_5 (
itemSTRING,
val DOUBLE,
ts BIGINT,
isEnergyBIGINT,
shiftId INTEGER,
eventTime BIGINT,
event_time AS TO_TIMESTAMP_LTZ(eventTime, 3),
process_timeAS PROCTIME(),
projectId AS 1,
WATERMARK FOR event_time AS event_time)
WITH ('connector' = 'kafka','topic' =
'daily-consumption','properties.bootstrap.servers' =
'KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS', 'properties.group.id' =
'poem-consumergroup-flink-v2', 'value.format' = 'json','scan.startup.mode' =
'latest-offset');
CREATE VIEW daily_last_value_with_monthly_frame5 AS
SELECT
item AS tag,
val,
ts,
process_time,
isEnergy,
eventTime,
event_time,
1 AS frame
FROM monthly_source_5
WHERE shiftId =0;
CREATE VIEW energy_monthly_consumptions5 AS
SELECT
tag,
ts AS ts,
1 AS monthFrameTs,
val AS val,
eventTime,
event_time,
isEnergy
FROM daily_last_value_with_monthly_frame5;
CREATE VIEW monthly_consumption_result_10 AS
SELECT
tag AS tag,
monthFrameTsAS ts,
ddd(
ts,
val,
monthFrameTs) AS val,
MAX(eventTime) AS eventTime,
1 AS isEnergy
FROM TABLE(
HOP(TABLE energy_monthly_consumptions5, DESCRIPTOR(event_time),
INTERVAL '1' DAYS, INTERVAL '31' DAYS))
WHERE isEnergy = 1
GROUP BY tag, monthFrameTs, window_start, window_end;
select * from monthly_consumption_result_10;
was:
In Flink1.15
1. put attachment jar to directory: ./flink-release-1.15/build-target/lib/ ,
eg: ./flink-release-1.15/build-target/lib/flink-demo-1.0-SNAPSHOT.jar
2. start flink local cluster:
./flink-release-1.15/build-target/start-cluster.sh
3. start sql-client：./flink-release-1.15/build-target/sql-client.sh
4. step by step exec below sql script in sql-client:
SET 'execution.runtime-mode' = 'streaming';
CREATE FUNCTION ddd AS 'org.example.SumHopWindowUpsertVal';
CREATE TABLE monthly_source_5 (
itemSTRING,
val DOUBLE,
ts BIGINT,
isEnergyBIGINT,
shiftId INTEGER,
eventTime BIGINT,
event_time AS TO_TIMESTAMP_LTZ(eventTime, 3),
process_timeAS PROCTIME(),
projectId AS 1,
WATERMARK FOR event_time AS event_time)
WITH ('connector' = 'kafka','topic' =
'daily-consumption','properties.bootstrap.servers' =
'KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS', 'properties.group.id' =
'poem-consumergroup-flink-v2', 'value.format' = 'json','scan.startup.mode' =
'latest-offset');
CREATE VIEW daily_last_value_with_monthly_frame5 AS
SELECT
item AS tag,
val,
ts,
process_time,
isEnergy,
eventTime,
event_time,
1 AS frame
FROM monthly_source_5
WHERE shiftId =0;
CREATE VIEW energy_monthly_consumptions5 AS
SELECT
tag,
ts AS ts,
1 AS monthFrameTs,
val AS val,
eventTime,
event_time,
isEnergy
FROM daily_last_value_with_monthly_frame5;
CREATE VIEW monthly_consumption_result_10 AS
SELECT
tag AS tag,
monthFrameTsAS ts,
ddd(
ts,
val,
monthFrameTs) AS val,
MAX(eventTime) AS eventTime,
1 AS isEnergy
FROM TABLE(
HOP(TABLE energy_monthly_consumptions5, DESCRIPTOR(event_time),
INTERVAL '1' DAYS, INTERVAL '31' DAYS))
WHERE isEnergy = 1
GROUP BY tag, monthFrameTs, window_start, window_end;
select * from monthly_consumption_result_10;
> SQL Error in Flink1.15
> --
>
> Key: FLINK-27888
> URL: https://issues.apache.org/jira/browse/FLINK-27888
> Project: Flink
>
[jira] [Updated] (FLINK-27888) SQL Error in Flink1.15
[
https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
songwenbin updated FLINK-27888:
---
Docs Text:
In Flink1.15
1. put attachment jar to directory: ./flink-release-1.15/build-target/lib/ ,
eg: ./flink-release-1.15/build-target/lib/flink-demo-1.0-SNAPSHOT.jar
2. start flink local cluster:
./flink-release-1.15/build-target/start-cluster.sh
3. start sql-client：./flink-release-1.15/build-target/sql-client.sh
4. run below sql script in sql-client:
CREATE FUNCTION ddd AS 'org.example.SumHopWindowUpsertVal';
CREATE TABLE monthly_source_5 (
itemSTRING,
val DOUBLE,
ts BIGINT,
isEnergyBIGINT,
shiftId INTEGER,
eventTime BIGINT,
event_time AS TO_TIMESTAMP_LTZ(eventTime, 3),
process_timeAS PROCTIME(),
projectId AS 1,
WATERMARK FOR event_time AS event_time)
WITH ('connector' = 'kafka','topic' =
'daily-consumption','properties.bootstrap.servers' =
'KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS', 'properties.group.id' =
'poem-consumergroup-flink-v2', 'value.format' = 'json','scan.startup.mode' =
'latest-offset');
CREATE VIEW daily_last_value_with_monthly_frame5 AS
SELECT
item AS tag,
val,
ts,
process_time,
isEnergy,
eventTime,
event_time,
1 AS frame
FROM monthly_source_5
WHERE shiftId =0;
CREATE VIEW energy_monthly_consumptions5 AS
SELECT
tag,
ts AS ts,
1 AS monthFrameTs,
val AS val,
eventTime,
event_time,
isEnergy
FROM daily_last_value_with_monthly_frame5;
CREATE VIEW monthly_consumption_result_10 AS
SELECT
tag AS tag,
monthFrameTsAS ts,
ddd(
ts,
val,
monthFrameTs) AS val,
MAX(eventTime) AS eventTime,
1 AS isEnergy
FROM TABLE(
HOP(TABLE energy_monthly_consumptions5, DESCRIPTOR(event_time),
INTERVAL '1' DAYS, INTERVAL '31' DAYS))
WHERE isEnergy = 1
GROUP BY tag, monthFrameTs, window_start, window_end;
select * from monthly_consumption_result_10;
was:
In Flink1.15
1. put attachment jar to directory: ./flink-release-1.15/build-target/lib/ ,
eg: ./flink-release-1.15/build-target/lib/flink-demo-1.0-SNAPSHOT.jar
2. start flink local cluster:
./flink-release-1.15/build-target/start-cluster.sh
3. start sql-client：./flink-release-1.15/build-target/sql-client.sh
4. step by step exec below sql script in sql-client:
CREATE FUNCTION ddd AS 'org.example.SumHopWindowUpsertVal';
CREATE TABLE monthly_source_5 (
itemSTRING,
val DOUBLE,
ts BIGINT,
isEnergyBIGINT,
shiftId INTEGER,
eventTime BIGINT,
event_time AS TO_TIMESTAMP_LTZ(eventTime, 3),
process_timeAS PROCTIME(),
projectId AS 1,
WATERMARK FOR event_time AS event_time)
WITH ('connector' = 'kafka','topic' =
'daily-consumption','properties.bootstrap.servers' =
'KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS', 'properties.group.id' =
'poem-consumergroup-flink-v2', 'value.format' = 'json','scan.startup.mode' =
'latest-offset');
CREATE VIEW daily_last_value_with_monthly_frame5 AS
SELECT
item AS tag,
val,
ts,
process_time,
isEnergy,
eventTime,
event_time,
1 AS frame
FROM monthly_source_5
WHERE shiftId =0;
CREATE VIEW energy_monthly_consumptions5 AS
SELECT
tag,
ts AS ts,
1 AS monthFrameTs,
val AS val,
eventTime,
event_time,
isEnergy
FROM daily_last_value_with_monthly_frame5;
CREATE VIEW monthly_consumption_result_10 AS
SELECT
tag AS tag,
monthFrameTsAS ts,
ddd(
ts,
val,
monthFrameTs) AS val,
MAX(eventTime) AS eventTime,
1 AS isEnergy
FROM TABLE(
HOP(TABLE energy_monthly_consumptions5, DESCRIPTOR(event_time),
INTERVAL '1' DAYS, INTERVAL '31' DAYS))
WHERE isEnergy = 1
GROUP BY tag, monthFrameTs, window_start, window_end;
select * from monthly_consumption_result_10;
> SQL Error in Flink1.15
> --
>
> Key: FLINK-27888
> URL: https://issues.apache.org/jira/browse/FLINK-27888
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Runtime
[jira] [Updated] (FLINK-27888) SQL Error in Flink1.15
[ https://issues.apache.org/jira/browse/FLINK-27888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] songwenbin updated FLINK-27888: --- Summary: SQL Error in Flink1.15 (was: Flink SQL execute error in Flink1.15) > SQL Error in Flink1.15 > -- > > Key: FLINK-27888 > URL: https://issues.apache.org/jira/browse/FLINK-27888 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Affects Versions: 1.15.0 > Environment: mac os , linux >Reporter: songwenbin >Priority: Major > Attachments: flink-sql-demo-1.0-SNAPSHOT.jar > > > In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it > execute error : Cannot determine simple type name 'org' . > Flink1.14 or flink1.15 is fine. > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27888) Flink SQL execute error in Flink1.15
songwenbin created FLINK-27888: -- Summary: Flink SQL execute error in Flink1.15 Key: FLINK-27888 URL: https://issues.apache.org/jira/browse/FLINK-27888 Project: Flink Issue Type: Bug Components: Table SQL / Runtime Affects Versions: 1.15.0 Environment: mac os , linux Reporter: songwenbin Attachments: flink-sql-demo-1.0-SNAPSHOT.jar In flink1.15 , if sql include UDF(AggregateFunction) and HOP windown , it execute error : Cannot determine simple type name 'org' . Flink1.14 or flink1.15 is fine. -- This message was sent by Atlassian Jira (v8.20.7#820007)
