[jira] [Commented] (FLINK-17226) Remove Prometheus relocations
[ https://issues.apache.org/jira/browse/FLINK-17226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086729#comment-17086729 ] molsion commented on FLINK-17226: - [~chesnay] I don't quite understand the question, can you make it clear?thx > Remove Prometheus relocations > - > > Key: FLINK-17226 > URL: https://issues.apache.org/jira/browse/FLINK-17226 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Metrics >Reporter: Chesnay Schepler >Priority: Major > Fix For: 1.11.0 > > > Now that we load the Prometheus reporters as plugins we should remove the > shade-plugin configuration/relocations. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-17229) Add a flink-sql-client-sdk module
[ https://issues.apache.org/jira/browse/FLINK-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086716#comment-17086716 ] molsion commented on FLINK-17229: - [~godfreyhe], thank you for your answer, but is flink-sql-gateway necessary? Why does the SDK not directly access the cluster but go through the gateway > Add a flink-sql-client-sdk module > -- > > Key: FLINK-17229 > URL: https://issues.apache.org/jira/browse/FLINK-17229 > Project: Flink > Issue Type: Improvement > Components: Table SQL / API, Table SQL / Client >Reporter: molsion >Priority: Major > > can we add a flink-sql-client-sdk module that can import like jdbc(sdk)？ If > we do it , our user can use flink-sql-client-sdk to sumit sql job . it will > be more friendly than flink-sql-gateway。 > I have created and implemented a flink-sql-client-sdk project and i want to > contribute to community。 > > [flink-sql-gateway : > https://github.com/ververica/flink-sql-gateway|https://github.com/ververica/flink-sql-gateway] > [flink-sql-client-sdk : > https://github.com/molsionmo/flink-sql-client|https://github.com/molsionmo/flink-sql-client] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-17229) Add a flink-sql-client-sdk module
molsion created FLINK-17229: --- Summary: Add a flink-sql-client-sdk module Key: FLINK-17229 URL: https://issues.apache.org/jira/browse/FLINK-17229 Project: Flink Issue Type: Improvement Components: Table SQL / API, Table SQL / Client Reporter: molsion can we add a flink-sql-client-sdk module that can import like jdbc(sdk)？ If we do it , our user can use flink-sql-client-sdk to sumit sql job . it will be more friendly than flink-sql-gateway。 I have created and implemented a flink-sql-client-sdk project and i want to contribute to community。 [flink-sql-gateway : https://github.com/ververica/flink-sql-gateway|https://github.com/ververica/flink-sql-gateway] [flink-sql-client-sdk : https://github.com/molsionmo/flink-sql-client|https://github.com/molsionmo/flink-sql-client] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-16962) Convert DatadogReporter to plugin
[ https://issues.apache.org/jira/browse/FLINK-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083802#comment-17083802 ] molsion commented on FLINK-16962: - If no one can deal with the issue, can you assign it to me? > Convert DatadogReporter to plugin > - > > Key: FLINK-16962 > URL: https://issues.apache.org/jira/browse/FLINK-16962 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Metrics >Reporter: Chesnay Schepler >Priority: Major > Fix For: 1.11.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-16967) Convert Slf4j reporter to plugin
[ https://issues.apache.org/jira/browse/FLINK-16967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083798#comment-17083798 ] molsion commented on FLINK-16967: - If no one work for this issue , i can work it. > Convert Slf4j reporter to plugin > > > Key: FLINK-16967 > URL: https://issues.apache.org/jira/browse/FLINK-16967 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Metrics >Reporter: Chesnay Schepler >Priority: Major > Fix For: 1.11.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-13690) Connectors/JDBC LookupFunction getFieldFromResultSet BUG
[
https://issues.apache.org/jira/browse/FLINK-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
molsion updated FLINK-13690:
Description:
JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
this method have a bug, ResultSet.wasNull() reports whether the last column
read had a value of SQL NULL, {color:#ff}NOT the current column ,
{color:#33}when one colums's value is null then all colums value behind it
will be null , even if they are not null{color}{color}
*bug scene:*
{color:#33}1. I want to join a dimension table, column is {color}
{code:java}
Id (INT), ProjectType(INT), Desp(VARCHAR),ProjectName(VARCHAR)
{code}
2. select from database table is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":"ProjectName"}
{code}
3.
org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
return the row is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":NULL}{code}
beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
when index = 3, ResultSet.wasNull is true, then value of column ProjectName is
null
this operator will influence next opertator , then i can not get the column
ProjectName.
*Bug Fix:*
org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix NULL
judge to fix this bug
was:
JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
this method have a bug, ResultSet.wasNull() reports whether the last column
read had a value of SQL NULL, {color:#ff}NOT the current column
,{color:#33} when one colums's value is null then all colums value behind
it will be null , even if they are not null{color}{color}
*{color:#33}bug scene:{color}*
{color:#33}1. I want to join a dimension table, column is {color}
{code:java}
Id (INT), ProjectType(INT), Desp(VARCHAR),ProjectName(VARCHAR)
{code}
2. select from database table is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":"ProjectName"}
{code}
3.
org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
return the row is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":NULL}{code}
beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
when index = 3, ResultSet.wasNull is true, then value of column ProjectName is
null
this operator will influence next opertator , then i can not get the column
ProjectName.
*Bug Fix:*
org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix NULL
judge to fix this bug
> Connectors/JDBC LookupFunction getFieldFromResultSet BUG
>
>
> Key: FLINK-13690
> URL: https://issues.apache.org/jira/browse/FLINK-13690
> Project: Flink
> Issue Type: Bug
> Components: Connectors / JDBC
>Affects Versions: 1.8.0, 1.9.0
>Reporter: molsion
>Assignee: molsion
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
> this method have a bug, ResultSet.wasNull() reports whether the last column
> read had a value of SQL NULL, {color:#ff}NOT the current column ,
> {color:#33}when one colums's value is null then all colums value behind
> it will be null , even if they are not null{color}{color}
>
> *bug scene:*
> {color:#33}1. I want to join a dimension table, column is {color}
> {code:java}
> Id (INT), ProjectType(INT), Desp(VARCHAR),ProjectName(VARCHAR)
> {code}
>
> 2. select from database table is
> {code:java}
> {"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":"ProjectName"}
> {code}
>
> 3.
> org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
> return the row is
> {code:java}
> {"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":NULL}{code}
> beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
> when index = 3, ResultSet.wasNull is true, then value of column ProjectName
> is null
>
> this operator will influence next opertator , then i can not get the column
> ProjectName.
>
> *Bug Fix:*
> org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix
> NULL judge to fix this bug
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Updated] (FLINK-13690) Connectors/JDBC LookupFunction getFieldFromResultSet BUG
[
https://issues.apache.org/jira/browse/FLINK-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
molsion updated FLINK-13690:
Description:
JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
this method have a bug, ResultSet.wasNull() reports whether the last column
read had a value of SQL NULL, {color:#ff}NOT the current column
,{color:#33} when one colums's value is null then all colums value behind
it will be null , even if they are not null{color}{color}
*{color:#33}bug scene:{color}*
{color:#33}1. I want to join a dimension table, column is {color}
{code:java}
Id (INT), ProjectType(INT), Desp(VARCHAR),ProjectName(VARCHAR)
{code}
2. select from database table is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":"ProjectName"}
{code}
3.
org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
return the row is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":NULL}{code}
beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
when index = 3, ResultSet.wasNull is true, then value of column ProjectName is
null
this operator will influence next opertator , then i can not get the column
ProjectName.
*Bug Fix:*
org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix NULL
judge to fix this bug
was:
JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
this method have a bug, ResultSet.wasNull() reports whether the last column
read had a value of SQL NULL, {color:#ff}NOT the current column {color}
*{color:#33}bug scene:{color}*
{color:#33}1. I want to join a dimension table, column is {color}
{code:java}
Id (INT), ProjectType(INT), Desp(VARCHAR),ProjectName(VARCHAR)
{code}
2. select from database table is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":"ProjectName"}
{code}
3.
org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
return the row is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":NULL}{code}
beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
when index = 3, ResultSet.wasNull is true, then value of column ProjectName is
null
this operator will influence next opertator , then i can not get the column
ProjectName.
*Bug Fix:*
org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix NULL
judge to fix this bug
> Connectors/JDBC LookupFunction getFieldFromResultSet BUG
>
>
> Key: FLINK-13690
> URL: https://issues.apache.org/jira/browse/FLINK-13690
> Project: Flink
> Issue Type: Bug
> Components: Connectors / JDBC
>Affects Versions: 1.8.0, 1.9.0
>Reporter: molsion
>Assignee: molsion
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
> this method have a bug, ResultSet.wasNull() reports whether the last column
> read had a value of SQL NULL, {color:#ff}NOT the current column
> ,{color:#33} when one colums's value is null then all colums value
> behind it will be null , even if they are not null{color}{color}
>
> *{color:#33}bug scene:{color}*
> {color:#33}1. I want to join a dimension table, column is {color}
> {code:java}
> Id (INT), ProjectType(INT), Desp(VARCHAR),ProjectName(VARCHAR)
> {code}
>
> 2. select from database table is
> {code:java}
> {"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":"ProjectName"}
> {code}
>
> 3.
> org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
> return the row is
> {code:java}
> {"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":NULL}{code}
> beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
> when index = 3, ResultSet.wasNull is true, then value of column ProjectName
> is null
>
> this operator will influence next opertator , then i can not get the column
> ProjectName.
>
> *Bug Fix:*
> org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix
> NULL judge to fix this bug
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Updated] (FLINK-13690) Connectors/JDBC LookupFunction getFieldFromResultSet BUG
[
https://issues.apache.org/jira/browse/FLINK-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
molsion updated FLINK-13690:
Affects Version/s: 1.8.0
> Connectors/JDBC LookupFunction getFieldFromResultSet BUG
>
>
> Key: FLINK-13690
> URL: https://issues.apache.org/jira/browse/FLINK-13690
> Project: Flink
> Issue Type: Bug
> Components: Connectors / JDBC
>Affects Versions: 1.8.0, 1.9.0
>Reporter: molsion
>Assignee: molsion
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
> this method have a bug, ResultSet.wasNull() reports whether the last column
> read had a value of SQL NULL, {color:#ff}NOT the current column {color}
>
> *{color:#33}bug scene:{color}*
> {color:#33}1. I want to join a dimension table, column is {color}
> {code:java}
> Id (INT), ProjectType(INT), Desp(VARCHAR),ProjectName(VARCHAR)
> {code}
>
> 2. select from database table is
> {code:java}
> {"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":"ProjectName"}
> {code}
>
> 3.
> org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
> return the row is
> {code:java}
> {"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":NULL}{code}
> beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
> when index = 3, ResultSet.wasNull is true, then value of column ProjectName
> is null
>
> this operator will influence next opertator , then i can not get the column
> ProjectName.
>
> *Bug Fix:*
> org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix
> NULL judge to fix this bug
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Updated] (FLINK-13690) Connectors/JDBC LookupFunction getFieldFromResultSet BUG
[
https://issues.apache.org/jira/browse/FLINK-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
molsion updated FLINK-13690:
Description:
JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
this method have a bug, ResultSet.wasNull() reports whether the last column
read had a value of SQL NULL, {color:#ff}NOT the current column {color}
*{color:#33}bug scene:{color}*
{color:#33}1. I want to join a dimension table, column is {color}
{code:java}
Id (INT), ProjectType(INT), Desp(VARCHAR),ProjectName(VARCHAR)
{code}
2. select from database table is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":"ProjectName"}
{code}
3.
org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
return the row is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":NULL}{code}
beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
when index = 3, ResultSet.wasNull is true, then value of column ProjectName is
null
this operator will influence next opertator , then i can not get the column
ProjectName.
*Bug Fix:*
org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix NULL
judge to fix this bug
was:
JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
this method have a bug, ResultSet.wasNull() reports whether the last column
read had a value of SQL NULL, {color:#ff}NOT the current column {color}
*{color:#33}bug scene:{color}*
{color:#33}1. I want to join a dimension table, column is {color}
{code:java}
Id (INT), ProjectType(INT), Desp(VARCHAR),Name(VARCHAR)
{code}
2. select from database table is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"Name":"ProjectName"}
{code}
3.
org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
return the row is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"Name":NULL}{code}
beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
when index = 3, ResultSet.wasNull is true, then value of column Name is null
this operator will influence next opertator , then i can not get the column
Name.
*Bug Fix:*
org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix NULL
judge to fix this bug
> Connectors/JDBC LookupFunction getFieldFromResultSet BUG
>
>
> Key: FLINK-13690
> URL: https://issues.apache.org/jira/browse/FLINK-13690
> Project: Flink
> Issue Type: Bug
> Components: Connectors / JDBC
>Affects Versions: 1.9.0
>Reporter: molsion
>Assignee: molsion
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
> this method have a bug, ResultSet.wasNull() reports whether the last column
> read had a value of SQL NULL, {color:#ff}NOT the current column {color}
>
> *{color:#33}bug scene:{color}*
> {color:#33}1. I want to join a dimension table, column is {color}
> {code:java}
> Id (INT), ProjectType(INT), Desp(VARCHAR),ProjectName(VARCHAR)
> {code}
>
> 2. select from database table is
> {code:java}
> {"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":"ProjectName"}
> {code}
>
> 3.
> org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
> return the row is
> {code:java}
> {"Id": 10, "ProjectType":100,"Desp":NULL,"ProjectName":NULL}{code}
> beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
> when index = 3, ResultSet.wasNull is true, then value of column ProjectName
> is null
>
> this operator will influence next opertator , then i can not get the column
> ProjectName.
>
> *Bug Fix:*
> org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix
> NULL judge to fix this bug
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Updated] (FLINK-13690) Connectors/JDBC LookupFunction getFieldFromResultSet BUG
[
https://issues.apache.org/jira/browse/FLINK-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
molsion updated FLINK-13690:
Description:
JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
this method have a bug, ResultSet.wasNull() reports whether the last column
read had a value of SQL NULL, {color:#ff}NOT the current column {color}
*{color:#33}bug scene:{color}*
{color:#33}1. I want to join a dimension table, column is {color}
{code:java}
Id (INT), ProjectType(INT), Desp(VARCHAR),Name(VARCHAR)
{code}
2. select from database table is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"Name":"ProjectName"}
{code}
3.
org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
return the row is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"Name":NULL}{code}
beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
when index = 3, ResultSet.wasNull is true, then value of column Name is null
this operator will influence next opertator , then i can not get the column
Name.
*Bug Fix:*
org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix NULL
judge to fix this bug
was:
JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
this method have a bug, ResultSet.wasNull() reports whether the last column
read had a value of SQL NULL, {color:#FF}NOT the current column {color}
*{color:#33}bug scene:{color}*
{color:#33}1. I want to join a dimension table, column is {color}
{code:java}
Id (INT), ProjectType(INT), Desp(VARCHAR),Name(VARCHAR)
{code}
2. select from database table is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"Name":"ProjectName"}
{code}
3.
org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
return the row is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"Name":NULL}{code}
beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
when index = 3, ResultSet.wasNull is true, then value of column Name is null
this operator will influence next opertator , then i can not get the column
Name.
*Bug Fix:*
org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix NULL
judge to fix this bug
> Connectors/JDBC LookupFunction getFieldFromResultSet BUG
>
>
> Key: FLINK-13690
> URL: https://issues.apache.org/jira/browse/FLINK-13690
> Project: Flink
> Issue Type: Bug
> Components: Connectors / JDBC
>Affects Versions: 1.9.0
>Reporter: molsion
>Assignee: molsion
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
> this method have a bug, ResultSet.wasNull() reports whether the last column
> read had a value of SQL NULL, {color:#ff}NOT the current column {color}
>
> *{color:#33}bug scene:{color}*
> {color:#33}1. I want to join a dimension table, column is {color}
> {code:java}
> Id (INT), ProjectType(INT), Desp(VARCHAR),Name(VARCHAR)
> {code}
>
> 2. select from database table is
> {code:java}
> {"Id": 10, "ProjectType":100,"Desp":NULL,"Name":"ProjectName"}
> {code}
>
> 3.
> org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
> return the row is
> {code:java}
> {"Id": 10, "ProjectType":100,"Desp":NULL,"Name":NULL}{code}
> beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
> when index = 3, ResultSet.wasNull is true, then value of column Name is null
>
> this operator will influence next opertator , then i can not get the column
> Name.
>
> *Bug Fix:*
> org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix
> NULL judge to fix this bug
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Created] (FLINK-13690) Connectors/JDBC LookupFunction getFieldFromResultSet BUG
molsion created FLINK-13690:
---
Summary: Connectors/JDBC LookupFunction getFieldFromResultSet BUG
Key: FLINK-13690
URL: https://issues.apache.org/jira/browse/FLINK-13690
Project: Flink
Issue Type: Bug
Components: Connectors / JDBC
Affects Versions: 1.8.1, 1.7.2
Reporter: molsion
JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
this method have a bug, ResultSet.wasNull() reports whether the last column
read had a value of SQL NULL, {color:#FF}NOT the current column {color}
*{color:#33}bug scene:{color}*
{color:#33}1. I want to join a dimension table, column is {color}
{code:java}
Id (INT), ProjectType(INT), Desp(VARCHAR),Name(VARCHAR)
{code}
2. select from database table is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"Name":"ProjectName"}
{code}
3.
org.apache.flink.api.java.io.jdbc.JDBCLookupFunction#convertToRowFromResultSet
return the row is
{code:java}
{"Id": 10, "ProjectType":100,"Desp":NULL,"Name":NULL}{code}
beause JDBCUtils.getFieldFromResultSet(int index, int type, ResultSet set)
when index = 3, ResultSet.wasNull is true, then value of column Name is null
this operator will influence next opertator , then i can not get the column
Name.
*Bug Fix:*
org.apache.flink.api.java.io.jdbc.JDBCUtils#getFieldFromResultSet can fix NULL
judge to fix this bug
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Updated] (FLINK-13270) CheckpointCoordinator abort the checkpoint
[
https://issues.apache.org/jira/browse/FLINK-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
molsion updated FLINK-13270:
Description:
# Submitting a job that source is Kafka, and Kafka partition is 1 , if set
source Parallelism to 4,the job will be submitted successfully and source
operator is RUNNING status but three Parallelism task is FINISHED
# checkpoint will abort when
org.apache.flink.runtime.checkpoint.CheckpointCoordinator#triggerCheckpoint
trigger and return
CheckpointTriggerResult(CheckpointDeclineReason.NOT_ALL_REQUIRED_TASKS_RUNNING),
this job do not have a successful checkpoint and lost runtime status
# Here is the log
{code:java}
July 15th 2019, 19:29:43.230 Checkpoint triggering task Source:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
-> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey, CAST(key)
AS msg)) -> SinkConversion to Row (1/4) of job 2e1b28950a38d62803a9840609b55612
is not being executed at the moment. Aborting checkpoint.
July 15th 2019, 19:28:43.230 Checkpoint triggering task Source:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
-> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey, CAST(key)
AS msg)) -> SinkConversion to Row (1/4) of job 2e1b28950a38d62803a9840609b55612
is not being executed at the moment. Aborting checkpoint.
{code}
We want to be able to trigger checkpoint and store it if we have a finished
node in operator,or we want to be able to check Parallelism problem when we
submit the job(eg : if Parallelism > kafkaPartition then submit unsuccessfully)
was:
# Submitting a job that source is Kafka, and Kafka partition is 1 , if set
source Parallelism to 4,the job will be submitted successfully and source
operator is RUNNING status but three Parallelism task is FINISHED
# checkpoint will abort when
org.apache.flink.runtime.checkpoint.CheckpointCoordinator#triggerCheckpoint
trigger and return
CheckpointTriggerResult(CheckpointDeclineReason.NOT_ALL_REQUIRED_TASKS_RUNNING),
this job do not have a successful checkpoint and lost runtime status
# Here is the log
{code:java}
//代码占位符
July 15th 2019, 19:29:43.230 Checkpoint triggering task Source:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
-> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey, CAST(key)
AS msg)) -> SinkConversion to Row (1/4) of job 2e1b28950a38d62803a9840609b55612
is not being executed at the moment. Aborting checkpoint.
July 15th 2019, 19:28:43.230 Checkpoint triggering task Source:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
-> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey, CAST(key)
AS msg)) -> SinkConversion to Row (1/4) of job 2e1b28950a38d62803a9840609b55612
is not being executed at the moment. Aborting checkpoint.
{code}
We want to be able to trigger checkpoint and store it if we have a finished
node in operator,or we want to be able to check Parallelism problem when we
submit the job(eg : if Parallelism > kafkaPartition then submit unsuccessfully)
> CheckpointCoordinator abort the checkpoint
> --
>
> Key: FLINK-13270
> URL: https://issues.apache.org/jira/browse/FLINK-13270
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.6.3
>Reporter: molsion
>Priority: Critical
> Attachments: image-2019-07-15-19-30-12-930.png
>
>
> # Submitting a job that source is Kafka, and Kafka partition is 1 , if set
> source Parallelism to 4,the job will be submitted successfully and source
> operator is RUNNING status but three Parallelism task is FINISHED
> # checkpoint will abort when
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator#triggerCheckpoint
> trigger and return
> CheckpointTriggerResult(CheckpointDeclineReason.NOT_ALL_REQUIRED_TASKS_RUNNING),
> this job do not have a successful checkpoint and lost runtime status
> # Here is the log
> {code:java}
> July 15th 2019, 19:29:43.230 Checkpoint triggering task Source:
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
> -> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey,
> CAST(key) AS msg)) -> SinkConversion to Row (1/4) of job
> 2e1b28950a38d62803a9840609b55612 is not being executed at the moment.
> Aborting checkpoint.
> July 15th 2019, 19:28:43.230 Checkpoint triggering task Source:
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
> -> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey,
> CAST(key) AS msg)) -> SinkConversion to Row (1/4) of job
> 2e1b28950a38d62803a9840609b55612 is not being executed at the moment.
> Aborting
[jira] [Updated] (FLINK-13270) CheckpointCoordinator abort the checkpoint
[
https://issues.apache.org/jira/browse/FLINK-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
molsion updated FLINK-13270:
Description:
# Submitting a job that source is Kafka, and Kafka partition is 1 , if set
source Parallelism to 4,the job will be submitted successfully and source
operator is RUNNING status but three Parallelism task is FINISHED
# checkpoint will abort when
org.apache.flink.runtime.checkpoint.CheckpointCoordinator#triggerCheckpoint
trigger and return
CheckpointTriggerResult(CheckpointDeclineReason.NOT_ALL_REQUIRED_TASKS_RUNNING),
this job do not have a successful checkpoint and lost runtime status
# Here is the log
{code:java}
//代码占位符
July 15th 2019, 19:29:43.230 Checkpoint triggering task Source:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
-> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey, CAST(key)
AS msg)) -> SinkConversion to Row (1/4) of job 2e1b28950a38d62803a9840609b55612
is not being executed at the moment. Aborting checkpoint.
July 15th 2019, 19:28:43.230 Checkpoint triggering task Source:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
-> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey, CAST(key)
AS msg)) -> SinkConversion to Row (1/4) of job 2e1b28950a38d62803a9840609b55612
is not being executed at the moment. Aborting checkpoint.
{code}
We want to be able to trigger checkpoint and store it if we have a finished
node in operator,or we want to be able to check Parallelism problem when we
submit the job(eg : if Parallelism > kafkaPartition then submit unsuccessfully)
was:
# Submitting a job that source is Kafka, and Kafka partition is 1 , if set
source Parallelism to 4,the job will be submitted successfully and source
operator is RUNNING status but three Parallelism task is FINISHED
# checkpoint will abort when
org.apache.flink.runtime.checkpoint.CheckpointCoordinator#triggerCheckpoint
trigger and return
CheckpointTriggerResult(CheckpointDeclineReason.NOT_ALL_REQUIRED_TASKS_RUNNING),
this job do not have a successful checkpoint and lost runtime status
# Here is the log
{code:java}
//代码占位符
July 15th 2019, 19:29:43.230 Checkpoint triggering task Source:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
-> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey, CAST(key)
AS msg)) -> SinkConversion to Row (1/4) of job 2e1b28950a38d62803a9840609b55612
is not being executed at the moment. Aborting checkpoint.
July 15th 2019, 19:28:43.230 Checkpoint triggering task Source:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
-> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey, CAST(key)
AS msg)) -> SinkConversion to Row (1/4) of job 2e1b28950a38d62803a9840609b55612
is not being executed at the moment. Aborting checkpoint.
{code}
We want to be able to trigger checkpoint and store it if we have a finished
node in operator,or we want to be able to check Parallelism problem when we
submit the job(eg : if Parallelism > kafkaPartition then submit unsuccessfully)
> CheckpointCoordinator abort the checkpoint
> --
>
> Key: FLINK-13270
> URL: https://issues.apache.org/jira/browse/FLINK-13270
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.6.3
>Reporter: molsion
>Priority: Critical
> Attachments: image-2019-07-15-19-30-12-930.png
>
>
> # Submitting a job that source is Kafka, and Kafka partition is 1 , if set
> source Parallelism to 4,the job will be submitted successfully and source
> operator is RUNNING status but three Parallelism task is FINISHED
> # checkpoint will abort when
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator#triggerCheckpoint
> trigger and return
> CheckpointTriggerResult(CheckpointDeclineReason.NOT_ALL_REQUIRED_TASKS_RUNNING),
> this job do not have a successful checkpoint and lost runtime status
> # Here is the log
> {code:java}
> //代码占位符
> July 15th 2019, 19:29:43.230 Checkpoint triggering task Source:
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
> -> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey,
> CAST(key) AS msg)) -> SinkConversion to Row (1/4) of job
> 2e1b28950a38d62803a9840609b55612 is not being executed at the moment.
> Aborting checkpoint.
> July 15th 2019, 19:28:43.230 Checkpoint triggering task Source:
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
> -> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey,
> CAST(key) AS msg)) -> SinkConversion to Row (1/4) of job
> 2e1b28950a38d62803a9840609b55612 is not being executed at the
[jira] [Created] (FLINK-13270) CheckpointCoordinator abort the checkpoint
molsion created FLINK-13270:
---
Summary: CheckpointCoordinator abort the checkpoint
Key: FLINK-13270
URL: https://issues.apache.org/jira/browse/FLINK-13270
Project: Flink
Issue Type: Bug
Components: Runtime / Checkpointing
Affects Versions: 1.6.3
Reporter: molsion
Attachments: image-2019-07-15-19-30-12-930.png
# Submitting a job that source is Kafka, and Kafka partition is 1 , if set
source Parallelism to 4,the job will be submitted successfully and source
operator is RUNNING status but three Parallelism task is FINISHED
# checkpoint will abort when
org.apache.flink.runtime.checkpoint.CheckpointCoordinator#triggerCheckpoint
trigger and return
CheckpointTriggerResult(CheckpointDeclineReason.NOT_ALL_REQUIRED_TASKS_RUNNING),
this job do not have a successful checkpoint and lost runtime status
# Here is the log
{code:java}
//代码占位符
July 15th 2019, 19:29:43.230 Checkpoint triggering task Source:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
-> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey, CAST(key)
AS msg)) -> SinkConversion to Row (1/4) of job 2e1b28950a38d62803a9840609b55612
is not being executed at the moment. Aborting checkpoint.
July 15th 2019, 19:28:43.230 Checkpoint triggering task Source:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer@132e3594-Stream
-> Calc(where: (CAST(msg) LIKE '%我们%'), select: (CAST(msg) AS kkey, CAST(key)
AS msg)) -> SinkConversion to Row (1/4) of job 2e1b28950a38d62803a9840609b55612
is not being executed at the moment. Aborting checkpoint.
{code}
We want to be able to trigger checkpoint and store it if we have a finished
node in operator,or we want to be able to check Parallelism problem when we
submit the job(eg : if Parallelism > kafkaPartition then submit unsuccessfully)
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
