yuan created FLINK-32712:
----------------------------
Summary: Enhance Flink ogg-json format
Key: FLINK-32712
URL: https://issues.apache.org/jira/browse/FLINK-32712
Project: Flink
Issue Type: Bug
Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
Affects Versions: 1.17.1
Reporter: yuan
The BEFORE field in ogg-json can be configured to contain no table fields, as
in the ogg-json example below.
{code:java}
{
"table": "ZBZZZ",
"op_type": "U",
"op_ts": "2023-07-20 21:45:34.860817",
"current_ts": "2023-07-21T05:45:36.615000",
"pos": "00002564940142073691",
"before": {},
"after": {
"ID": 1461242,
"PROPERTY_01": "tc",
"PROPERTY_02": null,
"PROPERTY_03": null,
"PROPERTY_04": "K",
"PROPERTY_05": "5",
"PROPERTY_06": null,
"PROPERTY_07": null,
"PROPERTY_08": null,
"PROPERTY_09": null,
"PROPERTY_10": null
}
}{code}
For this case, ogg-json format should not send a Record of type UPDATE_BEFORE
downstream。 Worse, it can sometimes cause the flink job to crash out.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
