[
https://issues.apache.org/jira/browse/FLINK-13807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chesnay Schepler closed FLINK-13807.
------------------------------------
Fix Version/s: 1.9.1
1.10.0
1.8.2
Resolution: Fixed
master: 59ec116aedab5f4b59fc5a0260b4c741e138de50
1.9: 603c128c364b8f6bb20dce5ce2708b614b284a99
1.8: 70dfb7a8ea52fac7a00ed1d5b28b7ef244defaa6
> Flink-avro unit tests fails if the character encoding in the environment is
> not default to UTF-8
> ------------------------------------------------------------------------------------------------
>
> Key: FLINK-13807
> URL: https://issues.apache.org/jira/browse/FLINK-13807
> Project: Flink
> Issue Type: Bug
> Affects Versions: 1.8.0
> Reporter: Ethan Li
> Assignee: TisonKun
> Priority: Minor
> Labels: pull-request-available
> Fix For: 1.8.2, 1.10.0, 1.9.1
>
> Attachments: patch.diff
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> On Flink release-1.8 branch:
> {code:java}
> [ERROR] Tests run: 12, Failures: 4, Errors: 0, Skipped: 0, Time elapsed: 4.81
> s <<< FAILURE! - in
> org.apache.flink.formats.avro.typeutils.AvroTypeExtractionTest
> [ERROR] testSimpleAvroRead[Execution mode =
> CLUSTER](org.apache.flink.formats.avro.typeutils.AvroTypeExtractionTest)
> Time elapsed: 0.438 s <<< FAILURE!
> java.lang.AssertionError:
> Different elements in arrays: expected 2 elements and received 2
> files: [/tmp/junit5386344396421857812/junit6023978980792200274.tmp/4,
> /tmp/junit5386344396421857812/junit6023978980792200274.tmp/2,
> /tmp/junit5386344396421857812/junit6023978980792200274.tmp/1,
> /tmp/junit5386344396421857812/junit6023978980792200274.tmp/3]
> expected: [{"name": "Alyssa", "favorite_number": 256, "favorite_color":
> null, "type_long_test": null, "type_double_test": 123.45, "type_null_test":
> null, "type_bool_test": true, "type_array_string": ["ELEMENT 1", "ELEMENT
> 2"], "type_array_boolean": [true, false], "type_nullable_array": null,
> "type_enum": "GREEN", "type_map": {"KEY 2": 17554, "KEY 1": 8546456},
> "type_fixed": null, "type_union": null, "type_nested": {"num": 239, "street":
> "Baker Street", "city": "London", "state": "London", "zip": "NW1 6XE"},
> "type_bytes": {"bytes":
> "\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000"}, "type_date":
> 2014-03-01, "type_time_millis": 12:12:12.000, "type_time_micros": 123456,
> "type_timestamp_millis": 2014-03-01T12:12:12.321Z, "type_timestamp_micros":
> 123456, "type_decimal_bytes": {"bytes": "\u0007?"}, "type_decimal_fixed": [7,
> -48]}, {"name": "Charlie", "favorite_number": null, "favorite_color": "blue",
> "type_long_test": 1337, "type_double_test": 1.337, "type_null_test": null,
> "type_bool_test": false, "type_array_string": [], "type_array_boolean": [],
> "type_nullable_array": null, "type_enum": "RED", "type_map": {},
> "type_fixed": null, "type_union": null, "type_nested": {"num": 239, "street":
> "Baker Street", "city": "London", "state": "London", "zip": "NW1 6XE"},
> "type_bytes": {"bytes":
> "\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000"}, "type_date":
> 2014-03-01, "type_time_millis": 12:12:12.000, "type_time_micros": 123456,
> "type_timestamp_millis": 2014-03-01T12:12:12.321Z, "type_timestamp_micros":
> 123456, "type_decimal_bytes": {"bytes": "\u0007?"}, "type_decimal_fixed": [7,
> -48]}]
> received: [{"name": "Alyssa", "favorite_number": 256, "favorite_color":
> null, "type_long_test": null, "type_double_test": 123.45, "type_null_test":
> null, "type_bool_test": true, "type_array_string": ["ELEMENT 1", "ELEMENT
> 2"], "type_array_boolean": [true, false], "type_nullable_array": null,
> "type_enum": "GREEN", "type_map": {"KEY 2": 17554, "KEY 1": 8546456},
> "type_fixed": null, "type_union": null, "type_nested": {"num": 239, "street":
> "Baker Street", "city": "London", "state": "London", "zip": "NW1 6XE"},
> "type_bytes": {"bytes":
> "\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000"}, "type_date":
> 2014-03-01, "type_time_millis": 12:12:12.000, "type_time_micros": 123456,
> "type_timestamp_millis": 2014-03-01T12:12:12.321Z, "type_timestamp_micros":
> 123456, "type_decimal_bytes": {"bytes": "\u0007??"}, "type_decimal_fixed":
> [7, -48]}, {"name": "Charlie", "favorite_number": null, "favorite_color":
> "blue", "type_long_test": 1337, "type_double_test": 1.337, "type_null_test":
> null, "type_bool_test": false, "type_array_string": [], "type_array_boolean":
> [], "type_nullable_array": null, "type_enum": "RED", "type_map": {},
> "type_fixed": null, "type_union": null, "type_nested": {"num": 239, "street":
> "Baker Street", "city": "London", "state": "London", "zip": "NW1 6XE"},
> "type_bytes": {"bytes":
> "\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000"}, "type_date":
> 2014-03-01, "type_time_millis": 12:12:12.000, "type_time_micros": 123456,
> "type_timestamp_millis": 2014-03-01T12:12:12.321Z, "type_timestamp_micros":
> 123456, "type_decimal_bytes": {"bytes": "\u0007??"}, "type_decimal_fixed":
> [7, -48]}]
> at
> org.apache.flink.formats.avro.typeutils.AvroTypeExtractionTest.after(AvroTypeExtractionTest.java:76)
> {code}
> Comparing “expected” with “received”, there is really some question mark
> difference.
> For example, in “expected’, it’s
> {code:java}
> "type_decimal_bytes": {"bytes": "\u0007?”}
> {code}
> While in “received”, it’s
> {code:java}
> "type_decimal_bytes": {"bytes": "\u0007??"}
> {code}
> The environment I ran the unit tests on uses ANSI_X3.4-1968
> I changed to "en_US.UTF-8" and the unit tests passed.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
