Raúl Cumplido created ARROW-17683: ------------------------------------- Summary: [CI][Python] Nightly test-conda-python-3.7-kartothek-latest fails due to UnicodeDecodeError Key: ARROW-17683 URL: https://issues.apache.org/jira/browse/ARROW-17683 Project: Apache Arrow Issue Type: Bug Components: Continuous Integration, Python Reporter: Raúl Cumplido
The nightly tests against kartothek are currently failing due to the following error: {code:java} ______________________ test_eval_operators[<-1-expected3] ______________________op = '<', value = 1, expected = {'a', 'b', 'c'} @pytest.mark.parametrize( > "op, value, expected", [ ("==", 1, {"b", "c", "e"}), ("<=", 1, {"a", "b", "c", "e"}), (">=", 1, {"b", "c", "e", "f"}), ("<", 1, {"a", "b", "c"}), (">", 1, {"f"}), ("in", [0, 2], {"a", "b", "c", "f"}), ], )tests/core/test_index.py:621: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ tests/core/test_index.py:638: in test_eval_operators index_data[2]: ["f"], kartothek/core/index.py:614: in __init__ normalize_dtype=normalize_dtype, kartothek/core/index.py:78: in __init__ table = _index_dct_to_table(index_dct, column, None) kartothek/core/index.py:949: in _index_dct_to_table labeled_array = pa.array(keys, type=dtype) pyarrow/array.pxi:313: in pyarrow.lib.array ??? _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > ??? E UnicodeDecodeError: 'utf-32-le' codec can't decode bytes in position 4-7: code point in surrogate code point range(0xd800, 0xe000) E Falsifying example: test_eval_operators( E index_data=array(['', '0', '0\ud800', '1', '2', '3', '4', '5', '6', '7'], dtype='<U2'), E op='<', E value=1, E expected={'a', 'b', 'c'}, E )pyarrow/array.pxi:83: UnicodeDecodeError {code} An example of build failure: [https://github.com/ursacomputing/crossbow/runs/8296508320?check_suite_focus=true] -- This message was sent by Atlassian Jira (v8.20.10#820010)