[ https://issues.apache.org/jira/browse/CASSANDRA-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15294133#comment-15294133 ]
Michael Shuler commented on CASSANDRA-11799: -------------------------------------------- We finally figured out how to reproduce this. When using {{--with-xunit}} and we {{| tee -a logfile}}, this is when we expose the problem. All looks fine locally: {noformat} $ nosetests --with-xunit -vs cqlsh_tests/cqlsh_tests.py:TestCqlsh.test_unicode_invalid_request_error cqlsh_tests/cqlsh_tests.py:TestCqlsh.test_unicode_syntax_error test_unicode_invalid_request_error (cqlsh_tests.cqlsh_tests.TestCqlsh) ... (EE) <stdin>:2:InvalidRequest: code=2200 [Invalid query] message=""ä" is not a valid keyspace name"(EE) ok test_unicode_syntax_error (cqlsh_tests.cqlsh_tests.TestCqlsh) ... (EE) <stdin>:2:Invalid syntax at char 1(EE) <stdin>:2: ä;(EE) <stdin>:2: ^(EE) ok ---------------------------------------------------------------------- XML: /home/mshuler/git/cassandra-dtest/nosetests.xml ---------------------------------------------------------------------- Ran 2 tests in 24.650s OK {noformat} Pipe to tee and we repro the problem in CI: {noformat} $ nosetests --with-xunit -vs cqlsh_tests/cqlsh_tests.py:TestCqlsh.test_unicode_invalid_request_error cqlsh_tests/cqlsh_tests.py:TestCqlsh.test_unicode_syntax_error | tee -a logfile test_unicode_invalid_request_error (cqlsh_tests.cqlsh_tests.TestCqlsh) ... (EE) ERROR test_unicode_syntax_error (cqlsh_tests.cqlsh_tests.TestCqlsh) ... (EE) <stdin>:2:Invalid syntax at char 1(EE) ERROR ====================================================================== ERROR: test_unicode_invalid_request_error (cqlsh_tests.cqlsh_tests.TestCqlsh) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/cqlsh_tests/cqlsh_tests.py", line 476, in test_unicode_invalid_request_error output, err = node1.run_cqlsh(cmds=cmd, return_output=True) File "/home/mshuler/git/ccm/ccmlib/node.py", line 816, in run_cqlsh print_("(EE) ", err, end='') File "/usr/lib/python2.7/dist-packages/nose/plugins/xunit.py", line 126, in write s.write(data) File "/usr/lib/python2.7/dist-packages/nose/plugins/xunit.py", line 126, in write s.write(data) File "/usr/lib/python2.7/dist-packages/nose/plugins/xunit.py", line 126, in write s.write(data) File "/usr/lib/python2.7/dist-packages/nose/plugins/xunit.py", line 126, in write s.write(data) UnicodeEncodeError: 'ascii' codec can't encode character u'\xe4' in position 62: ordinal not in range(128) -------------------- >> begin captured logging << -------------------- dtest: DEBUG: cluster ccm directory: /tmp/dtest-Wvh3PT dtest: DEBUG: Custom init_config not found. Setting defaults. dtest: DEBUG: Done setting configuration options: { 'initial_token': None, 'num_tokens': '256', 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 10000, 'read_request_timeout_in_ms': 10000, 'request_timeout_in_ms': 10000, 'truncate_request_timeout_in_ms': 10000, 'write_request_timeout_in_ms': 10000} --------------------- >> end captured logging << --------------------- ====================================================================== ERROR: test_unicode_syntax_error (cqlsh_tests.cqlsh_tests.TestCqlsh) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/cqlsh_tests/cqlsh_tests.py", line 456, in test_unicode_syntax_error output, err = node1.run_cqlsh(cmds=u"ä;".encode('utf8'), return_output=True) File "/home/mshuler/git/ccm/ccmlib/node.py", line 816, in run_cqlsh print_("(EE) ", err, end='') File "/usr/lib/python2.7/dist-packages/nose/plugins/xunit.py", line 126, in write s.write(data) File "/usr/lib/python2.7/dist-packages/nose/plugins/xunit.py", line 126, in write s.write(data) File "/usr/lib/python2.7/dist-packages/nose/plugins/xunit.py", line 126, in write s.write(data) File "/usr/lib/python2.7/dist-packages/nose/plugins/xunit.py", line 126, in write s.write(data) UnicodeEncodeError: 'ascii' codec can't encode character u'\xe4' in position 12: ordinal not in range(128) -------------------- >> begin captured logging << -------------------- dtest: DEBUG: cluster ccm directory: /tmp/dtest-lh6EEU dtest: DEBUG: Custom init_config not found. Setting defaults. dtest: DEBUG: Done setting configuration options: { 'initial_token': None, 'num_tokens': '256', 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 10000, 'read_request_timeout_in_ms': 10000, 'request_timeout_in_ms': 10000, 'truncate_request_timeout_in_ms': 10000, 'write_request_timeout_in_ms': 10000} --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- XML: /home/mshuler/git/cassandra-dtest/nosetests.xml ---------------------------------------------------------------------- Ran 2 tests in 24.832s FAILED (errors=2) {noformat} Workaround is to {{export PYTHONIOENCODING='utf-8'}} and pipe to tee: {noformat} $ export PYTHONIOENCODING='utf-8' $ nosetests --with-xunit -vs cqlsh_tests/cqlsh_tests.py:TestCqlsh.test_unicode_invalid_request_error cqlsh_tests/cqlsh_tests.py:TestCqlsh.test_unicode_syntax_error | tee -a logfile test_unicode_invalid_request_error (cqlsh_tests.cqlsh_tests.TestCqlsh) ... (EE) <stdin>:2:InvalidRequest: code=2200 [Invalid query] message=""ä" is not a valid keyspace name"(EE) ok test_unicode_syntax_error (cqlsh_tests.cqlsh_tests.TestCqlsh) ... (EE) <stdin>:2:Invalid syntax at char 1(EE) <stdin>:2: ä;(EE) <stdin>:2: ^(EE) ok ---------------------------------------------------------------------- XML: /home/mshuler/git/cassandra-dtest/nosetests.xml ---------------------------------------------------------------------- Ran 2 tests in 25.611s OK {noformat} > dtest failure in cqlsh_tests.cqlsh_tests.TestCqlsh.test_unicode_syntax_error > ---------------------------------------------------------------------------- > > Key: CASSANDRA-11799 > URL: https://issues.apache.org/jira/browse/CASSANDRA-11799 > Project: Cassandra > Issue Type: Test > Reporter: Philip Thompson > Assignee: Tyler Hobbs > Labels: cqlsh, dtest > Fix For: 2.2.x, 3.0.x, 3.x > > > example failure: > http://cassci.datastax.com/job/cassandra-3.0_dtest/703/testReport/cqlsh_tests.cqlsh_tests/TestCqlsh/test_unicode_syntax_error > Failed on CassCI build cassandra-3.0_dtest #703 > Also failing is > cqlsh_tests.cqlsh_tests.TestCqlsh.test_unicode_invalid_request_error > The relevant failure is > {code} > 'ascii' codec can't encode character u'\xe4' in position 12: ordinal not in > range(128) > {code} > These are failing on 2.2, 3.0 and trunk. -- This message was sent by Atlassian JIRA (v6.3.4#6332)