[jira] [Commented] (CASSANDRA-9898) cqlsh crashes if it load a utf-8 file.
[ https://issues.apache.org/jira/browse/CASSANDRA-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14709591#comment-14709591 ] Carl Yeksigian commented on CASSANDRA-9898: --- +1. It would be great to add a [dtest|https://github.com/riptano/cassandra-dtest/blob/master/cqlsh_tests/cqlsh_tests.py] for this. cqlsh crashes if it load a utf-8 file. -- Key: CASSANDRA-9898 URL: https://issues.apache.org/jira/browse/CASSANDRA-9898 Project: Cassandra Issue Type: Bug Components: Tools Environment: linux, os x yosemite. Reporter: Yasuharu Goto Assignee: Yasuharu Goto Priority: Minor Labels: cqlsh Fix For: 2.1.x, 2.2.x Attachments: cassandra-2.1-9898.txt, cassandra-2.2-9898.txt cqlsh crashes when it load a cql script file encoded in utf-8. This is a reproduction procedure. {noformat} $cat ./test.cql // 日本語のコメント use system; select * from system.peers; $cqlsh --version cqlsh 5.0.1 $cqlsh -f ./test.cql Traceback (most recent call last): File ./cqlsh, line 2459, in module main(*read_options(sys.argv[1:], os.environ)) File ./cqlsh, line 2451, in main shell.cmdloop() File ./cqlsh, line 940, in cmdloop line = self.get_input_line(self.prompt) File ./cqlsh, line 909, in get_input_line self.lastcmd = self.stdin.readline() File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 675, in readline return self.reader.readline(size) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 530, in readline data = self.read(readsize, firstline=True) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 477, in read newchars, decodedbytes = self.decode(data, self.errors) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 3: ordinal not in range(128) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CASSANDRA-9898) cqlsh crashes if it load a utf-8 file.
[ https://issues.apache.org/jira/browse/CASSANDRA-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703391#comment-14703391 ] Yasuharu Goto commented on CASSANDRA-9898: -- Ping [~carlyeks]. What should I do as a next step? cqlsh crashes if it load a utf-8 file. -- Key: CASSANDRA-9898 URL: https://issues.apache.org/jira/browse/CASSANDRA-9898 Project: Cassandra Issue Type: Bug Components: Tools Environment: linux, os x yosemite. Reporter: Yasuharu Goto Assignee: Yasuharu Goto Priority: Minor Labels: cqlsh Fix For: 2.1.x, 2.2.x Attachments: cassandra-2.1-9898.txt, cassandra-2.2-9898.txt cqlsh crashes when it load a cql script file encoded in utf-8. This is a reproduction procedure. {noformat} $cat ./test.cql // 日本語のコメント use system; select * from system.peers; $cqlsh --version cqlsh 5.0.1 $cqlsh -f ./test.cql Traceback (most recent call last): File ./cqlsh, line 2459, in module main(*read_options(sys.argv[1:], os.environ)) File ./cqlsh, line 2451, in main shell.cmdloop() File ./cqlsh, line 940, in cmdloop line = self.get_input_line(self.prompt) File ./cqlsh, line 909, in get_input_line self.lastcmd = self.stdin.readline() File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 675, in readline return self.reader.readline(size) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 530, in readline data = self.read(readsize, firstline=True) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 477, in read newchars, decodedbytes = self.decode(data, self.errors) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 3: ordinal not in range(128) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CASSANDRA-9898) cqlsh crashes if it load a utf-8 file.
[ https://issues.apache.org/jira/browse/CASSANDRA-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654600#comment-14654600 ] Yasuharu Goto commented on CASSANDRA-9898: -- Oops, I've not paste the last line of my error log. I've updated my description. cqlsh crashes if it load a utf-8 file. -- Key: CASSANDRA-9898 URL: https://issues.apache.org/jira/browse/CASSANDRA-9898 Project: Cassandra Issue Type: Bug Components: Tools Environment: linux, os x yosemite. Reporter: Yasuharu Goto Assignee: Yasuharu Goto Priority: Minor Labels: cqlsh Fix For: 2.1.x, 2.2.x Attachments: cassandra-2.1-9898.txt, cassandra-2.2-9898.txt cqlsh crashes when it load a cql script file encoded in utf-8. This is a reproduction procedure. {noformat} $cat ./test.cql // 日本語のコメント use system; select * from system.peers; $cqlsh --version cqlsh 5.0.1 $cqlsh -f ./test.cql Traceback (most recent call last): File ./cqlsh, line 2459, in module main(*read_options(sys.argv[1:], os.environ)) File ./cqlsh, line 2451, in main shell.cmdloop() File ./cqlsh, line 940, in cmdloop line = self.get_input_line(self.prompt) File ./cqlsh, line 909, in get_input_line self.lastcmd = self.stdin.readline() File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 675, in readline return self.reader.readline(size) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 530, in readline data = self.read(readsize, firstline=True) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 477, in read newchars, decodedbytes = self.decode(data, self.errors) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 3: ordinal not in range(128) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CASSANDRA-9898) cqlsh crashes if it load a utf-8 file.
[ https://issues.apache.org/jira/browse/CASSANDRA-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654651#comment-14654651 ] Yasuharu Goto commented on CASSANDRA-9898: -- Hmm, I've seen the ticket, but then I thought it's different issue with mine because their error log looks so different. But now I agree with you. their repro code looks get fixed by my patch in my brief test. cqlsh crashes if it load a utf-8 file. -- Key: CASSANDRA-9898 URL: https://issues.apache.org/jira/browse/CASSANDRA-9898 Project: Cassandra Issue Type: Bug Components: Tools Environment: linux, os x yosemite. Reporter: Yasuharu Goto Assignee: Yasuharu Goto Priority: Minor Labels: cqlsh Fix For: 2.1.x, 2.2.x Attachments: cassandra-2.1-9898.txt, cassandra-2.2-9898.txt cqlsh crashes when it load a cql script file encoded in utf-8. This is a reproduction procedure. {noformat} $cat ./test.cql // 日本語のコメント use system; select * from system.peers; $cqlsh --version cqlsh 5.0.1 $cqlsh -f ./test.cql Traceback (most recent call last): File ./cqlsh, line 2459, in module main(*read_options(sys.argv[1:], os.environ)) File ./cqlsh, line 2451, in main shell.cmdloop() File ./cqlsh, line 940, in cmdloop line = self.get_input_line(self.prompt) File ./cqlsh, line 909, in get_input_line self.lastcmd = self.stdin.readline() File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 675, in readline return self.reader.readline(size) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 530, in readline data = self.read(readsize, firstline=True) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py, line 477, in read newchars, decodedbytes = self.decode(data, self.errors) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 3: ordinal not in range(128) {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)