[jira] [Commented] (CASSANDRA-9898) cqlsh crashes if it load a utf-8 file.

2015-08-24 Thread Carl Yeksigian (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14709591#comment-14709591
 ] 

Carl Yeksigian commented on CASSANDRA-9898:
---

+1. It would be great to add a 
[dtest|https://github.com/riptano/cassandra-dtest/blob/master/cqlsh_tests/cqlsh_tests.py]
 for this.

 cqlsh crashes if it load a utf-8 file.
 --

 Key: CASSANDRA-9898
 URL: https://issues.apache.org/jira/browse/CASSANDRA-9898
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
 Environment: linux, os x yosemite.
Reporter: Yasuharu Goto
Assignee: Yasuharu Goto
Priority: Minor
  Labels: cqlsh
 Fix For: 2.1.x, 2.2.x

 Attachments: cassandra-2.1-9898.txt, cassandra-2.2-9898.txt


 cqlsh crashes when it load a cql script file encoded in utf-8.
 This is a reproduction procedure.
 {noformat}
 $cat ./test.cql
 // 日本語のコメント
 use system;
 select * from system.peers;
 $cqlsh --version
 cqlsh 5.0.1
 $cqlsh -f ./test.cql
 Traceback (most recent call last):
   File ./cqlsh, line 2459, in module
 main(*read_options(sys.argv[1:], os.environ))
   File ./cqlsh, line 2451, in main
 shell.cmdloop()
   File ./cqlsh, line 940, in cmdloop
 line = self.get_input_line(self.prompt)
   File ./cqlsh, line 909, in get_input_line
 self.lastcmd = self.stdin.readline()
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 675, in readline
 return self.reader.readline(size)
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 530, in readline
 data = self.read(readsize, firstline=True)
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 477, in read
 newchars, decodedbytes = self.decode(data, self.errors)
 UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 3: 
 ordinal not in range(128)
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-9898) cqlsh crashes if it load a utf-8 file.

2015-08-19 Thread Yasuharu Goto (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703391#comment-14703391
 ] 

Yasuharu Goto commented on CASSANDRA-9898:
--

Ping [~carlyeks].
What should I do as a next step?

 cqlsh crashes if it load a utf-8 file.
 --

 Key: CASSANDRA-9898
 URL: https://issues.apache.org/jira/browse/CASSANDRA-9898
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
 Environment: linux, os x yosemite.
Reporter: Yasuharu Goto
Assignee: Yasuharu Goto
Priority: Minor
  Labels: cqlsh
 Fix For: 2.1.x, 2.2.x

 Attachments: cassandra-2.1-9898.txt, cassandra-2.2-9898.txt


 cqlsh crashes when it load a cql script file encoded in utf-8.
 This is a reproduction procedure.
 {noformat}
 $cat ./test.cql
 // 日本語のコメント
 use system;
 select * from system.peers;
 $cqlsh --version
 cqlsh 5.0.1
 $cqlsh -f ./test.cql
 Traceback (most recent call last):
   File ./cqlsh, line 2459, in module
 main(*read_options(sys.argv[1:], os.environ))
   File ./cqlsh, line 2451, in main
 shell.cmdloop()
   File ./cqlsh, line 940, in cmdloop
 line = self.get_input_line(self.prompt)
   File ./cqlsh, line 909, in get_input_line
 self.lastcmd = self.stdin.readline()
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 675, in readline
 return self.reader.readline(size)
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 530, in readline
 data = self.read(readsize, firstline=True)
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 477, in read
 newchars, decodedbytes = self.decode(data, self.errors)
 UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 3: 
 ordinal not in range(128)
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-9898) cqlsh crashes if it load a utf-8 file.

2015-08-04 Thread Yasuharu Goto (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654600#comment-14654600
 ] 

Yasuharu Goto commented on CASSANDRA-9898:
--

Oops, I've not paste the last line of my error log. I've updated my description.

 cqlsh crashes if it load a utf-8 file.
 --

 Key: CASSANDRA-9898
 URL: https://issues.apache.org/jira/browse/CASSANDRA-9898
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
 Environment: linux, os x yosemite.
Reporter: Yasuharu Goto
Assignee: Yasuharu Goto
Priority: Minor
  Labels: cqlsh
 Fix For: 2.1.x, 2.2.x

 Attachments: cassandra-2.1-9898.txt, cassandra-2.2-9898.txt


 cqlsh crashes when it load a cql script file encoded in utf-8.
 This is a reproduction procedure.
 {noformat}
 $cat ./test.cql
 // 日本語のコメント
 use system;
 select * from system.peers;
 $cqlsh --version
 cqlsh 5.0.1
 $cqlsh -f ./test.cql
 Traceback (most recent call last):
   File ./cqlsh, line 2459, in module
 main(*read_options(sys.argv[1:], os.environ))
   File ./cqlsh, line 2451, in main
 shell.cmdloop()
   File ./cqlsh, line 940, in cmdloop
 line = self.get_input_line(self.prompt)
   File ./cqlsh, line 909, in get_input_line
 self.lastcmd = self.stdin.readline()
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 675, in readline
 return self.reader.readline(size)
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 530, in readline
 data = self.read(readsize, firstline=True)
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 477, in read
 newchars, decodedbytes = self.decode(data, self.errors)
 UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 3: 
 ordinal not in range(128)
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-9898) cqlsh crashes if it load a utf-8 file.

2015-08-04 Thread Yasuharu Goto (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654651#comment-14654651
 ] 

Yasuharu Goto commented on CASSANDRA-9898:
--

Hmm, I've seen the ticket, but then I thought it's different issue with mine 
because their error log looks so different.
But now I agree with you. their repro code looks get fixed by my patch in my 
brief test.

 cqlsh crashes if it load a utf-8 file.
 --

 Key: CASSANDRA-9898
 URL: https://issues.apache.org/jira/browse/CASSANDRA-9898
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
 Environment: linux, os x yosemite.
Reporter: Yasuharu Goto
Assignee: Yasuharu Goto
Priority: Minor
  Labels: cqlsh
 Fix For: 2.1.x, 2.2.x

 Attachments: cassandra-2.1-9898.txt, cassandra-2.2-9898.txt


 cqlsh crashes when it load a cql script file encoded in utf-8.
 This is a reproduction procedure.
 {noformat}
 $cat ./test.cql
 // 日本語のコメント
 use system;
 select * from system.peers;
 $cqlsh --version
 cqlsh 5.0.1
 $cqlsh -f ./test.cql
 Traceback (most recent call last):
   File ./cqlsh, line 2459, in module
 main(*read_options(sys.argv[1:], os.environ))
   File ./cqlsh, line 2451, in main
 shell.cmdloop()
   File ./cqlsh, line 940, in cmdloop
 line = self.get_input_line(self.prompt)
   File ./cqlsh, line 909, in get_input_line
 self.lastcmd = self.stdin.readline()
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 675, in readline
 return self.reader.readline(size)
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 530, in readline
 data = self.read(readsize, firstline=True)
   File 
 /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py,
  line 477, in read
 newchars, decodedbytes = self.decode(data, self.errors)
 UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 3: 
 ordinal not in range(128)
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)