Re: [sqlite] unicode case insensitive

2014-10-25 Thread dd
I am summarizing options to support unicode case-sensitive: 1. Richard Hipp: icu ext 2. Aleksey Tulinov: https://bitbucket.org/alekseyt/nunicode#markdown- header-sqlite3-extension 3. Grey's suggestion: custom collation Please add in options list if I missed. I don't have experience in

Re: [sqlite] unicode case insensitive

2014-10-25 Thread dd
typo: *I am summarizing options to support unicode* case-insensitive*: On Sat, Oct 25, 2014 at 10:34 AM, dd durga.d...@gmail.com wrote: I am summarizing options to support unicode case-sensitive: 1. Richard Hipp: icu ext 2. Aleksey Tulinov: https://bitbucket.org/alekseyt/nunicode#markdown-

[sqlite] unicode case insensitive

2014-10-24 Thread dd
Hi, ö and Ö same character but case different. I dont want to allow to insert two entries for same data with different case. It works well with ascii set. How to handle this? any inputs welcome. $./sqlite3 '/home//sqlite/test/a.db' SQLite version 3.8.7 2014-10-17 11:24:17 Enter .help for

Re: [sqlite] unicode case insensitive

2014-10-24 Thread Gerry Snyder
In a vaguely similar situation I wrote a custom collation that converted accented letters to their non-accented cousins. Since the conversion is on a case-by-case basis I also had to do a pre-screening that would show any non-ascii characters that I wasn't converting, so that I could add them

Re: [sqlite] unicode case insensitive

2014-10-24 Thread dd
Hi, Any sample/open source avail to custom collation. Will it work for like queries. Any performance degradation? Convert everything to upper (or lower) case brute force. Sorry. I am not clear. Can you please elaborate this. Thanks. On Fri, Oct 24, 2014 at 9:16 PM, Gerry

Re: [sqlite] unicode case insensitive

2014-10-24 Thread Richard Hipp
On Fri, Oct 24, 2014 at 1:44 PM, dd durga.d...@gmail.com wrote: Hi, Any sample/open source avail to custom collation. http://www.sqlite.org/compile.html#enable_icu Will it work for like queries. Yes Any performance degradation? Yes. Such is the price of unicode. -- D.

Re: [sqlite] unicode case insensitive

2014-10-24 Thread Aleksey Tulinov
On 24/10/14 20:44, dd wrote: dd, Any sample/open source avail to custom collation. Will it work for like queries. Any performance degradation? You might try nunicode: https://bitbucket.org/alekseyt/nunicode#markdown-header-sqlite3-extension. I think COLLATE NU700_NOCASE should do what

Re: [sqlite] unicode case insensitive

2014-10-24 Thread Gerry Snyder
By brute force I just meant specifying each conversion (such as Ö to ö) individually. In my Tcl code, it is done with a single [string map ...] statement containing all of the conversions. The down side being, as I mentioned earlier, that each time I run it on a new set of data I have to check

Re: [sqlite] unicode case insensitive

2014-10-24 Thread James K. Lowden
On Fri, 24 Oct 2014 21:44:50 +0400 dd durga.d...@gmail.com wrote: Convert everything to upper (or lower) case brute force. Sorry. I am not clear. Can you please elaborate this. The standard function tolower(3) is locale-dependent. If your locale is set to match the data's

[sqlite] Unicode support in SQLite

2014-10-14 Thread Aleksey Tulinov
Hello, I'm glad to announce that nunicode SQLite extension was updated to support Unicode-conformant case folding and was improved on performance of every component provided to SQLite. You can read about and download this extension at BitBucket page of nunicode library:

Re: [sqlite] Unicode support in SQLite

2014-10-14 Thread Kevin Benson
On Tue, Oct 14, 2014 at 4:37 AM, Aleksey Tulinov aleksey.tuli...@gmail.com wrote: Hello, I'm glad to announce that nunicode SQLite extension was updated to support Unicode-conformant case folding and was improved on performance of every component provided to SQLite. You can read about and

Re: [sqlite] Unicode support in SQLite

2014-10-14 Thread Aleksey Tulinov
On 14/10/14 17:02, Kevin Benson wrote: https://bitbucket.org/alekseyt/nunicode/downloads/libnusqlite3-1.4-4a0e4773-win32.zip --- 404 response code Thank you, fixed now. ___ sqlite-users mailing list sqlite-users@sqlite.org

Re: [sqlite] Unicode support in SQLite

2014-07-04 Thread Aleksey Tulinov
Hello, I'm glad to announce that nunicode SQLite extension was updated to support Unicode 7.0.0 character set. It also implements LIKE operation which is faster compared to previous releases. This extension provides the following Unicode-aware components: - upper(X) - lower(X) - X LIKE Y

Re: [sqlite] Unicode support in SQLite

2014-04-02 Thread Aleksey Tulinov
Hey, According to previous discussion in this mailing list, i've updated nunicode SQLite extension not to override default NOCASE collation due to possible issues with database indexing. Version 1.2.1 removes nunicode-specific NOCASE and NUNICODE collations and introduces NU630 and

[sqlite] Unicode support in SQLite

2014-01-24 Thread Aleksey Tulinov
Hey, I've just updated nunicode to version 1.2: https://bitbucket.org/alekseyt/nunicode Now all collations are backed by reduced DUCET. Library grew in size a little bit, you'll get Unicode collations for around 200Kb, but at the same time you will also get several languages completely

Re: [sqlite] Unicode support in SQLite

2013-11-10 Thread Gert Van Assche
Very nice! Thanks for sharing, Aleksey. 2013/11/9 Aleksey Tulinov aleksey.tuli...@gmail.com On 11/04/2013 11:50 AM, Aleksey Tulinov wrote: Hey, As you can see, this is truly full Unicode collation and case mapping with untailored special casing. Extension provides the following

Re: [sqlite] Unicode support in SQLite

2013-11-09 Thread Aleksey Tulinov
On 11/04/2013 11:50 AM, Aleksey Tulinov wrote: Hey, As you can see, this is truly full Unicode collation and case mapping with untailored special casing. Extension provides the following functions, statements and collations: I've updated extension, examples and documentation, now it's

[sqlite] Unicode support in SQLite

2013-11-04 Thread Aleksey Tulinov
Dear SQLite users, I'd like to present you Unicode support extension i've implemented for SQLite, it does full Unicode (6.3.0) collations, case mapping and untailored ordering, and takes only ~100Kb to do that if you link it statically. It's also open source and free (MIT license):

[sqlite] unicode() and char() functions does not exists

2013-06-27 Thread Stefano Zaglio
Hi, I'm tring this: select unicode('2') as a; and select char(50) but firefox.sqlite_manager (sqlite 3.7) and others say:no such function: unicode. Where I'm wrong? ___ sqlite-users mailing list sqlite-users@sqlite.org

Re: [sqlite] unicode() and char() functions does not exists

2013-06-27 Thread Richard Hipp
On Thu, Jun 27, 2013 at 4:19 AM, Stefano Zaglio stefano.zag...@seltris.itwrote: Hi, I'm tring this: select unicode('2') as a; and select char(50) but firefox.sqlite_manager (sqlite 3.7) and others say:no such function: unicode. Where I'm wrong? Those functions where added

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-11 Thread Nick Shaw
-Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Simon Slavin Sent: 10 April 2012 19:04 To: General Discussion of SQLite Database Subject: Re: [sqlite] Unicode problem when setting PRAGMA journal_mode Realised I made a typo

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-11 Thread Dan Kennedy
On 04/11/2012 09:50 PM, Nick Shaw wrote: -Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Simon Slavin Sent: 10 April 2012 19:04 To: General Discussion of SQLite Database Subject: Re: [sqlite] Unicode problem when setting

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-11 Thread Nick Shaw
-Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Dan Kennedy Sent: 11 April 2012 16:07 To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode problem when setting PRAGMA journal_mode I'll try your suggestion of setting

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-11 Thread Nick Shaw
-Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Dan Kennedy Sent: 11 April 2012 16:07 To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode problem when setting PRAGMA journal_mode After sqlite3_close() returns

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-11 Thread Nick Shaw
-Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Nick Shaw Sent: 11 April 2012 16:29 To: General Discussion of SQLite Database Subject: Re: [sqlite] Unicode problem when setting PRAGMA journal_mode -Original Message

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-10 Thread Nick Shaw
To: General Discussion of SQLite Database (sqlite-users@sqlite.org) Subject: [sqlite] Unicode problem when setting PRAGMA journal_mode Hi all, Our windows application uses sqlite, and we've had no problems with it in our existing builds, which use the multibyte character set. We are now converting

Re: [sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-10 Thread Simon Slavin
On 10 Apr 2012, at 1:42pm, Nick Shaw nick.s...@citysync.co.uk wrote: Realised I made a typo below: should have said PRAGMA journal_mode = DELETE (though setting it to WAL or OFF causes the same problem). Are you by any chance having a technical problem with the PRAGMA command itself ? For

[sqlite] Unicode problem when setting PRAGMA journal_mode

2012-04-05 Thread Nick Shaw
Hi all, Our windows application uses sqlite, and we've had no problems with it in our existing builds, which use the multibyte character set. We are now converting our codebase to Unicode. SqLite is quite happily running with our Unicode builds, creating SqLite databases in UTF-16LE

[sqlite] Unicode collation sequences for Kexi - the solution

2011-12-18 Thread Jaroslaw Staniek
Hi again, Unicode collation sequences for default Kexi (SQLite databases) is what defines _distinction_ between 1. ease of use and ease of deployment desktop db solutions and 2. complexity of server solutions (powerfull but tuned by hand, fragile to changes). I invested into a small research

Re: [sqlite] Unicode Confusion and Database Size

2011-09-04 Thread Mohit Sindhwani
Hi Simon, On 4/9/2011 12:01 AM, Simon Slavin wrote: Have you tried speed tests on your platform ? It's hard to tell which will be faster because it depends on what language and OS you're using that interacts with SQLite. So if you have your schema designed and any part of your application

Re: [sqlite] Unicode Confusion and Database Size

2011-09-03 Thread Mohit Sindhwani
Hi Igor, Thanks for your advice and guidance. On 1/9/2011 11:57 PM, Igor Tandetnik wrote: On 9/1/2011 10:24 AM, Mohit Sindhwani wrote: On the other hand, the other language that we are storing seems to require 3 bytes in UTF-8. Given that, it would appear that using UTF-8 would be a better

Re: [sqlite] Unicode Confusion and Database Size

2011-09-03 Thread Simon Slavin
On 3 Sep 2011, at 4:27pm, Mohit Sindhwani wrote: for our data, we can get savings in the region of 25% - 33% in the case of strings being stored in a language that does require 3bytes/ character. So, given that, we should explore UTF-16 in more detail. However, we also have a lot of

[sqlite] Unicode Confusion and Database Size

2011-09-01 Thread Mohit Sindhwani
Hi All, I apologize first if this question has its roots in my partial understanding of unicode and the various UTF-encodings. We're using Windows CE and SQLite3 - so far, we have only used ASCII data. Now, we're going to store data in other languages and feel the need to go towards

Re: [sqlite] Unicode Confusion and Database Size

2011-09-01 Thread Igor Tandetnik
On 9/1/2011 10:24 AM, Mohit Sindhwani wrote: I understand that the database could be either UTF-8 or UTF-16 - but that would apply to the full DB not to a single column, right? Right. If that is the case, would it not make the database larger if we had a lot of content that was originally

Re: [sqlite] Unicode Confusion and Database Size

2011-09-01 Thread Mohit Sindhwani
Hi Igor, On 1/9/2011 11:57 PM, Igor Tandetnik wrote: On 9/1/2011 10:24 AM, Mohit Sindhwani wrote: I understand that the database could be either UTF-8 or UTF-16 - but that would apply to the full DB not to a single column, right? Right. *many useful answers snipped* Thank you very much!!

Re: [sqlite] SQLite + unicode

2011-08-21 Thread NOCaut
Thanks i change 1251 to CP_UTF8 All work :jumping: -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32296232p32301685.html Sent from the SQLite mailing list archive at Nabble.com. ___ sqlite-users mailing list

Re: [sqlite] SQLite + unicode

2011-08-20 Thread NOCaut
For and '' i know thanks, and why you write ? i want write arabic symbul مثالمثالمثالمثال -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32296232p32300446.html Sent from the SQLite mailing list archive at Nabble.com.

Re: [sqlite] SQLite + unicode

2011-08-20 Thread Kees Nuyt
On Sat, 20 Aug 2011 01:45:42 -0700 (PDT), NOCaut per...@mail.ru wrote: For and '' i know thanks, and why you write ? i want write arabic symbul Apparently your utf-8 Arabic characters were dropped and replaced by ?, probably by my mail reader. My apologies. Replace

Re: [sqlite] SQLite + unicode

2011-08-20 Thread NOCaut
I try this function. Do you have Visual Studio. i show you my example. NOCaut wrote: char * unicode_to_1251(wchar_t *unicode_string) { int err; char * res; int res_len = WideCharToMultiByte( 1251, // Code page 0,

Re: [sqlite] SQLite + unicode

2011-08-20 Thread NOCaut
this is my example spellings on the VS2008 http://www.4shared.com/file/RDzSVPZq/SQLite_example.html -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32296232p32301433.html Sent from the SQLite mailing list archive at Nabble.com.

Re: [sqlite] SQLite + unicode

2011-08-20 Thread Jean-Christophe Deschamps
I try this function. Do you have Visual Studio. i show you my example. NOCaut wrote: char * unicode_to_1251(wchar_t *unicode_string) Why are you converting Unicode to 1251? This is a lossy conversion in the general case. Work with Unicode strings end-to-end, using the UTF encoding of

[sqlite] SQLite + unicode

2011-08-19 Thread NOCaut
Say my some wrapper for i can make this query: Select Value from Config Where Key = \بوبوبو\ Thanks. -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32296232p32296232.html Sent from the SQLite mailing list archive at Nabble.com.

Re: [sqlite] SQLite + unicode

2011-08-19 Thread Kees Nuyt
On Fri, 19 Aug 2011 08:26:49 -0700 (PDT), NOCaut per...@mail.ru wrote: Say my some wrapper for i can make this query: Select Value from Config Where Key = \??\ In SQL, string literals are delimited by single qoutes. So, the statement would be: SELECT Value FROM Config WHERE Key =

Re: [sqlite] SQLite + unicode

2011-08-19 Thread Stephan Beal
On Fri, Aug 19, 2011 at 5:46 PM, Kees Nuyt k.n...@zonnet.nl wrote: Also of interest might be: http://www.sqlite.org/cvstrac/wiki?p=SqliteWrappers i've got a link addition for the JavaScript bindings, if anyone with wiki commit access is listening...

Re: [sqlite] SQLite + unicode

2011-08-11 Thread NOCaut
I now how work with sqlite guys my problem: in const char * and i wont wchar_t*. becouse wchar_t* - unicode type understand int sqlite3_exec( sqlite3*, /* An open database */ const char *sql, /* SQL to be executed */ sqlite3_callback, /*

Re: [sqlite] SQLite + unicode

2011-08-11 Thread Teg
Hello NOCaut, I convert everything to UTF-8 for insert and then back to ascii or unicode when I pull the data from the DB. C Thursday, August 11, 2011, 4:20:36 AM, you wrote: N I now how work with sqlite guys N my problem: in const char * and i wont wchar_t*. becouse wchar_t* - N unicode

Re: [sqlite] SQLite + unicode

2011-08-11 Thread NOCaut
You think i most 1 -convert to UTF-8 2 -read un the const char * 3 - convert to anscii i right understand you? -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32241427.html Sent from the SQLite mailing list archive at Nabble.com.

Re: [sqlite] SQLite + unicode

2011-08-11 Thread Igor Tandetnik
NOCaut per...@mail.ru wrote: I now how work with sqlite guys my problem: in const char * and i wont wchar_t*. becouse wchar_t* - unicode type understand int sqlite3_exec( sqlite3*, /* An open database */ const char *sql, /* SQL to be executed */

Re: [sqlite] SQLite + unicode

2011-08-11 Thread NOCaut
I want use but sqlity3.h NOT have this function. and i create this post for you help me use this function -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32241783.html Sent from the SQLite mailing list archive at Nabble.com.

Re: [sqlite] SQLite + unicode

2011-08-11 Thread Igor Tandetnik
NOCaut per...@mail.ru wrote: I want use but sqlity3.h NOT have this function. Does not have which function? The one you can download from http://sqlite.org/download.html certainly declares all the functions I've mentioned. -- Igor Tandetnik ___

Re: [sqlite] SQLite + unicode

2011-08-11 Thread Pavel Ivanov
Don't use sqlite3_exec. Use sqlite3_prepare16 (which accepts wchar_t*), sqlite3_step, sqlite3_finalize. Read text from columns with sqlite3_column_text16 (which returns wchar_t*). I'd say it's not exactly this way. AFAIK, wchar_t on Linux is 32-bit, but sqlite3_column_text16 will return

Re: [sqlite] SQLite + unicode

2011-08-11 Thread NOCaut
please kill me %-| -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32242440.html Sent from the SQLite mailing list archive at Nabble.com. ___ sqlite-users mailing list sqlite-users@sqlite.org

Re: [sqlite] SQLite + unicode

2011-08-11 Thread NOCaut
It`s so hard for me. I'll be very grateful :jumping: -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32243061.html Sent from the SQLite mailing list archive at Nabble.com. ___ sqlite-users mailing list

[sqlite] SQLite + unicode

2011-08-10 Thread NOCaut
Where i can find c++ unicode unit for work with SQLite database? Thanks. -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32235242.html Sent from the SQLite mailing list archive at Nabble.com. ___ sqlite-users

Re: [sqlite] SQLite + unicode

2011-08-10 Thread Igor Tandetnik
On 8/10/2011 11:55 AM, NOCaut wrote: Where i can find c++ unicode unit for work with SQLite database? Thanks. What kind of unit? What is it that you want to do, but cannot, without such a unit? -- Igor Tandetnik ___ sqlite-users mailing list

Re: [sqlite] SQLite + unicode

2011-08-10 Thread NOCaut
Sorry for my bad english)) I want find source code for work with sqlite.. -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32235334.html Sent from the SQLite mailing list archive at Nabble.com. ___ sqlite-users

Re: [sqlite] SQLite + unicode

2011-08-10 Thread Stephan Beal
On Wed, Aug 10, 2011 at 5:55 PM, NOCaut per...@mail.ru wrote: Where i can find c++ unicode unit for work with SQLite database? Thanks. If you're looking for a generic unicode C++ library i can highly recommend: http://utfcpp.sourceforge.net/ it's easy to use, header-only, and liberally

Re: [sqlite] SQLite + unicode

2011-08-10 Thread NOCaut
in the other forum say: You can get the SQLite source code and compile it directly with C++ Builder (2010 and XE tested). Come to home and see -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32235384.html Sent from the SQLite mailing list archive at

Re: [sqlite] SQLite + unicode

2011-08-10 Thread Igor Tandetnik
On 8/10/2011 12:08 PM, NOCaut wrote: in the other forum say: You can get the SQLite source code and compile it directly with C++ Builder (2010 and XE tested). If you need SQLite source code, it's here: http://sqlite.org/download.html . See also http://sqlite.org/amalgamation.html -- Igor

Re: [sqlite] SQLite + unicode

2011-08-10 Thread NOCaut
I work in VS2008 c++ i create data base my.db and wont use U N I C O D E function from this DLL i find class or unit for connect to my base from VS2008 http://sqlite.org/download.html - this link help me? you understand me? -- View this message in context:

Re: [sqlite] SQLite + unicode

2011-08-10 Thread Doug Currie
On Aug 10, 2011, at 12:39 PM, NOCaut wrote: I work in VS2008 c++ i create data base my.db and wont use U N I C O D E function from this DLL i find class or unit for connect to my base from VS2008 http://sqlite.org/download.html - this link help me? you understand me? No, but maybe

Re: [sqlite] SQLite + unicode

2011-08-10 Thread Igor Tandetnik
On 8/10/2011 12:39 PM, NOCaut wrote: I work in VS2008 c++ i create data base my.db and wont use U N I C O D E function from this DLL Why won't you? Which DLL is 'this DLL'? i find class or unit for connect to my base from VS2008 http://sqlite.org/download.html - this link help me? I

[sqlite] Unicode function for collapsing upper/lower case

2011-08-07 Thread Simon Slavin
This is off-charter for this list but I hope the listmom will indulge me since it's the sort of thing people here know. We've already established that it's impossible to implement a simple function to sort unicode strings into order. But I wondered whether there were patterns in the unicode

Re: [sqlite] Unicode function for collapsing upper/lower case

2011-08-07 Thread Igor Tandetnik
Simon Slavin slav...@bigfraud.org wrote: But I wondered whether there were patterns in the unicode which made it simple to ignore string case. http://www.sqlite.org/cvstrac/fileview?f=sqlite/ext/icu/README.txt -- Igor Tandetnik ___ sqlite-users

[sqlite] Unicode command line bug in Windows version of sqlite3 with patch

2010-03-16 Thread Kunc Filip
Hello SQLite Team, We currently use sqlite 3.6.23. We have a big problem with characters with accents or other special characters in path to database file, for example in Czech Windows XP the Application Data folder is translated to Data aplikací so if the accented 'í' is in path the

Re: [sqlite] Unicode command line bug in Windows version of sqlite3 with patch

2010-03-16 Thread Pavel Ivanov
sqlite3_open[_v2] accepts all filenames in UTF-8 (although it doesn't check for valid UTF-8 string). So CP_UTF8 cannot be changed anywhere. OTOH maybe command line utility should have some logic of re-encoding of command line parameter from terminal encoding to UTF-8. But I'm not sure about that.

Re: [sqlite] Unicode command line bug in Windows version of sqlite3 with patch

2010-03-16 Thread Jean-Christophe Deschamps
We currently use sqlite 3.6.23. We have a big problem with characters with accents or other special characters in path to database file, for example in Czech Windows XP the Application Data folder is translated to Data aplikací so if the accented 'í' is in path the sqlite3.exe writes that it is

Re: [sqlite] Unicode command line bug in Windows version of sqlite3 with patch

2010-03-16 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jean-Christophe Deschamps wrote: A much better solution is to use a MSYS terminal (installed by MinGW), so you have UTF-8 command-line and data entry/display without conversion. No need to patch anything. No need for msys. You can make a

Re: [sqlite] Unicode support

2009-11-20 Thread Nicolas Williams
On Tue, Nov 17, 2009 at 09:31:46PM -0500, Tim Romano wrote: quote but if ORDER BY is relying on an index for ordering, then flip() can have negative effects./quote Substr() could have negative effects on ordering too. That is a red herring. Flip() is merely a function that reverses

[sqlite] Unicode support

2009-11-17 Thread Simon Slavin
On 17 Nov 2009, at 6:37pm, Igor Tandetnik wrote: Simon Slavin slav...@bigfraud.org wrote: On 17 Nov 2009, at 5:52pm, Igor Tandetnik wrote: But for your goals, it has to be sortable, right? In a proper Unicode collation, U+0041 U+0301 would behave quite differently from U+0301 U+0041.

Re: [sqlite] Unicode support

2009-11-17 Thread Igor Tandetnik
Simon Slavin slav...@bigfraud.org wrote: On 17 Nov 2009, at 6:37pm, Igor Tandetnik wrote: Simon Slavin slav...@bigfraud.org wrote: First split the string into characters, then reassemble them in reverse order. The problem is, in Unicode it's not quite clear what constitutes a character.

Re: [sqlite] Unicode support

2009-11-17 Thread Nicolas Williams
On Tue, Nov 17, 2009 at 02:01:55PM -0500, Igor Tandetnik wrote: This would mean that the result of the hypothetical flip() function would be locale-dependent. E.g. in Spanish Traditional sort, a combination 'ch' sorts as if it were a single letter between 'c' and 'd', forming a single sort

Re: [sqlite] Unicode support

2009-11-17 Thread Beau Wilkinson
:01 PM To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode support Simon Slavin slav...@bigfraud.org wrote: On 17 Nov 2009, at 6:37pm, Igor Tandetnik wrote: Simon Slavin slav...@bigfraud.org wrote: First split the string into characters, then reassemble them in reverse order. The problem

Re: [sqlite] Unicode support

2009-11-17 Thread Igor Tandetnik
Nicolas Williams nicolas.willi...@sun.com wrote: On Tue, Nov 17, 2009 at 02:01:55PM -0500, Igor Tandetnik wrote: This would mean that the result of the hypothetical flip() function would be locale-dependent. E.g. in Spanish Traditional sort, a combination 'ch' sorts as if it were a single

Re: [sqlite] Unicode support

2009-11-17 Thread Beau Wilkinson
the realm of ASCII-with-zeroes-on-top. From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] On Behalf Of Igor Tandetnik [itandet...@mvps.org] Sent: Tuesday, November 17, 2009 1:01 PM To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode

Re: [sqlite] Unicode support

2009-11-17 Thread Nicolas Williams
On Tue, Nov 17, 2009 at 05:15:16PM -0500, Igor Tandetnik wrote: Nicolas Williams nicolas.willi...@sun.com wrote: This is no longer true, either of 'ch' nor 'll'. There is a number of contractions in Hungarian that are still very much in use, but I can't recall them off the top of my head

Re: [sqlite] Unicode support

2009-11-17 Thread Tim Romano
For those who are insisting on Unicode graphemic codepoint-combination intelligence: why can't we have a function that simply reverses the order of the codepoints, and is blissfully ignorant about what those individual codepoints or codepoint-combinations might signify as graphemes in a

Re: [sqlite] Unicode support

2009-11-17 Thread Jean-Christophe Deschamps
Tim, For those who are insisting on Unicode graphemic codepoint-combination intelligence: why can't we have a function that simply reverses the order of the codepoints, and is blissfully ignorant about what those individual codepoints or codepoint-combinations might signify as graphemes in a

Re: [sqlite] Unicode support

2009-11-17 Thread Tim Romano
quote but if ORDER BY is relying on an index for ordering, then flip() can have negative effects./quote Substr() could have negative effects on ordering too. That is a red herring. Flip() is merely a function that reverses the order of codepoints as found without knowing anything about what

[sqlite] Unicode Character

2008-11-13 Thread Baskaran Selvaraj
Hi All, We have a field of datatype nvarchar in SQL Server 2005, which stores the data in unicode. When I export the data into SQLite, it is storing as ascii, even if I change the datatype as nvarchar when the table is created. I am using SQL Maestro tool to export the data from SQL

Re: [sqlite] Unicode searches

2008-04-07 Thread Dan
On Apr 6, 2008, at 5:10 AM, Keith Stemmer wrote: Yes, I can add a custom collation which works for ASCII chars LOL. If you don't understand the problem, just don't reply. By the way, you can read on the SQLite website that the developer describes my problem as a BUG which is nice to

Re: [sqlite] Unicode searches

2008-04-07 Thread Miha Vrhovnik
Someone sent a sqlite3_unicode.c file to this mailing list in the last week of December, 1st week of January which implemented upper/lower and some other functions. File was released as public domain if I remember correctly and used data from Unicode 5.1 standard. As ICU brings a lot of bulk

Re: [sqlite] Unicode searches

2008-04-07 Thread Keith Stemmer
Cory, sorry, I had a bad day. Keith ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Unicode searches

2008-04-07 Thread Jay A. Kreibich
On Sat, Apr 5, 2008 at 11:42 PM, Cory Nelson [EMAIL PROTECTED] wrote: Sort order is highly dependent on locale. You can add custom collations to do this. [EMAIL PROTECTED] wrote: That was not was I was talking about. I was not talking about Sort Order but about Searches.

[sqlite] Unicode searches

2008-04-05 Thread Keith Stemmer
Hello! I found SQLite quite amazing, but I think there is one showstopper for me. It seems that searches for Unicode strings are case sensitive and there is no (easy) way around that. Could you please confirm or deny this? Your explanation... (A bug: SQLite only understands upper/lower case for

Re: [sqlite] Unicode searches

2008-04-05 Thread Cory Nelson
Sort order is highly dependent on locale. You can add custom collations to do this. On Sat, Apr 5, 2008 at 10:41 AM, Keith Stemmer [EMAIL PROTECTED] wrote: Hello! I found SQLite quite amazing, but I think there is one showstopper for me. It seems that searches for Unicode strings are case

Re: [sqlite] Unicode searches

2008-04-05 Thread Cory Nelson
They are one and the same. Look up collations. On Sat, Apr 5, 2008 at 2:55 PM, Keith Stemmer [EMAIL PROTECTED] wrote: That was not was I was talking about. I was not talking about Sort Order but about Searches. Keith On Sat, Apr 5, 2008 at 11:42 PM, Cory Nelson [EMAIL PROTECTED] wrote:

Re: [sqlite] Unicode searches

2008-04-05 Thread Keith Stemmer
Yes, I can add a custom collation which works for ASCII chars LOL. If you don't understand the problem, just don't reply. By the way, you can read on the SQLite website that the developer describes my problem as a BUG which is nice to read. At least he doesn't call it a feature. Keith. Sort

Re: [sqlite] Unicode searches

2008-04-05 Thread Gunnar Roth
Keith Stemmer schrieb: Yes, I can add a custom collation which works for ASCII chars LOL. Plain wrong If you don't understand the problem, just don't reply. Plain unreasonable carefulle read ( and understand) this http://sqlite.org/c3ref/create_collation.html and this

[sqlite] Unicode support for Sqlite?

2007-12-12 Thread Sreedhar.a
Hi, Does Sqlite support unicode? I have seen that it supports utf-8 and utf-16. I want to know whether it supports unicode character formats. Thanks and Best Regards, A.Sreedhar.

RE: [sqlite] Unicode support for Sqlite?

2007-12-12 Thread Sreedhar.a
To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode support for Sqlite? On 12/12/07, Sreedhar.a [EMAIL PROTECTED] wrote: Does Sqlite support unicode? I have seen that it supports utf-8 and utf-16. I want to know whether it supports unicode character formats. Unicode is a very large and complex

Re: [sqlite] Unicode support for Sqlite?

2007-12-12 Thread Trevor Talbot
On 12/12/07, Sreedhar.a [EMAIL PROTECTED] wrote: Does Sqlite support unicode? I have seen that it supports utf-8 and utf-16. I want to know whether it supports unicode character formats. Unicode is a very large and complex topic, so that question is way too vague to answer. Can you provide an

Re: [sqlite] Unicode support for Sqlite?

2007-12-12 Thread Trevor Talbot
On 12/12/07, Sreedhar.a [EMAIL PROTECTED] wrote: I am using the sqlite to store the metadata of audio files. Is it possible to store the metadata in unicode character format in sqlite. Yes; SQLite assumes all TEXT type data in the database is Unicode. You can work with it in UTF-8 with the

RE: [sqlite] Unicode support for Sqlite?

2007-12-12 Thread Sreedhar.a
Thankyou all for the quick replies. Best Regards, A.Sreedhar. -Original Message- From: Trevor Talbot [mailto:[EMAIL PROTECTED] Sent: Wednesday, December 12, 2007 5:08 PM To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode support for Sqlite? On 12/12/07, Sreedhar.a [EMAIL

Re: [sqlite] Unicode support for Sqlite?

2007-12-12 Thread Daniel Önnerby
utf-8 and utf-16 ARE unicode formats. But there are some things that sqlite does not handle without the ICU extension. The ICU extension extends SQLite with the following functionallity: 1.1 SQL Scalars upper() and lower() 1.2 Unicode Aware LIKE Operator 1.3 ICU Collation

[sqlite] Unicode Capabilities in Simple Terms

2007-09-14 Thread Asif Lodhi
Hi, I've been just glancing over the Unicode related posts. However, I would like to know how it's possible for me to insert text in different languages in an Sqlite database. Can you fixate the type of the language for any particular database? I would be thankful if any of you guys could explain

Re: [sqlite] Unicode Capabilities in Simple Terms

2007-09-14 Thread Cory Nelson
On 9/14/07, Asif Lodhi [EMAIL PROTECTED] wrote: Hi, I've been just glancing over the Unicode related posts. However, I would like to know how it's possible for me to insert text in different languages in an Sqlite database. Can you fixate the type of the language for any particular database?

Re: [sqlite] Unicode Again... Sti ll Stuck... A Challenge... Store and retrieve the word résumé with out using a unicode string literal

2007-07-31 Thread wcmadness
Well, I have a solution to my own problem, and I wanted to post it for two reasons: First, it might help someone; second, I'm wondering if someone can explain it to me... Here's the scoop... I'm on a Windows machine. It turns out that the default code page on Windows is cp437. So, in my

Re: [sqlite] Unicode Again... Still Stuck... A Challenge... Store and retrieve the word résumé without using a unicode string literal

2007-07-31 Thread Nuno Lucas
First, let me start by saying I don't have much experience with Python, but this isn't a python problem. On 7/31/07, wcmadness [EMAIL PROTECTED] wrote: [...] I'm on a Windows machine. It turns out that the default code page on Windows is cp437. So, in my Python code, if I type: Wrong. The

Re: [sqlite] Unicode Again... Sti ll Stuck... A Challenge... Store and retrieve the word résumé with out using a unicode string literal

2007-07-31 Thread wcmadness
Folks: Thanks so much for your replies. I have absorbed a lot of information about code pages and unicode in the last couple of days. My understanding is far from complete, but I'm ahead of where I was... In the end, my best answer was to set the text_factory property of the connection object

  1   2   >