[Firebird-devel] [FB-Tracker] Created: (CORE-3447) Collation is not installed with icu > 4.2
Collation is not installed with icu > 4.2
-
Key: CORE-3447
URL: http://tracker.firebirdsql.org/browse/CORE-3447
Project: Firebird Core
Issue Type: Bug
Components: Charsets/Collation
Affects Versions: 2.1.4, 2.5.0
Environment: Firebird build with system icu under Linux
Reporter: Philippe Makowski
$ ldd /usr/lib64/firebird/bin/fbserver | grep icu
libicuuc.so.44 => /usr/lib64/libicuuc.so.44 (0x0038e940)
libicudata.so.44 => /usr/lib64/libicudata.so.44 (0x0038e9c0)
libicui18n.so.44 => /usr/lib64/libicui18n.so.44 (0x0038eae0)
show system collations;
give
UNICODE, CHARACTER SET UTF8, PAD SPACE, SYSTEM
UNICODE_CI, CHARACTER SET UTF8, FROM EXTERNAL ('UNICODE'), PAD SPACE,
CASE INSENSITIVE, SYSTEM
UNICODE_FSS, CHARACTER SET UNICODE_FSS, PAD SPACE, SYSTEM
UTF8, CHARACTER SET UTF8, PAD SPACE, SYSTEM
but :
SQL> create table test (C1 varchar(32) character set UTF8 collate UTF8,
C2 varchar(10) character set ISO8859_1 collate FR_FR);
SQL> show table test;
C1 VARCHAR(32) CHARACTER SET UTF8 Nullable
C2 VARCHAR(10) CHARACTER SET ISO8859_1 Nullable
COLLATE FR_FR
SQL> create table test2 (C1 varchar(32) character set UTF8 collate UNICODE);
Statement failed, SQLCODE = -607
unsuccessful metadata update
-TEST2
-COLLATION UNICODE for CHARACTER SET UTF8 is not installed
same with for unicode_ci and unicode_ci_ai and certainly others
reported first in Fedora bug tracker
https://bugzilla.redhat.com/show_bug.cgi?id=697313
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://tracker.firebirdsql.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
--
Benefiting from Server Virtualization: Beyond Initial Workload
Consolidation -- Increasing the use of server virtualization is a top
priority.Virtualization can reduce costs, simplify management, and improve
application availability and disaster protection. Learn more about boosting
the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev
Firebird-Devel mailing list, web interface at
https://lists.sourceforge.net/lists/listinfo/firebird-devel
[Firebird-devel] ODS12. RDB$FUNCTION_ARGUMENTS. Description field.
Hi The system table "RDB$FUNCTION_ARGUMENTS" (in ODS12) still exists without "RDB$DESCRIPTION" field. RDB$PROCEDURE_PARAMETERS contains this (and RDB$SYSTEM_FLAG also) field. Kovalenko Dmitry-- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2devFirebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] Index is corrupt (missing entries) in table
From: Borut Maricic [mailto:borut.mari...@borut.eu] >Oh, yes, unfortunately we have. >In fact, we became aware of this for the first time under 2.1.4 Just some more info here. When you restore a database, it looks at your index definitions, and current data, and builds the indices from that. That is why backing up and restoring will rectify the problem (temporarily, till a new corruption occurs) I find I only see the index error in Firebird.log after doing a Database Validation (which doesn't fix the error, just reports it) So, if I just optimise, the problem just gets fixed with no signs of a problem being posted to the Firebird.log (|just letting you know, so you are aware where and when these messages are seen) I think Vlad is going to need a copy of your database you get to the bottom of the problem, so if you're customer is not going to allow that, it's going to be a problem :-( I have 4 or 5 large clients with this problem, and I am in the process of convincing them to try 2.1.4. We have a few other sites who have updated, but they never had a problem before, and are not noticing any difference at all between versions, so that's good but nothing conclusive yet with regards to index corruptions. Will post the results here, as soon as I have them... Are there perhaps any other messages in your Firebird.log apart from the index corruption ones? Maya -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] The boot build again
> -Original Message- > From: Vlad Khorsun [mailto:hv...@users.sourceforge.net] > Sent: Domingo, 17 de Abril de 2011 5:21 > > > I mean, it should be > > able to complete itself without my manual intervention to > copy some files in > > addition to run make_boot. > > What files are you need to copy ? I was thinking that maybe, copying some plugins to the same dir where the engine is being built, may help the process finish normally. > > > I still get this with the latest sources: > > > > 1>-- Build started: Project: isql, Configuration: Debug > Win32 -- > > Hmm.. never run make_boot DEBUG :) Tried it right now > (VC10, Win32) - all is OK. > > > 1>Compiling... > > > > 1>isql - 0 error(s), 1 warning(s) > > == Build: 1 succeeded, 0 failed, 3 up-to-date, 0 > skipped == > > > > Statement failed, SQLSTATE = 39000 > > Entrypoint of plugin > > > F:\fb3dev\fbbuild\firebird30\temp\Win32\debug\firebird\plugins > /fbtrace does > > not > > exist > > Statement failed, SQLSTATE = 39000 > > Do you have file \builds\win32\defs\plugin.def ? Yes and besides the license, it says EXPORTS firebird_plugin > > I hope the people that develop FB from Windows will share > their trick on how > > to bypass this problem. > > Believe me or not, but there is not tricks known to me. > It just works :) Maybe some environment variable that you defined at the OS level and thus it's always active? C. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
[Firebird-devel] [FB-Tracker] Created: (CORE-3446) Allow conversion from/to BLOBs and others types in the API functions (XSQLVAR or blr messages)
Allow conversion from/to BLOBs and others types in the API functions (XSQLVAR or blr messages) -- Key: CORE-3446 URL: http://tracker.firebirdsql.org/browse/CORE-3446 Project: Firebird Core Issue Type: Improvement Components: API / Client Library, Engine Reporter: Adriano dos Santos Fernandes It's allowed to use XSQLVAR (or blr messages) between different types like number->varchar (or vice-versa) but it's not allowed to use different types when one of them is a blob. DSQL moves data using MOVD_move, which do it like a client move. This was ok before, cause DSQL was not part of the engine and blobs wasn't very integrated with others types. Now it's very inconsistent. The proposed change makes possible to move blobs to/from different types in the execute and fetch calls. For input parameters, it is specially good as user can put the parameter as string without need to create and fill a blob from the client side. For output (execute or fetch), it's good when the application knows it's data and may describe a blob as a string with its maximum length. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://tracker.firebirdsql.org/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] BLOBs in DSQL
On 18-04-2011 03:21, Dmitry Yemanov wrote: > 17.04.2011 22:03, Adriano dos Santos Fernandes wrote: >> >> It's allowed to use XSQLVAR (or blr messages) between different types >> like number->varchar (or vice-versa) but it's not allowed to use >> different types when one of them is a blob. >> >> DSQL moves data using MOVD_move, which do it like a client move. This >> was ok before, cause DSQL was not part of the engine and blobs wasn't >> very integrated with others types. Now it's very inconsistent. >> >> I've done a small change making possible to move blobs to/from different >> types in the fetch call. This would be done in execute too. >> >> For input parameters, it would be specially good as user can put the >> parameter as string without need to create and fill a blob from the >> client side. >> >> For output (execute or fetch), it's good when the application knows it's >> data and may describe a blob as a string with its maximum length. > > I welcome this change. > > Is it doable to have it backported into v2.5.1? Yes, it is. Adriano -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] ICU. VS2010 project files
On 04/18/11 21:24, Dmitry Yemanov wrote: > 18.04.2011 13:26, Alex Peshkoff wrote: > >>> So, are we going to use more recent ICU libraries in FB3 ? >> Vlad, I think yes > This sounds as a good idea to me as well. > >> Ideally ICU should be installed by package manager due to dependency. >> But taking into an account that such method of install is not too >> popular in windows (or may be I'm wrong and something has changed during >> last years?) > It's not only about popularity, but also about a "install-by-copying" > approach for the embedded server which was always considered a feature. > So we have no other choice but to have the ICU binaries included in our > Windows packages (or available as a separate download). As a separate download ICU binaries are always available from IBM site (including win32/64). Therefore adding them to installer is just about 'one click install' on windows. I suppose they are needed in self-extract installer first of all for this purpose. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] Index is corrupt (missing entries) in table
Oh, yes, unfortunately we have. In fact, we became aware of this for the first time under 2.1.4 and hence thought about the unlikely possibility that it might be some kind of degradation. Since we have not done such validations before, we then validated a long list of backups of this DB (here not .fbk, but frozen compressed .fb), many of which were changed for the last time before the 2.1.4. So we became aware of the fact that the problem must have been there for the long time and going unnoticed. It seems to be completely irrelevant under which Version this index is being built (as I said, we did not test 1.5) - validations fail but we are not able to notice any other consequences. As I said - backup to .fbk and restore back to .fb have no problems too. We have not seen something like that ever before. Anyway, thank you for your suggestion. Since we do not have any good ideas now, we are eager to hear any possible suggestion. 2011-04-18 14:35:51 Maya Opperman (m...@omniaccounts.co.za): > Have you tried Firebird 2.1.4? Apparently that is > supposed to have sorted this problem out... -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] ICU. VS2010 project files
18.04.2011 13:26, Alex Peshkoff wrote: >> So, are we going to use more recent ICU libraries in FB3 ? > > Vlad, I think yes This sounds as a good idea to me as well. > Ideally ICU should be installed by package manager due to dependency. > But taking into an account that such method of install is not too > popular in windows (or may be I'm wrong and something has changed during > last years?) It's not only about popularity, but also about a "install-by-copying" approach for the embedded server which was always considered a feature. So we have no other choice but to have the ICU binaries included in our Windows packages (or available as a separate download). Dmitry -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] isql -i and BOM
On 18-04-2011 06:49, Philippe Makowski wrote: > Hi, > > today you can't use utf-8 files with BOM > if you create utf-8 files you have to be careful about that > > would it be possible to deal with files encoded in utf-8 even with BOM ? > even if > "Use of a BOM is neither required nor recommended for UTF-8, but may be > encountered in contexts where UTF-8 data is converted from other > encoding forms that use a BOM or where the BOM is used as a UTF-8 signature" > I remember to have problem with BOM encoded-files even compiling Java sources. I don't think it's something we must waste time. People should not use it. :-) Adriano -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] Index is corrupt (missing entries) in table
>> Index 1 is corrupt (missing entries) in table (128) Have you tried Firebird 2.1.4? Apparently that is supposed to have sorted this problem out... -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
[Firebird-devel] Index is corrupt (missing entries) in table
Hello! We are repeatedly stumbling upon a problem which apparently looks like one already discussed in 2010 (about a year ago): http://tech.groups.yahoo.com/group/firebird-support/message/106845 Firebird log shows the messages of the type: Index 1 is corrupt (missing entries) in table (128) The problem appears consistently, irrespective of FB version (we see this with various 2.1.x and 2.5 FB versions), irrespective of the underlying hardware (we have made tests on several machines, so we believe we can really safely exclude the possibility of RAM or disk problems). All our FB installations are running under Windows (Vista and some others). Apparently the problem shows up only when validation is being done with some specific software (for instance: IBO console, using "check record fragments") or via IBX Delphi components. I was apparently *NOT* able to produce any validation errors by using gfix with either -validate -full or -validate -full -ignore It appears that the problem shows up only with massive databases of size about 40 to 65 GB - we have two such examples. Our databases in question consist of one massive table and few very small ones. The problem appears with the primary index of the massive table. This index has six fields of type varchar, with the total length of 44 characters. There are neither Null nor blank key fields present in the table. The ODS used is the highest supported with the used FB version. Backup and restore have no problems to successfully complete (both directions work). However, the problem does not go away. The problem is obviously connected to the building of the index and not to the basic table: index may be dropped, whereupon no validation problems appear. As soon as the index is recreated, the subsequent validation reports the same problem. The table in question has many insertions and deletions in productive use, invoked only from a single connection. Following the phase of intensive insertions and deletions, comes a "select phase", consisting solely of selects, possibly but rarely from more than one concurrent connection. We actually haven't noticed any data loss or other abnormalities. However, we are not happy to see these validation results and would like to know if we can do something in some other way in order to avoid that, or if we can perhaps somehow help developers to pinpoint the issue (if this is a FB issue at all). Unfortunately, we must not provide the data itself. Thank you for any suggestions! Borut -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] The boot build again
> Believe me or not, but there is not tricks known to me. It just works :) Vlad, looks like FIREBIRD_BOOT_BUILD env variable is not set during windows build. I do not say that it's too much important, but it helps to avoid UDF dependencies (we do not UDF during boot build), set correct owner (SYSDBA) in created databases and does some not critical, but useful tricks when resolving paths to files. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
[Firebird-devel] isql -i and BOM
Hi, today you can't use utf-8 files with BOM if you create utf-8 files you have to be careful about that would it be possible to deal with files encoded in utf-8 even with BOM ? even if "Use of a BOM is neither required nor recommended for UTF-8, but may be encountered in contexts where UTF-8 data is converted from other encoding forms that use a BOM or where the BOM is used as a UTF-8 signature" -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] Namespaces
On 04/17/11 21:29, Adriano dos Santos Fernandes wrote: > Unfortunately my proposal can't be done. > > There is the forward decls that can't be declared in another namespace. > > There is a second option. There is nothing much "namespace Jrd" opening, > so is possible to change all of them. > > But there is a lot of Jrd::, specially in _proto.h files. I never > understand why we create functions outside of the namespace. Sometimes long ago we hoped to move all code to classes in reasonable time. And therefore I've left all functions out of namespaces (supposed they will be gone soon) when moving data structures of engine into namespace Jrd. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] Do we need many options for boolean constants in config file?
On 04/17/11 09:51, Dmitry Yemanov wrote: > 17.04.2011 1:21, Leyne, Sean wrote: >> Am I reading this correctly; any non-zero value would be considered true? >> >> If so, then I do not agree with this logic. "True" values must be specific, >> all other values must be false. > FWIW, this logic is used since v1.5 and nobody so far complained. I think that use of t / true / y / yes and any non-zero as true value in boolean expressions is OK. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
Re: [Firebird-devel] ICU. VS2010 project files
On 04/16/11 14:23, Vlad Khorsun wrote: >> I spend some time for revision and adaption of your copy of ICU library for >> VS2010 > Thanks > >> 1. Reduce number of compiler warnings >> I defined the _CRT_SECURE_NO_WARNINGS=1 in firebird2intl.props > Good change, imho > >> 2. Creation of PDB files for all binaries (debug/release) > Not necessary. I doubt we are going to distribute pdb files for ICU > package. There > was ZERO issues with ICU which could require to install .pdb at use machine, > AFAIR. > >> 3. Unified names of release/debug binaries > Good change too. > > I have nothing againt applaying this patch to the our copy of ICU but > first i want to > raise more important question re. ICU : > > are we going to update our copy of ICU package in FB3 ? We used very > outdated > copy and it have some still not fixed (mostly minor) issues. On Linuxes there > is possibility > to use system ICU libraries but on Windows there is no ICU distributed with > OS itself. > > So, are we going to use more recent ICU libraries in FB3 ? Vlad, I think yes, and moreover - taking into an account that since fb2.1 we are not forced to use specific ICU version, we should not import ICU sources into our tree. Ideally ICU should be installed by package manager due to dependency. But taking into an account that such method of install is not too popular in windows (or may be I'm wrong and something has changed during last years?), I suppose that latest binaries from IBM should be integrated into both windows binary packages, and we our self should not waste time for support of that package. On posix no other option instead use of ICU, already installed in OS, will be present. What must be done: 1. Ability to load existing ICU version dynamically (i.e. our binaries should not explicitly depend upon it). 2. SQL command to recreate dependent indexes when ICU version is changed should also be present. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev Firebird-Devel mailing list, web interface at https://lists.sourceforge.net/lists/listinfo/firebird-devel
