Changeset: efdf0bcb0089 for MonetDB URL: https://dev.monetdb.org/hg/MonetDB/rev/efdf0bcb0089 Modified Files: gdk/gdk.h gdk/gdk_private.h monetdb5/modules/mal/CMakeLists.txt monetdb5/modules/mal/batExtensions.c sql/backends/monet5/CMakeLists.txt sql/backends/monet5/sql.c Branch: string_imprints Log Message:
Merge with default diffs (truncated from 101160 to 300 lines): diff --git a/.hgtags b/.hgtags --- a/.hgtags +++ b/.hgtags @@ -803,3 +803,11 @@ 6b71a8cc3498561815ac88d6c652922359efd13a 02fd591b7d3311d566007e1bfb0c59682b17f12c Jul2021_root 5cb19dc0880d1fb4799cd0f8019d1c2b430c503e Oct2020_17 5cb19dc0880d1fb4799cd0f8019d1c2b430c503e Oct2020_SP5_release +489951059c7fc87ef706d8a563cd024ebdeed108 Jul2021_1 +489951059c7fc87ef706d8a563cd024ebdeed108 Jul2021_release +404cb13ad1bc3469bfaf5b7696a4d2cfe5ce71f4 Jul2021_3 +489951059c7fc87ef706d8a563cd024ebdeed108 Jul2021_release +404cb13ad1bc3469bfaf5b7696a4d2cfe5ce71f4 Jul2021_release +9ab0adea978c184d895ca445792a79f26cb9d075 Jul2021_5 +404cb13ad1bc3469bfaf5b7696a4d2cfe5ce71f4 Jul2021_release +9ab0adea978c184d895ca445792a79f26cb9d075 Jul2021_release diff --git a/CMakeLists.txt b/CMakeLists.txt --- a/CMakeLists.txt +++ b/CMakeLists.txt @@ -36,6 +36,7 @@ set(CMAKE_FIND_APPBUNDLE LAST) include(CheckCSourceCompiles REQUIRED) include(CheckCCompilerFlag REQUIRED) include(CheckIncludeFile REQUIRED) +include(CheckIncludeFiles REQUIRED) include(CMakePushCheckState REQUIRED) include(CheckStructHasMember REQUIRED) include(CheckSymbolExists REQUIRED) @@ -76,7 +77,6 @@ if(NOT HAVE_SYS_SOCKET_H) endif() set(CMAKE_REQUIRED_INCLUDES "/usr/include") -monetdb_configure_crypto() monetdb_configure_sizes() include(GNUInstallDirs) diff --git a/ChangeLog.Jul2021 b/ChangeLog.Jul2021 --- a/ChangeLog.Jul2021 +++ b/ChangeLog.Jul2021 @@ -1,6 +1,3 @@ # ChangeLog file for devel # This file is updated with Maddlog -* Thu Apr 15 2021 svetlin <svetlin.stali...@monetdbsolutions.com> -- preserve in query comments - diff --git a/ChangeLog.Oct2020 b/ChangeLog.Oct2020 deleted file mode 100644 --- a/ChangeLog.Oct2020 +++ /dev/null @@ -1,3 +0,0 @@ -# ChangeLog file for devel -# This file is updated with Maddlog - diff --git a/MonetDB.spec b/MonetDB.spec --- a/MonetDB.spec +++ b/MonetDB.spec @@ -84,7 +84,7 @@ Group: Applications/Databases License: MPLv2.0 URL: https://www.monetdb.org/ BugURL: https://bugs.monetdb.org/ -Source: https://www.monetdb.org/downloads/sources/Oct2020-SP5/%{name}-%{version}.tar.bz2 +Source: https://www.monetdb.org/downloads/sources/Jul2021/%{name}-%{version}.tar.bz2 # The Fedora packaging document says we need systemd-rpm-macros for # the _unitdir and _tmpfilesdir macros to exist; however on RHEL 7 @@ -119,18 +119,11 @@ BuildRequires: pkgconfig(libcurl) BuildRequires: pkgconfig(liblzma) BuildRequires: pkgconfig(uuid) BuildRequires: pkgconfig(libxml-2.0) -BuildRequires: pkgconfig(openssl) %if %{with pcre} BuildRequires: pkgconfig(libpcre) >= 4.5 %endif BuildRequires: pkgconfig(zlib) -%if %{?rhel:0}%{!?rhel:1} || 0%{?rhel} > 7 -# not on RHEL 7 BuildRequires: pkgconfig(liblz4) >= 1.8 -%global LZ4 ON -%else -%global LZ4 OFF -%endif %if %{with py3integration} BuildRequires: pkgconfig(python3) >= 3.5 BuildRequires: python3-numpy @@ -281,7 +274,6 @@ Summary: MonetDB - Monet Database Manage Group: Applications/Databases Requires: %{name}-client%{?_isa} = %{version}-%{release} Requires: %{name}-stream-devel%{?_isa} = %{version}-%{release} -Requires: openssl-devel %description client-devel MonetDB is a database management system that is developed from a @@ -350,6 +342,10 @@ Recommends: php-monetdb >= 1.0 %endif Requires: MonetDB5-server%{?_isa} = %{version}-%{release} Requires: python3-pymonetdb >= 1.0.6 +%if %{?rhel:0}%{!?rhel:1} || 0%{?rhel} > 7 +Recommends: python3dist(lz4) +Recommends: python3dist(scipy) +%endif %description client-tests MonetDB is a database management system that is developed from a @@ -794,9 +790,8 @@ fi -DTESTING=ON \ -DWITH_BZ2=ON \ -DWITH_CMOCKA=OFF \ - -DWITH_CRYPTO=ON \ -DWITH_CURL=ON \ - -DWITH_LZ4=%{LZ4} \ + -DWITH_LZ4=ON \ -DWITH_LZMA=ON \ -DWITH_PCRE=ON \ -DWITH_PROJ=OFF \ @@ -848,6 +843,249 @@ else fi %changelog +* Tue Aug 03 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.5-20210803 +- Rebuilt. +- GH#7161: fix priority + +* Tue Aug 3 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.5-20210803 +- gdk: A bug in the grouping code has been fixed. + +* Tue Aug 3 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.5-20210803 +- sql: The system view sys.ids has been updated to include some more system + IDs. + +* Fri Jul 30 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.3-20210730 +- Rebuilt. + +* Fri Jul 30 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.3-20210730 +- gdk: Hash indexes are no longer maintained at all cost: if the number of + distinct values is too small compared to the total number of values, + the index is dropped instead of being maintained during updates. + +* Fri Jul 30 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.3-20210730 +- sql: The sys.storage() function now only returns meta data, i.e. data that + can be calculated without access to the column contents. + +* Wed Jul 28 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.3-20210730 +- sql: Since STREAM tables support is removed, left over STREAM tables are + dropped from the catalog. + +* Fri Jul 23 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.1-20210723 +- Rebuilt. +- GH#2030: Temporary table is semi-persistent when transaction fails +- GH#7031: I cannot start MoentDb, because the installation path has + Chinese. +- GH#7055: Table count returning function used inside other function gives + wrong results. +- GH#7075: Inconsistent Results using CTEs in Large Queries +- GH#7079: WITH table AS... UPDATE ignores the WHERE conditions on table +- GH#7081: Attempt to allocate too much space in UPDATE query +- GH#7093: `current_schema` not in sys.keywords +- GH#7096: DEBUG SQL statement broken +- GH#7115: Jul2021: ParseException while upgrading Oct2020 database +- GH#7116: Jul2021: Cannot create filter functions +- GH#7125: MonetDB Round Function issues in the latest release +- GH#7126: The "lower" and "upper" functions doesn't work for Cyrillic + alphabet +- GH#7127: Bug report: "write error on stream" that results in mclient + crash +- GH#7128: Bug report: strange error message "Subquery result missing" +- GH#7129: Bug report: TypeException:user.main[19]:'batcalc.between' + undefined +- GH#7130: Bug report: TypeException:user.main[396]:'algebra.join' + undefined +- GH#7131: Bug report: TypeException:user.main[273]:'bat.append' undefined +- GH#7133: WITH <alias> ( SELECT x ) DELETE FROM ... deletes wrong tuples +- GH#7136: MERGE statement is deleting rows if the column is set as NOT + NULL even though it should not +- GH#7137: Segmentation fault while loading data +- GH#7138: Monetdb Python UDF crashes because of null aggr_group_arr +- GH#7141: COUNT(DISTINCT col) does not calculate correctly distinct values +- GH#7142: Aggregates returning tables should not be allowed +- GH#7144: Type up-casting (INT to BIGINT) doesn't always happen + automatically +- GH#7146: Query produces this error: !ERROR: Could not find %102.%102 +- GH#7147: Internal error occurs and is not shown on the screen +- GH#7148: Select distinct is not working correctly +- GH#7151: Insertion is too slow +- GH#7153: System UDFs lose their indentation - Python functions broken +- GH#7158: Python aggregate UDF returns garbage when run on empty table + +* Wed Jul 21 2021 Joeri van Ruth <joeri.van.r...@monetdbsolutions.com> - 11.41.1-20210723 +- mapilib: Add optional MAPI header field which can be used to immediately + set reply size, autocommit, time zone and some other options, see + mapi.h. This makes client connection setup faster. Support has been + added to mapilib, pymonetdb and the jdbc driver. + +* Wed Jul 21 2021 Joeri van Ruth <joeri.van.r...@monetdbsolutions.com> - 11.41.1-20210723 +- sql: Fix a warning emitted by some implementations of the tar(1) command + when unpacking hot snapshot files. +- sql: support reading the concatenation of compressed files as a single + compressed file. +- sql: COPY BINARY overhaul. Allow control over binary endianness using + COPY [ (BIG | LITTLE | NATIVE) ENDIAN] BINARY syntax. Defaults to + NATIVE. Strings are now \0 terminated rather than \n. Support for + BOOL, TINYINT, SMALLINT, INT, LARGEINT, HUGEINT, with their + respective "INTMIN" values as the NULL representation; 32 and 64 bit + FLOAT/REAL, with NaN as the NULL representation; VARCHAR/TEXT, JSON + and URL with \x80 as the NULL representation; UUID as fixed width 16 + byte binary values, with (by default) all zeroes as the NULL + representation; temporal type structs as defined in copybinary.h + with any invalid value as the NULL representation. + +* Tue Jul 20 2021 Niels Nes <ni...@cwi.nl> - 11.41.1-20210723 +- sql: In the Jul2021 release the storage and transaction layers have + undergone major changes. The goal of these changes is robust + performance under inserts/updates and deletes and lowering the + transaction startup costs, allowing faster (small) queries. Where + the old transaction layer duplicated a lot of data structures during + startup, the new layer shares the same tree. Using object + timestamps the isolation of object is guaranteed. On the storage + side the timestamps indicate whether a row is visible (deleted or + valid), to a transaction as well. The changes also give some slight + changes on the perceived transactional behavior. The new + implementation uses shared structures among all transactions, which + do not allow multiple changes of the same object. And we then + follow the principle of the first writer wins, i.e., if a + transaction creates a table with name 'table_name', and concurrently + one other transaction does the same the later of the two will fail + with a concurrency conflict error message (even if the first writer + never commits). We expect most users not to notice this change, as + such schema changes aren't usually done concurrently. + +* Tue Jul 20 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.1-20210723 +- clients: The MonetDB stethoscope has been removed. There is now a separate + package available with PIP (monetdb_stethoscope) or as an RPM or DEB + package (stethoscope) from the monetdb.org repository. + +* Tue Jul 20 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.1-20210723 +- gdk: A new type, called msk, was introduced. This is a bit mask type. + In a bat with type msk, each row occupies a single bit, so 8 rows are + stored in a single byte. There is no NULL value for this type. +- gdk: The function of the BAT iterator (type BATiter, function bat_iterator) + has been expanded. The iterator now contains more information about + the BAT, and it contains a pointer to the heaps (theap and tvheap) + that are stable, at least in the sense that they will remain available + even when parallel threads update the BAT and cause those heaps to grow + (and therefore possibly move in memory). A call to bat_iterator must + now be accompanied by a call to bat_iterator_end. + +* Mon Jun 7 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.1-20210723 +- monetdb5: When using the --in-memory option, mserver5 will run completely in + memory, i.e. not create a database on disk. The server can still be + connected to using the name of the in-memory database. This name is + "in-memory". + +* Tue May 11 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.1-20210723 +- sql: There is now a function sys.current_sessionid() to return the session + ID of the current session. This ID corresponds with the sessionid in + the sys.queue() result. + +* Mon May 10 2021 Panagiotis Koutsourakis <kutsu...@monetdbsolutions.com> - 11.41.1-20210723 +- merovingian: Deprecate `profilerstart` and `profilerstop` commands. Since + stethoscope is a separate project (https://github.com/MonetDBSolutions/monetdb-pystethoscope) + the installation directory is not standard anymore. `profilerstart` and + `profilerstop` commands assume that the stethoscope executable is in the + same directory as `mserver5`. This is no longer necessarily true since + stethoscope can now be installed in a python virtual environment. The + commands still work if stethoscope is installed using the official + MonetDB installers, or if a symbolic link is created in the directory + where `mserver5` is located. + +* Fri May 7 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.1-20210723 +- odbc: A typo that made the SQLSpecialColumns function unusable was fixed. + +* Mon May 3 2021 Pedro Ferreira <pedro.ferre...@monetdbsolutions.com> - 11.41.1-20210723 +- sql: Merge statements could not produce correct results on complex join + conditions, so a renovation was made. As a consequence, subqueries + now have to be disabled on merge join conditions. + +* Mon May 3 2021 svetlin <svetlin.stali...@monetdbsolutions.com> - 11.41.1-20210723 +- sql: preserve in-query comments + +* Mon May 3 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.1-20210723 +- merovingian: The exittimeout value can now be set to a negative value (e.g. -1) to + indicate that when stopping the dbfarm (using monetdbd stop dbfarm), + any mserver5 processes are to be sent a termination signal and then + waited for until they terminate. In addition, if exittimeout is greater + than zero, the mserver5 processes are sent a SIGKILL signal after the + specified timeout and the managing monetdbd is sent a SIGKILL signal + after another five seconds (if it didn't terminate already). The old + situation was that the managing monetdbd process was sent a SIGKILL + after 30 seconds, and the mserver5 processes that hadn't terminated + yet would be allowed to continue their termination sequence. + +* Mon May 3 2021 Sjoerd Mullender <sjo...@acm.org> - 11.41.1-20210723 +- gdk: Implemented function BUNreplacemultiincr to replace multiple values + in a BAT in one go, starting at a given position. +- gdk: Implemented new function BUNreplacemulti to replace multiple values + in a BAT in one go, at the given positions. +- gdk: Removed function BUNinplace, just use BUNreplace, and check whether + the BAT argument is of type TYPE_void before calling if you don't + want to materialize. + +* Mon May 3 2021 Pedro Ferreira <pedro.ferre...@monetdbsolutions.com> - 11.41.1-20210723 +- sql: Use of CTEs inside UPDATE and DELETE statements are now more _______________________________________________ checkin-list mailing list checkin-list@monetdb.org https://www.monetdb.org/mailman/listinfo/checkin-list
