[ANNOUNCE] pgFormatter v2.1 has been released
pgFormatter 2.1 released -- Version 2.1 of pgFormatter, a free a SQL formatter/beautifier dedicated to standard SQL and PostgreSQL specifics keywords, has been officially released and is publicly available for download. This release fixes several issues reported by users since four months. It also adds some improvements in code formatting: - Add support to new psql meta-command from v10. - Add two command line option to defined where comma must appears in a parameter list: -b | --comma-start: in a parameters list, start with a comma (see -e) -e | --comma-end : in a parameters list, end with a comma (default) The CGI interface adds a new checkbox to force comma at beginning. Default is lines end with a comma. - Prevent dynamic code formatting. By default pgFormatter takes all code between single quote as string constant and do not perform any formatting on this code. It is common to use a string as code separator to avoid doubling single quote in dynamic code generation, in this case pgFormatter can fail to auto detect the code separator. By default it will search for any string after the EXECUTE keyword starting with dollar sign. If it can not auto detect your code separator you can use the command line option -S or --separator to set the code separator that must be used. - Make it possible to run pg_format via symlink. For example, if pgFormatter is in /opt/pgFormatter and there is a symlink like /usr/local/bin/pg_format -> /opt/pgFormatter/pg_format then previous version wouldn't work when called via symlink, as it would search for libs in /usr/local/bin/lib/, and not in /opt/pgFormatter/lib. For the full list of changes, see: Changelog: https://github.com/darold/pgFormatter/blob/master/ChangeLog Links & Credits Thank to the developers who submitted patches and users who reported bugs and feature requests, especially Alvaro Herrera, fnwiya, Sebastian Albert, Vesa Karjalainen, Fabian Zeindl, Huy Pham, Jakob Egger and Gajus Kuizinas pgFormatter is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools. Links: Website: http://sqlformat.darold.net/ Download1: https://github.com/darold/pgFormatter/releases/ Download2: http://sourceforge.net/projects/pgformatter/ Development: https://github.com/darold/pgFormatter About pgFormatter - pgFormatter is a SQL formatter/beautifier that supports keywords from SQL-92, SQL-99, SQL-2003, SQL-2008, SQL-2011 and PostgreSQL specifics keywords. May works with any other databases too. It shares the same code with pgBadger, so any improvement made in the parser is reversed to pgBadger. Tool created by Gilles Darold. pgFormatter can work as a console program or as a CGI. It will automatically detect his environment and output as text or as HTML following the context. pgFormatter works on any platform and is available under the PostgreSQL licence. -- Gilles Darold
[ANNOUNCE] Ora2Pg v18.2 has been released
r but just the translated code. There is also some behavior changes from previous release: - Remove SysTimestamp() from the list of not translated function, it is replaced with CURRENT_TIMESTAMP for a long time now. - Change migration assessment cost to 84 units (1 day) for type TABLE, INDEX and SYNONYM and to 168 units (2 days) for TABLE PARTITION and GLOBAL TEMPORARY TABLE, this is more realistic. - Set minimum assessment unit to 1 when an object exists. Improve PL/SQL code translation speed. - Change behavior of COMPILE_SCHEMA directive used to force Oracle to compile schema before exporting code. When this directive is enabled and SCHEMA is set to a specific schema name, only invalid objects in this schema will be recompiled. When SCHEMA is not set then all schema will be recompiled. To force recompile invalid object in a specific schema, set COMPILE_SCHEMA to the schema name you want to recompile. This will ask to Oracle to validate the PL/SQL that could have been invalidate after a export/import for example. The 'VALID' or 'INVALID' status applies to functions, procedures, packages and user defined types. - Default transaction isolation level is now set to READ COMMITTED for all action excluding data export. - Oracle doesn't allow the use of lookahead expression but you may want to exclude some objects that match the ALLOW regexp you have defined. For example if you want to export all table starting with E but not those starting with EXP it is not possible to do that in a single expression. Now you can start a regular expression with the ! character to exclude all objects matching the regexp given just after. Our previous example can be written as follow: ALLOW E.* !EXP.* it will be translated into REGEXP_LIKE(..., '^E.*$') AND NOT REGEXP_LIKE(..., '^EXP.*$') in the object search expression. - Fix quoting of PG_SCHEMA with multiple schema in search path. The definition of the search path now follow the following behavior: * when PG_SCHEMA is define, always set search_path to its value. * when EXPORT_SCHEMA is enabled and SCHEMA is set, the search_path is set the name of the schema. - Remove forcing of export_schema when pg_schema is set at command line. This could change the behavior of some previous use of these variables and the resulting value of the search_path but it seems much better understandable. - Rewrite translation of raise_application_error to use RAISE EXCEPTION with a message and the SQLSTATE code. Oracle user defined code -2 to -20999 are translated to PostgreSQL user define code from 45000 to 45999. Call to raise_application_error(mySQLCODE, myErrmsg); will be translated into RAISE EXCEPTION '%', myErrmsg USING ERRCODE = mySQLCODE; - Remove migration assessment cost for TG_OP and NOT_FOUND they might be fully covered now. As usual there is also lot of bug fixes and Oracle to PostgreSQL conversion adjustments, for a complete list see: https://github.com/darold/ora2pg/blob/master/changelog = Links & Credits = Thanks to all contributors, they are all cited in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download1: https://github.com/darold/ora2pg/releases/ - Download2: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README -- **About Ora2Pg** Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob, external table, etc.). Export of spatial data is also supported with the PostGis extension. Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- -- Gilles Darold -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgFormatter 2.0 released
pgFormatter 2.0 released May 23 2017 - v2.0 This major release adds a plpgsql code beautifier. This makes pgFormatter the best free tool to rewrite and beautify any SQL and PLPGSQL code. This release also fixes several issues and adds lot of improvements in code formatting. Support for AWS Redshift keywords have been improved. pgFormatter can work as a console program or online as a CGI. It will automatically detect his environment and output as text or as HTML following the context. pgFormatter v2.0 is available as a free online service for queries up to 100 Kb at http://sqlformat.darold.net/. To see a sample of SQL formatting provided by pgFormatter use the "Load an example" and the "Format my code" button. For the complete list of changes see: https://github.com/darold/pgFormatter/blob/master/ChangeLog Links & Credits --- Thank to the developers who submitted patches and users who reported bugs and feature requests, especially Hubert Depesz Lubaczewski and cavanaug pgFormatter is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools. Links: Website: http://sqlformat.darold.net/ Download: http://sourceforge.net/projects/pgformatter/ Development: https://github.com/darold/pgFormatter Changelog: https://github.com/darold/pgFormatter/blob/master/ChangeLog About pgFormatter - pgFormatter is a SQL and PlPgsql formatter/beautifier that supports keywords from SQL-92, SQL-99, SQL-2003, SQL-2008, SQL-2011 and PostgreSQL specifics keywords. May works with any other databases too. It shares the same code with pgBadger, so any improvement made in the parser is reversed to pgBadger. Tool created and maintained by Gilles Darold. pgFormatter works on any platform and is available under the PostgreSQL licence. -- Gilles Darold -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg v18.1 has been released
Paris, France - Febuary 17th, 2017 **Ora2Pg 18.1 released** Version 18.1 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This release fix several issues reported on outer join translation thanks to the help of Pavel Stehule and reapply the commit on virtual column export that was accidentally removed from v18.0. It also adds several new features: * Remove CHECK constraints for columns converted into boolean using REPLACE_AS_BOOLEAN column. * Oracle function are now marked as stable by default as they can not modify data. Two new configuration directives have been added: * DATE_FUNCTION_REWRITE: by default Ora2pg rewrite add_month(), add_year() and date_trunc() functions set it to 0 to force Ora2Pg to not translate those functions if translated code is broken. * GRANT_OBJECT: when exporting GRANT you can now specify a comma separated list of objects which privileges must be exported. Default is to export privileges for all objects. For example set it to TABLE if you just want to export privilege on tables. and a new command line option: * Add -g | --grant_object command line option to ora2pg to be able to extract privilege from the given object type. See possible values with GRANT_OBJECT configuration directive. For a complete list of change see https://github.com/darold/ora2pg/blob/master/changelog Thanks to all contributors, they are all cited in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README About Ora2Pg : Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob and external table). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg v18.0 was released today
Paris, France - January 30th, 2017
**Ora2Pg 18.0 released**
Version 18.0 of Ora2Pg, a free and reliable tool used to migrate an
Oracle database to PostgreSQL, has been officially released and is
publicly available for download.
This new major release adds several new useful features and lot of
improvements.
* Automatic rewrite of simple form of (+) outer join Oracle's
syntax. This major feature makes Ora2Pg become the first free
tool that is able to rewrite automatically some (+) outer join
in command line mode. It works with simple form of outer join
but this is a beginning.
* Add export of Oracle's virtual column using a real column and
a trigger.
* Allow conversion of RAW/CHAR/VARCHAR2 type with precision in
DATA_TYPE directive. Useful for example to transform all RAW(32)
or VARCHAR2(32) columns into PostgreSQL special type uuid.
* Add export NOT VALIDATED state from Oracle foreign keys and check
constraints into NOT VALID constraints in PostgreSQL.
* Replace call to SYS_GUID() with uuid_generate_v4() by default.
* Add "CREATE EXTENSION IF NOT EXISTS dblink;" before an autonomous
transaction or "CREATE EXTENSION IF NOT EXISTS pg_background;".
* Major rewrite of the way Ora2Pg parse PL/SQL to rewrite function
calls and other PL/SQL to plpgsql replacement. There should not
be any limitation in rewriting when a function contains a sub
query or an other function call inside his parameters.
* Refactoring of ora2pg to not requires any dependency other than
the Perl DBI module by default. All DBD drivers are now optionals
and ora2pg will expect an Oracle DDL file as input by default.
* Add export of Oracle's global variables defined in package. They
are exported as user defined custom variables and available in
a session. If the variable is a constant or have a default value
assigned at declaration, ora2pg will create a new file with the
declaration (global_variables.conf) to be included in the main
configuration file postgresql.conf file.
* Create full text search configuration when USE_UNACCENT directive
is enabled using the auto detected stemmer or the one defined in
FTS_CONFIG. For example:
CREATE TEXT SEARCH CONFIGURATION fr (COPY = french);
ALTER TEXT SEARCH CONFIGURATION fr ALTER MAPPING FOR
hword, hword_part, word WITH unaccent, french_stem;
CREATE INDEX place_notes_cidx ON places
USING gin(to_tsvector('fr', place_notes));
Changes and incompatibilities from previous release:
* FTS_INDEX_ONLY is now enabled by default because the addition of
a column is not always possible and not always necessary where a
simple function-based index is enough.
* Remove use to setweigth() on single column FTS based indexes.
* Change default behaviour of Ora2Pg in Full Text Search index
export.
A new command line option and some configuration directive have
been added:
* Option -D | --data_type to allow custom data type replacement
at command line like in configuration file with DATA_TYPE.
* UUID_FUNCTION to be able to redefined the function called to
replace SYS_GUID() Oracle function. Default to uuid_generate_v4.
* REWRITE_OUTER_JOIN to be able to disable the rewriting of Oracle
native syntax (+) into OUTER JOIN if rewritten code is broken.
* USE_UNACCENT and USE_LOWER_UNACCENT configuration directives to
use the unaccent extension with pg_trgm with the FTS indexes.
* FTS_INDEX_ONLY, by default Ora2Pg creates an extra tsvector column
with a dedicated triggers for FTS indexes. Enable this directive
if you just want a function-based index like:
CREATE INDEX ON t_document USING
gin(to_tsvector('pg_catalog.english', title));
* FTS_CONFIG, use this directive to force the text search stemmer
used with the to_tsvector() function. Default is to auto detect
the Oracle FTS stemmer. For example, setting FTS_CONFIG to
pg_catalog.english or pg_catalog.french will override the auto
detected stemmer.
Thanks to all contributors, they are all cited in the changelog file.
Useful Links:
- Website: http://ora2pg.darold.net/
- Download: http://sourceforge.net/projects/ora2pg/
- Development: https://github.com/darold/ora2pg
- Changelog: https://github.com/darold/ora2pg/blob/master/changelog
- Documentation: https://github.com/darold/ora2pg/blob/master/README
About Ora2Pg :
Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL.
It is developed since 2001 and can export most of the Oracle objects
(table, view, materialized view, tablespace, sequence, indexes, trigger,
grant, function, procedure, package, partition, data, blob and external
table).
Ora2Pg works on any platform and is available under the GPL v3 licence.
Docs, Download & Support at http://ora2pg.darold.net/
--
Gilles Darold
[ANNOUNCE] pgBadger v9.1 has been released
Paris, France - January 24th, 2017 pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. pgBadger 9.1 was released today, this is a maintenance release that fix some minor bugs. There is also a new report on error class distribution and some feature enhancements: * Add report of error class distribution when SQLState is available in the log_line_prefix (see %e placeholder). * Update SQL Beautifier to pgFormatter v1.6 code. * Improve error message normalization. * Add --normalized-only option to generate a text file containing all normalized queries found in a log with count. * Allow %c (session id) to replace %p (pid) as unique session id. * Add waiting for lock messages to event reports. * Add --start-monday option to start calendar weeks in Monday instead of default to Sunday. Here are the complete list of changes: - Add report of error class distribution when SQLState is available in the log line prefix. Thanks to jacks33 for the feature request. - Fix incremental global index on resize. Thanks to clomdd for the report. - Fix command tag log_line_prefix placeholder %i to allow space character. - Fix --exclude-line options and removing of obsolete directory when retention is enabled and --noreport is used. - Fix typo in "vacuum activity table". Thanks to Nicolas Gollet for the patch. - Fix autovacuum report. Thanks to Nicolas Gollet for the patch. - Fix author of pgbadger's logo - Damien Cazeils and English in comments. Thanks to Thibaut Madelaine for the patch. - Add information about pgbouncer log format in the -f option. Thanks to clomdd for the report. - Add --normalized-only information in documentation. - Fix broken report of date-time introduced in previous patch. - Fix duration/query association when log_duration=on and log_statement=all. Thanks to Eric Jensen for the report. - Fix normalization of messages about advisory lock. Thanks to Thibaut Madelaine for the report. - Fix report of auto_explain output. Thanks to fch77700 for the report. - Fix unwanted log format auto detection with log entry from stdin. Thanks to Jesus Adolfo Parra for the report. - Add left open parentheses to the "stop" chars of regex to look for db client in the prefix to handle the PostgreSQL client string format that includes source port. Thanks to Jon Nelson for the patch. - Fix some spelling errors. Thanks to Jon Nelson for the patch. - Allow %c (session id) to replace %p (pid) as unique session id. Thanks to Jerryliuk for the report. - Allow pgBadger to parse default log_line_prefix that will be probably used in 10.0: '%m [%p] ' - Fix missing first line with interpreter call. - Fix missing Avg values in CSV report. Thanks to Yosuke Tomita for the report. - Fix error message in autodetect_format() method. - Add --start-monday option to start calendar weeks in Monday instead of default to Sunday. Thanks to Joosep Mae for the feature request. - Fix --histo-average option. Thanks to Yves Martin for the report. - Remove plural form of --ssh-option in documentation. Thanks to mark-a-s for the report. - Fix --exclude-time filter and rewrite code to skip unwanted line as well code to update the progress bar. Thanks to Michael Chesterton for the report. - Fix support to %r placeholder in prefix instead of %h. = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : https://github.com/dalibo/pgbadger/releases/ * Mailing List : https://groups.google.com/forum/?hl=fr#!forum/pgbadger (pgbad...@googlegroups.com) -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org
[ANNOUNCE] pgFormatter v1.6 is out
pgFormatter 1.6 released January 23 2017 - v1.6 This release fixes several issues and adds lot of improvements in query formatting. Command line option --placeholder or -p has been added to be able to set regex to find code that must not be formatted. For example, in query like: SELECT * FROM projects WHERE projectnumber IN <> AND username = <>; you may want pgFormatter to not interpret << and >> as bit-shift keywords and modify your code snippsets. You can use a Perl regular expression to instruct pgFormatter to keep some part of the query untouched. For example: pg_format samples/ex9.sql -p '<<(?:.*)?>>' will not format the bit-shift like operators. pgFormatter v1.6 is available as a free online service for queries up to 100 Kb at http://sqlformat.darold.net/. To see a sample of SQL formatting provided by pgFormatter and compare with other tools click the "Load an example" and "Format my code" buttons. For the complete list of changes see: https://github.com/darold/pgFormatter/blob/master/ChangeLog Links & Credits --- Thank to the developers who submitted patches and users who reported bugs and feature requests, especially Laurenz Albe, Julien Rouhaud, clijunky, jhelberg and Pilat66. pgFormatter is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools. Links: Website: http://sqlformat.darold.net/ Download: http://sourceforge.net/projects/pgformatter/ Development: https://github.com/darold/pgFormatter Changelog: https://github.com/darold/pgFormatter/blob/master/ChangeLog About pgFormatter - pgFormatter is a SQL formatter/beautifier that supports keywords from SQL-92, SQL-99, SQL-2003, SQL-2008, SQL-2011 and PostgreSQL specifics keywords. May works with any other databases too. It shares the same code with pgBadger, so any improvement made in the parser is reversed to pgBadger. Tool created and maintained by Gilles Darold. pgFormatter can work as a console program or as a CGI. It will automatically detect his environment and output as text or as HTML following the context. pgFormatter works on any platform and is available under the PostgreSQL licence. -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg 17.6 released
Paris, France - November 21th, 2016 **Ora2Pg 17.6 released** Version 17.6 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This release adds several new features: * Adds export of Oracle Text Indexes into FTS (CONTEXT) or pg_trgm (CTXCAT) based indexes. * Add export of indexes defined on materialized views. * Allow export of materialized views as foreign tables when export type is FDW. * Add replacement of trim() by btrim(). Two new configuration directives have been added: * USE_INDEX_OPCLASS: when value is set to 1, this will force Ora2Pg to export all indexes defined on varchar2() and char() columns using *_pattern_ops operators. If you set it to a value greater than 1 it will only change indexes on columns where the character limit is greater or equal than this value. * CONTEXT_AS_TRGM: when enabled force Ora2Pg to translate all Oracle Text indexes (CONTEXT and CTXCAT) into PostgreSQL indexes using the pg_trgm extension. Default is to translate CONTEXT indexes into FTS indexes and CTXCAT indexes using pg_trgm. Some time using pg_trgm based indexes is enough. As usual these also some bug fixes and Oracle to PostgreSQl conversion adjustments, see https://github.com/darold/ora2pg/blob/master/changelog for a complete list. Thanks to all contributors, they are all cited in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README About Ora2Pg : Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob and external table). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg v17.5 is out
Paris, France - October 21th, 2016 **Ora2Pg 17.5 released** Version 17.5 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This is a maintenance release to fix several issues reported by users. There is also some major improvements and new features. There is a new configuration directive or change default behavior: * Fix export of CLOBs and NCLOB that was truncated to 64 Kb. * PG_BACKGROUND : when enabled autonomous transactions will be built using Robert Haas extension pg_background instead of dblink. Default is to still used dblink as pg_background is available only for PostgreSQL >= 9.5. * All Perl I/O now use the open pragma instead of calling method binmode(). This will force input and output to utf8 using the Perl pragma: use open ':encoding(utf8)'; when configuration directive BINMODE is not set or NLS_LANG is set to UTF8. * Ora2Pg will now export empty lob as empty string instead of NULL when the source column has NOT NULL constraint and that directive EMPTY_LOB_NULL is not activated. * Improve and fix progress bar especially when using JOBS/-J option. * Allow LOAD action to apply all settings defined in the input file on each opened session, this allow to use LOAD with export schema enabled. If settings are not set in the input file encoding and search_path is set from the ora2pg configuration settings. * NUMBER(*,0) is now exported as numeric(38) as well as a NUMBER with DATA_SCALE set to 0, no DATA_PRECISION and a DATA_LENGTH of 22. The last correspond to Oracle type INTEGER or INT. * Allow conversion of type with precision in DATA_TYPE directive. For example it is possible to transform all NUMBER(12,2) only into numeric(12,2) by escaping the comma. Example: DATA_TYPENUMBER(12\,2):numeric(12\,2);... * Write data exported into temporary files (prefixed by tmp_) and renamed them at end of the export to be able to detect incomplete export and override it at next export. * Add export of type created in package declaration. * Export foreign key when the referenced table is not in the same schema. * Enabled by default PG_SUPPORTS_CHECKOPTION assuming that your Pg destination database is at least a 9.4 version. * Add 12 units to migration assessment report per table/column conflicting with a reserved word in PostgreSQL to reflect the need of code rewriting. * Output a warning when a column has the same name than a system column (xmin,xmax,ctid,etc.) * Replace SYSDATE by a call to clock_timestamp() instead of a call to LOCALTIMESTAMP in plpgsql code. * Add missing documentation about DISABLE_PARTITION directive used to not reproduce partitioning into PostgreSQL and only export partitioned data into the main table. As usual these also some bug fixes and Oracle to PostgreSQL conversion adjustments, see https://github.com/darold/ora2pg/blob/master/changelog for a complete list. Thanks to all contributors, they are all cited in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README About Ora2Pg : Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob and external table). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger v9.0 released
Paris, France - September 5th, 2016 pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. pgBadger 9.0 was released today, this major release of pgBadger is a port to bootstrap 3 and a version upgrade of all resources files (CSS and Javascript). There's also some bugs fixes and features enhancements. Backward compatibility with old incremental report might be preserved. Here are the complete list of changes: - Sources and licences of resources files are now on a dedicated subdirectory. A script to update their minified version embedded in pgbager script has been added. Thanks to Christoph Berg for the help and feature request. - Try to detect user/database/host from connection strings if log_connection is enabled and log_line_prefix doesn't include them. Extend the regex to autodetect database name, user name, client ip address and application name. The regex now are the following: db => qr/(?:db|database)=([^,]*)/; user => qr/(?:user|usr)=([^,]*)/; client => qr/(?:client|remote|ip|host)=([^,]*)/; appname => qr/(?:app|application)=([^,]*)/; - Add backward compatibility with older version of pgbadger in incremental mode by creating a subdirectory for new CSS and Javascript files. This subdirectory is named with the major version number of pgbadger. - Increase the size of the pgbadger logo that appears too small with the new font size. - Normalize detailed information in all reports. - Fix duplicate copy icon in locks report. - Fix missing chart on histogram of session time. Thanks to Guillaume Lelarge for the report. - Add LICENSE file noting the licenses used by the resource files. Thanks to Christoph Berg for the patch. - Add patch to jqplot library to fix an infinite loop when trying to download some charts. Thanks to Julien Tachoires for the help to solve this issue. - Script tools/updt_embedded_rsc.pl will apply the patch to resource file resources/jquery.jqplot.js and doesn't complain if it has already been applied. - Remove single last comma at end of pie chart dataset. Thanks to Julien Tachoires for the report. - Change display of normalized error - Remove unused or auto-generated files - Update all resources files (js+css) and create a directory to include source of javascript libraries used in pgbadger. There is also a new script tools/updt_embedded_rsc.pl the can be used to generate the minified version of those files and embedded them into pgbadger. This script will also embedded the FontAwesome.otf open truetype font into the fontawesome.css file. Previous release, v8.3, was maintenance release that fix some minor bugs and adds replication command messages statistics to the Events reports. - Fix auto-detection of stderr format with timestamp as epoch (%n). - Fix histogram over multiples days to be cumulative per hour, not an average of the number of event per day. - Fix parsing of remote file that was failing when the file does not exists locally. Thanks to clomdd for the report. - Detect timezones like GMT+3 on CSV logs. Thanks to jacksonfoz for the patch. - Add replication command messages statistics to the Events reports. Thanks to Michael Paquier for the feature request. = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : https://github.com/dalibo/pgbadger/releases/ * Mailing List : https://groups.google.com/forum/?hl=fr#!forum/pgbadger (pgbad...@googlegroups.com) -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-ann
[ANNOUNCE] pgBadger v8.2 was released today
Paris, France - August 11th, 2016 pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. pgBadger 8.2 was released today, this is a maintenance release that fix some minor bugs. There is also some performances improvement, up to 20% on huge files and some new interesting features: * Multiprocessing can be used with pgbouncer log files. * pgBouncer and PostgreSQL log files can be used together in incremental mode. * With default or same prefix, stderr and syslog file can be parsed together, csvlog format can always be used. * Use a modal dialog window to download graphs as png images. * Add pl/pgSQL function information to queries when available. Here are the complete list of changes: - Fix report of database system messages. - Fix multi line statement concatenation after an error. - Fix box size for report of queries generating the most temporary files and the most waiting queries. - Rewrite code to better handle multi-line queries. - Fix garbage in examples of event queries with error only mode (option -w). Thanks to Thomas Reiss for the report. - Fix getting dataset related to query duration with the use of auto_explain. Thanks to tom__b for the patch. - Use a modal dialog window to download graphs as png images. - Huge rewrite of the incremental mechanism applied to log files to handle PostgreSQL and pgbouncer logs at the same time. - Multiprocess can be used with pgbouncer log. - Add code to remove remaining keyword placeholders tags. - Fix an other possible case of truncated date in LAST_PARSED file Thanks to brafaeloliveira for the report. - Set default scale 1 in pretty_print_number() js function. - Fix auto-detection of pgbouncer files that contain only stats lines. Thanks to Glyn Astill for the patch. - Add date to samples of queries generating most temporary files. - Do not display warning message of empty log when quiet mode is enable. - Fix reading from stdin by disabling pgbouncer format detection. Thanks to Robert Vargason for the patch. - Fix case of duplicate normalized error message with "nonstandard use of ...". - Fix storage of current temporary file related request. - Use the mnemonic rather than a signal number in kill calls. Thanks to Komeda Shinji for the patch. = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : https://github.com/dalibo/pgbadger/releases/ * Mailing List : https://groups.google.com/forum/?hl=fr#!forum/pgbadger (pgbad...@googlegroups.com) -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgCluu release 2.5
Paris, April 27th 2016 pgCluu 2.5 released --- PostgreSQL Cluster Utilization pgCluu is a Perl program used to perform a full audit of a PostgreSQL Cluster performances. It is divided in two parts, a collector used to grab statistics on the PostgreSQL server using psql and sar, a reports builder that will generate all HTML and charts output. This release fixes some issues reported by users over past year and a full replacement of the flotr2 javascript chart library with jqplot. There's also some new interesting reports: * Add report for hash indexes. * Keep track of pg_settings and database/roles settings changes and show diff in the the reports. * Add report of pending restart in pg settings view. * Add information about percentage of timed against requested checkpoints. * Split database menu in submenu per set of 10 databases. * Add report of tables without indexes and tables with more than five indexes. * Add report about invalid index after concurrency build. * Add report of system and PostgreSQL uptime. * Add report of last statistics reset per database and report of last autovacuum and autoanalyze. * Add report of bgwriter last statistics reset in Home/Cluster view. * Add a non default configuration settings report. and useful features: * Autodetect timezone from csv data files and automatic adjustment of chart axis. * Add systemd start script. * Add collect of crontab information. * Add support to daylight saving. * Add compatibility with PostgreSQL 9.5 * Add ablity to export plots data as csv * Set legend table outside the graph. * Display specific titles and description for overall graphs. Note that a CGI script have been added to be able to perform temporal lookup in incremental pgCluu statistics, with predefined year, month, day and hour views. This is a work in progress, it will be available in next major release. Upgrade: you can safely override previous installation, backward compatibility with 2.4 version is preserved. See ChangeLog for a complete list of changes and bug fixes. The goal of this project is to provide a complete PostgreSQL auditing tool that don't need any dependency to be run easily to audit a local or remote server. If you just have a sar output file, pgCluu can be use to draw graphs about the system utilization only. pgCluu is an original collection of tools built during my work at Dalibo. Those tools are published under the PostgreSQL License to be shared, any one is welcome to contribute. For more information take a look at http://pgcluu.darold.net/ View a sample report at http://pgcluu.darold.net/example/index.html About: -- pgCluu is created and maintained by Gilles Darold. * Web/Demo site: http://pgcluu.darold.net/ * Download: https://github.com/darold/pgcluu/releases * Development: https://github.com/darold/pgcluu * Documentation: https://github.com/darold/pgcluu/blob/master/README -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger v8.1 was released
Paris, France - April 24th, 2016 pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. pgBadger 8.1 was released today, this is a maintenance release that fix a major issue introduced with support to pgbouncer that was breaking the parsing of compressed log files. There's also some improvements. Here are the complete list of changes: - Fix one case where pid file remain after dying. - Add requirement of log_error_verbosity = default to documentation. - Report message "LOG: using stale statistics instead of current ones because stats collector is not responding" in events view. - Remove obsolete days when we are in binary mode with --noreport - Fix wrong report of statements responsible of temporary files. Thanks to Luan Nicolini Marcondes for the report. This patch also exclude line with log level LOCATION to be parsed. - Fix limit on number of sample at report generation and remove pending LAST_PARSED.tmp file. - Update load_stat() function and global variables to support pgbouncer statistics. Update version to 2.0. - Handle more kind or query types. Thanks to julien Rouhaud for the patch. - Fix pgbouncer log parser to handle message: FATAL: the database system is shutting down - Fix whitespace placed in between the E and the quote character. Thanks to clijunky for the report. - Fix a major issue introduced with support to pgbouncer that prevent parsing of compressed PostgreSQL log files. Thanks to Levente Birta for the report. = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : https://github.com/dalibo/pgbadger/releases/ * Mailing List : https://groups.google.com/forum/?hl=fr#!forum/pgbadger (pgbad...@googlegroups.com) -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg v18.4 has been released
Paris, France - April 24th, 2016 **Ora2Pg 18.4 released** Version 18.4 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This is a maintenance release to fix several issues reported by users. There is also some major data export speed improvement thanks to the work of PostgreSQL Pro and a new RPM spec file provided by Devrim Gündüz to be able to build RPM package for Ora2Pg. Details of data export speed improvement are explained in the following article: http://blog.dalibo.com/2016/04/06/Ora2Pg_data_export_improvement.html There is a new configuration directive: * EMPTY_LOB_NULL: when enabled force empty_clob() and empty_blob() to be exported as NULL instead as empty string. Here is the complete list of other changes: - Put parenthesis around AT TIME ZONE expression - Add EMPTY_LOB_NULL directive to force empty_clob and empty_blob() to be exported as NULL instead as empty string. This might improve data export speed if you have lot of empty lob. Thanks to Alex Ignatov for the report. - Fix import_all.sh script to import grant and tablespace separately as postgres user and just after indexes and constraints creation. - Add parsing of tablespace from "alter table ... add constraint" with DDL input file. Thanks to Felipe Lavoura. - Remove --single-transaction in import_all.sh with TABLESPACE import. Thanks to Guillaume Lelarge for the report. - Fix Makefile.PL to used with latest spec file from Devrim Gündüz and following the advice of calbiston. - Update spec file to v17.4 and latest change to Makefile.PL - Replace ora2pg.spec by postgressql.org spec file by Devrim Gunduz. - Generate man page to avoids rpmbuild error. - Fix Windows install. Thanks to Lorena Figueredo for the report. - Remove "deferrability" call for mysql foreign keys. Thanks to Jean-Eric Cuendet for the report. - Fix issue in restoring foreign key for mysql data export. Thanks to Jean-Eric Cuendet for the report. - Remove connection test to PostgreSQL instance as postgres or any - Fix creation of configuration directory. - Fix Makefile to dissociate CONFDIR and DOCDIR from PREFIX or DESTDIR. Thanks to Stephane Schildknecht for the report. - Fix date_trunc+add_month replacement issue. Thanks to Lorena Figueredo for the report. - Do not replace configuration directory in scripts/ora2pg if this is a RPM build. Thanks to calbiston for the report. - Return empty bytea when a LOB is empty and not NULL. - Regular expressions and conditions checks improvement in method format_data_type() to make it a bit faster on huge tables. Thanks to Svetlana Shorina for the patch. - Fix INSERT using on the fly data import with boolean values. Thanks to jecuendet for the report. - Allow MySQL data type to be converted into boolean. Thanks to jecuendet for the report. - Fix export of BIT mysql data type into bit bit varying. Thanks to jecuendet for the report. - Fix call to escape_copy/escape_insert function call. As usual these also some bug fixes and Oracle to PostgreSQl conversion adjustments, see https://github.com/darold/ora2pg/blob/master/changelog for a complete list. Thanks to all contributors, they are all cited in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README About Ora2Pg : Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob and external table). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg v17.2 has been released
Paris, France - Mars 24th, 2016 **Ora2Pg 17.2 released** Version 17.2 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This is a maintenance release to fix several issues reported in new LOB extraction method. There is also some feature improvement: * Allow NUMBER with precision to be replaced as boolean. * Allow full relocation of Ora2Pg installation using for example: perl Makefile.PL DESTDIR=/opt/ora2pg As usual there is also some bug fixes and Oracle to PostgreSQL conversion adjustments, for a complete list see: https://github.com/darold/ora2pg/blob/master/changelog = Links & Credits = Thanks to all contributors, they are all cited in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README -- **About Ora2Pg** Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob, external table, etc.). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg version 17.0 released
Paris, France - Febuary 22th, 2016 **Ora2Pg 17.0 released** Version 17.0 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This new major release adds a new action type to obtain a count of all objects, primary keys, constraints, etc., at both sides, Oracle and PostgreSQL. To perform a diff between the two database and verify that everything have been well imported, just set the DSN to Oracle and PostgreSQL and run ora2pg as follow: ora2pg -c config/ora2pg.conf -t TEST > migration_diff.txt It also fixes several major and minor issues reported by users. A new ora2pg command line option have been added to ora2pg script: * Add --count_rows command line option to perform a real row count on both side, Oracle and PostgreSQL, in TEST report. As usual there is also some bug fixes and Oracle to PostgreSQL conversion adjustments, for a complete list see: https://github.com/darold/ora2pg/blob/master/changelog = Links & Credits = Thanks to all contributors, they are all cited in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README -- **About Ora2Pg** Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob, external table, etc.). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger 8.0 released
Paris, France - Febuary 22th, 2016 DALIBO is proud to announce the release of pgBadger 8.0. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. This is a major release that adds support to pgbouncer log files. New pgbouncer reports are: * Request Throughput * Bytes I/O Throughput * Queries Average duration * Simultaneous sessions * Histogram of sessions times * Sessions per database * Sessions per user * Sessions per host * Established connections * Connections per database * Connections per user * Connections per host * Most used reserved pools * Most Frequent Errors/Events pgbouncer log files can be parsed together with PostgreSQL logs. It also adds a two new command line options: * --pgbouncer-only to only show pgbouncer related reports. * --rebuild to be able to rebuild all html reports in incremental output directory where binary data files are still available. This release fixes a major bug introduced with journalctl code that was prevented the use of multiprocess feature. Update operators list in SQL code beautifier to support all missing operators. For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially Nicolas Gollet, Oskar Wiksten, Ronan Dunklau and Laurenz Albe. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : http://dalibo.github.io/pgbadger/ * Mailing List : https://listes.dalibo.com/cgi-bin/mailman/listinfo/pgbagder -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger 7.3
Paris, France - January 18th, 2016 pgBadger 7.3 was released today to fix a major bug. Everyone using version 7.2 and the incremental mode of pgBadger must upgrade. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. This is a maintenance release to fix a major bug that was breaking the incremental mode in pgBadger. It also adds some more reports and features. * Add --timezone=+/-HH to control the timezone used in charts. The javascript library runs at client side so the timezone used is the browser timezone so the displayed time in the charts can be different from the time in the log file. * Add /tmp/pgbadger.pid file to prevent cron jobs overlaping on same log files. * Add command line option --pid-dir to be able to run two pgbadger at the same time by setting an alternate path to the pid file. * Report information about "LOG: skipping analyze of ..." into events reports. * Report message "LOG: sending cancel to blocking autovacuum" into events reports. Useful to look for queries generating autovacuum kill on account of a lock issue. For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially CZAirwolf for for the help to fix the incremental bug issue. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : https://github.com/dalibo/pgbadger/releases/ * Mailing List : https://groups.google.com/forum/?hl=fr#!forum/pgbadger (pgbad...@googlegroups.com) -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger 7.2 has been published
Paris, France - January 13th, 2016 DALIBO is proud to announce the release of pgBadger 7.2. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. This new release fixes some issues especially in temporary files reports and adds some new features: * Allow pgBadger to parse natively the journalctl command output * Add new keywords from PG 9.5 for code formating * Add support to %n log_line_prefix option for Unix epoch (PG 9.6) There's also some new command line option: * Adds --journalctl_cmd option to enable this functionality and set the command. Typically: --journalctl_cmd "journalctl -u postgresql-9.4" to parse output of PG 9.4 log through the journalctl command. For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially Mael Rimbault, Guillaume Lelarge, David Turvey, Julien Rouhaud and Josh Kupershmid. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : https://github.com/dalibo/pgbadger/releases/ * Mailing List : https://groups.google.com/forum/?hl=fr#!forum/pgbadger (pgbad...@googlegroups.com) -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Version Ora2Pg 16.2 is out
Paris, France - January 13th, 2016 **Ora2Pg 16.2 released** Version 16.2 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This release fixes several issues, is more accurate on migration assessment report and adds some new ora2pg command line options: * Add --pg_dsn, --pg_user and --pg_pwd to be able to set the connection to import directly into PostgreSQL at command line. * Add -f option to script import_all.sh to force to not check user/database existing and skip their creation. Potential backward compatibility issues: * PG_SUPPORTS_CHECKOPTION is now enabled by default, you may want to migrate to PostgreSQL 9.4 or above. * Remove modification of CLIENT_ENCODING in generic configuration file with --init_project, use the default instead. * Remove modification of directive NLS_LANG to AMERICAN_AMERICA.UTF8 in generic configuration file with --init_project, use the default instead. As usual there is also some bug fixes and Oracle to PostgreSQl conversion adjustments, for a complete list see: https://github.com/darold/ora2pg/blob/master/changelog = Links & Credits = Thanks to all contributors, they are all cited in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README -- **About Ora2Pg** Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob, external table, etc.). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg v16.1 released
Paris, France - December 3rd, 2015 **Ora2Pg 16.1 released** Version 16.1 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This release fixes several issues and adds some very useful features: * Generate automatically a new import_all.sh shell script when using option --init_project to help automate all import into PostgreSQL. See sh import_all.sh -? for more information. * Export Oracle bitmap index as PostgreSQL btree_gin index. This require the btree_gin extension and PostgreSQL >= 9.4. This is the default. * Auto set DEFINED_PK to the first column of a table that have a unique key defined that is a NUMBER. This allow data of any table with a numeric unique key to be extracted using multiple connexions to Oracle using -J option. Tables with no numeric unique key will be exported with a single process. * Improve BLOB export speed by using hex encoding instead of escape. This might speed up be BLOB export by 10. * Allow use of LOB locator to retrieve BLOB and CLOB data to prevent having to set LONGREADLEN. Now LONGREADLEN is set to 8KB. Old behavior using LONGREADLEN can still be enabled by setting NO_LOB_LOCATOR to 0, given for backward compatibility. Default is to use LOB locator. * Ora2Pg will also auto detect table with BLOB and automatically decrease DATA_LIMIT to a value lower or equal to 1000. This is to prevent OOM. * Improving indexes and constraints creation speed by using the LOAD action and a file containing SQL orders to perform. It is possible to dispatch those orders over multiple PostgreSQL connections. To be able to use this feature, PG_DSN, PG_USER and PG_PWD must be set. Then: "ora2pg -t LOAD -c config/ora2pg.conf -i schema/tables/INDEXES_table.sql -j 4" will dispatch indexes creation over 4 simultaneous PostgreSQL connections. This will considerably accelerate this part of the migration process with huge data size. * Domain indexes are now exported as b-tree but commented to let you know where possible FTS are required. * Add number of refresh ON COMMIT materialized view in detailed report. * Allow redefinition of numeric type, ex: NUMBER(3)::bigint to fix wrong original definition in Oracle. * Allow export of all schema from an Oracle Instance when SCHEMA directive is empty and EXPORT_SCHEMA is enabled. All exported objects will be prefixed with the name of their original Oracle schema or search_path will be set to that schema name. * Allow use of COPY FREEZE to export data when COPY_FREEZE is enabled. This will only works with export to file and when -J or ORACLE_COPIES is not set or default to 1. It can be used with direct import into PostgreSQL under the same condition but -j or JOBS must be unset or default to 1. Some new configuration directives: * BITMAP_AS_GIN: enable it to use btree_gin extension to create bitmap like index with pg >= 9.4. You will need to create the extension by yourself: "create extension btree_gin;". Default is to create GIN index, when disabled, a btree index will be�created. * NO_LOB_LOCATOR: to disable use of LOB locator and extract BLOB "inline" using a less or more high value in LONGREADLEN. * BLOB_LIMIT: to force the value of DATA_LIMIT for tables with BLOB. Default is to automatically set this limit using the following code: BLOB_LIMIT=DATA_LIMIT; while (BLOB_LIMIT > 1000) BLOB_LIMIT /= 10 * COPY_FREEZE: use it to use COPY FREEZE instead of simple COPY to speedup import into PostgreSQL. As usual there is also some bug fixes and Oracle to PostgreSQL conversion adjustments, for a complete list see: https://github.com/darold/ora2pg/blob/master/changelog = Links & Credits = Thanks to all contributors, they are all cited in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README -- **About Ora2Pg** Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob, external table, etc.). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg v16.0 released
in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README -- **About Ora2Pg** Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob, external table, etc.). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgFormatter v1.5 released
pgFormatter 1.5 released October 17 2015 - v1.5 Version 1.5 of pgFormatter, a free a SQL formatter/beautifier dedicated to standard SQL and PostgreSQL specifics keywords, has been officially released and is publicly available for download. This release fixes several issues and adds support to new keywords added in PostgreSQL 9.5. There's also a major code rewrite by Hubert depesz Lubaczewski, pg_format works as previously - handles both CGI and CLI interface, but you can get directly to whatever functionality you want by using pgFormatter::* modules. New beautified keywords are: BERNOULLI, CUBE, GROUPING SETS, SKIP LOCKED, LOGGED, POLICY, ROLLUP, TABLESAMPLE. And new functions are: jsonb_pretty, jsonb_set, pg_last_committed_xact, pg_xact_commit_timestamp. There is also a useful hint added to documentation to be able to format you SQL code from vi by adding a simple line to .vimrc. This hint is taken from David Fetter's blog: http://people.planetpostgresql.org/dfetter/index.php?/archives/78-Formatting!.html For the complete list of changes see: https://github.com/darold/pgFormatter/blob/master/ChangeLog Links & Credits --- Thank to the developers who submitted patches and users who reported bugs and feature requests, especially Hubert depesz Lubaczewski, Kevin Brannen, David Fetter, Tom Burnett, Adrian Klaver, Alvaro Herrera, Niklas Schmidtmer and Pablo Alvarez de Sotomayor Posadillo. pgFormatter is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools. Links: Website: http://sqlformat.darold.net/ Download: http://sourceforge.net/projects/pgformatter/ Development: https://github.com/darold/pgFormatter Changelog: https://github.com/darold/pgFormatter/blob/master/ChangeLog About pgFormatter - pgFormatter is a SQL formatter/beautifier that supports keywords from SQL-92, SQL-99, SQL-2003, SQL-2008, SQL-2011 and PostgreSQL specifics keywords. May works with any other databases too. It shares the same code with pgBadger, so any improvement made in the parser is reversed to pgBadger. Tool created and maintained by Gilles Darold. pgFormatter can work as a console program or as a CGI. It will automatically detect his environment and output as text or as HTML following the context. pgFormatter works on any platform and is available under the PostgreSQL licence. -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgCluu release 2.4 is out
pgCluu 2.4 released --- PostgreSQL Cluster Utilization pgCluu is a Perl program used to perform a full audit of a PostgreSQL Cluster performances. It is divided in two parts, a collector used to grab statistics on the PostgreSQL server using psql and sar, a reports builder that will generate all HTML and charts output. This release is a maintenance release that fix some issues. There's also some new interesting reports: * Transfers per second (read/write/both) on all devices from sar -b * Transfers per second for each device from sar -d . * Number of tasks created per second * Number of context switches per seconds. * Improve pg_stat_statement report by adding all shared block stats and read/write I/O timing per query when track_io_timing is enabled. * Add device with highest tps on overall system information. and useful features: * Add --capture mode to pgcluu_collectd to be be able to build a snapshot of the PostgreSQL instance and exit. pgCluu will automatically adapt the report to this capture mode. It will use a temporary directory /tmp/pgcluu_capture to generate a tarball /tmp/pgcluu_capture.tar.gz containing the capture. * Add pgCluu logo and ico to the html output. * Add --charset option to be able to change the html charset, default: utf8. * Allow regular expression in database list available in reports, for example: with --db-only "p.*", only database beginning with p will be reported. * Allow pgcluu to parse and compute statistics from gzip compressed files. * pgcluu will not stop anymore if the sar file is not found, it will only show a warning message and continue. This release also adds -r | --rotate-daily and -R | --rotate-hourly options to pgcluu_collectd be able to rotate statistic files on a daily or hourly basis. You can use -z or --compress option to compress rotated data files. There also some code relative to next coming major release that will be used to allow a full incremental mode and a temporal selection into the collected statistics through a CGI program. This code enable caching (option -C or --cache) by dumping statistics stored in memory into binary files. With those files, data files can be removed (automatically with option -c or --clean) and report can be build later from them. This is not really useful now but this is the first stage to be able to build incremental and cumulative reports. See ChangeLog for a complete list of changes and bug fixes. The goal of this project is to provide a complete PostgreSQL auditing tool that don't need any dependency to be run easily to audit a local or remote server. If you just have a sar output file, pgCluu can be use to draw graphs about the system utilization only. pgCluu is an original collection of tools built during my work at Dalibo. Those tools are published under the PostgreSQL License to be shared, any one is welcome to contribute. For more information take a look at http://pgcluu.darold.net/ View a sample report at http://pgcluu.darold.net/example/index.html **IMPORTANT:** Note that new official releases must now be downloaded from GitHub and no more from SourceForge. Download at https://github.com/darold/pgcluu/releases About: -- pgCluu is created and maintained by Gilles Darold. * Web/Demo site: http://pgcluu.darold.net/ * Download: https://github.com/darold/pgcluu/releases * Development: https://github.com/darold/pgcluu * Documentation: https://github.com/darold/pgcluu/blob/master/README -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger 7.1 is out
Paris, France - July 11th, 2015 DALIBO is proud to announce the release of pgBadger 7.1. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. This new release fixes some issues and adds a new report: * Distribution of sessions per application It also adds Json operators to SQL Beautifier. For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog **IMPORTANT:** Note that new official releases must now be downloaded from GitHub and no more from SourceForge. Download at https://github.com/dalibo/pgbadger/releases = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially Olivier Schiavo, Keith Fiske, Hubert Depesz Lubaczewski, Tom Burnett, Steve Crawford, Cyril Bouthors and Nicolas Thauvin. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : http://dalibo.github.io/pgbadger/ * Mailing List : https://listes.dalibo.com/cgi-bin/mailman/listinfo/pgbagder -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger 7.0 is out
Paris, France - Mai 11th, 2014 DALIBO is proud to announce the release of pgBadger 7.0. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. This major release adds more useful reports and features. One of the longest feature request have been also implemented, support to auto_explain extension. EXPLAIN plan will be added together with top slowest queries when available in log files. Thanks to the kind authorization of depesz, a link to automatically open directly the explain plan on http://explain.depesz.com/ is also available. List of other new reports in this release: * Events (panic, fatal, error and warning) distribution per 5 minutes. * Per application details (total duration and times executed) for each query reported in Top Queries. The details are visible from a button called "App(s) involved". * Cumulated queries durations per user. Three new report to help identifying queries cancelled on secondaries clusters: * Number of cancelled queries (graph) * Queries generating the most cancellation (N) * Queries most cancelled. For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially Mael Rimbault, Thomas Reiss, Korriliam, rlowe and Antti Koivisto. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : http://dalibo.github.io/pgbadger/ * Mailing List : https://listes.dalibo.com/cgi-bin/mailman/listinfo/pgbagder -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgFormatter 1.4
pgFormatter 1.4 released -- Version 1.4 of pgFormatter, a free a SQL formatter/beautifier dedicated to standard SQL and PostgreSQL specifics keywords, has been officially released and is publicly available for download. This release fixes several issues and adds a useful anonymization option to be able to obfuscate all values in SQL queries. See option -a | --anonymize at command line or the corresponding checkbox in the CGI interface. For the full list of changes, see: Changelog: https://github.com/darold/pgFormatter/blob/master/ChangeLog Links & Credits Thank to the developers who submitted patches and users who reported bugs and feature requests, especially Alvaro Herrera, Hubert depesz Lubaczewski, David Fetter and rimbault. pgFormatter is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools. Links: Website: http://sqlformat.darold.net/ Download: http://sourceforge.net/projects/pgformatter/ Development: https://github.com/darold/pgFormatter About pgFormatter - pgFormatter is a SQL formatter/beautifier that supports keywords from SQL-92, SQL-99, SQL-2003, SQL-2008, SQL-2011 and PostgreSQL specifics keywords. May works with any other databases too. It shares the same code with pgBadger, so any improvement made in the parser is reversed to pgBadger. Tool created by Gilles Darold. pgFormatter can work as a console program or as a CGI. It will automatically detect his environment and output as text or as HTML following the context. pgFormatter works on any platform and is available under the PostgreSQL licence. -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg 15.2 is out
Ora2Pg 15.2 released Version 15.2 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This new minor release fixes some issues and adds two new configuration directives: * ORA_INITIAL_COMMAND to be able to execute a custom command just after the connection to Oracle, for example to unlock a security policy. * INTERNAL_DATE_MAX to change the behavior of Ora2Pg with internal date found in user defined types. This version will also automatically re-order exported views taking into account interdependencies. As usual these also some bug fixes and Oracle to PostgreSQL conversion adjustments, see https://github.com/darold/ora2pg/blob/master/changelog for a complete list. Thanks to all contributors, they are all cited in the changelog file. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README About Ora2Pg : Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob and external table). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBdager release 6.4 is out
Paris, France - April 13th, 2015 DALIBO announce pgBadger 6.4, a maintenance release with some improvements. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. This new release fixes a major bug in SQL beautifier which removed operators. It also adds some useful improvement in anonymization of parameters values. pgBadger will now try to parse the full csvlog when a broken CSV line is encountered instead of terminating the parsing. For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially Hubert Depesz Lubaczewski, Sergey Burladyan and Thomas Reiss. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : http://dalibo.github.io/pgbadger/ * Mailing List : https://listes.dalibo.com/cgi-bin/mailman/listinfo/pgbagder -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger 6.3 is out!
Paris, France - Mars 30th, 2015 DALIBO is proud to announce the release of pgBadger 6.3. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. This new release fixes several issues and adds some new reports: * A new per user details (total duration and times executed) for each query reported in Top Queries reports. The details are visible from a new button called "User(s) involved". * Add "Average queries per session" and "Average queries duration per session" in Sessions tab of the Global statistics. * Add connection time histogram. * Use bar graph for Histogram of query times and sessions times. There's also some cool new features and options: * Add -L | --logfile-list option to read a list of logfiles from an external file. * Add support to log_timezones with + and - signs for timestamp with milliseconds (%m). * Add --noreport option to instruct pgbadger to not build any HTML reports in incremental mode. pgBadger will only create binary files. * Add auto detection of client=%h or remote=%h from the log so that adding a prefix is not needed when it respect the default of pgbadger. * Redefine sessions duration histogram bound to be more accurate. * Add new option -M | --no-multiline to not collect multi-line statement and avoid storing and reporting garbage when needed. * Add --log-duration option to force pgbadger to associate log entries generated by both log_duration=on and log_statement=all. The pgbadger_tools script have also been improve with new features: * Add a new tool to pgbadger_tool to output top queries in CSV format for follow-up analysis. * Add --explain-time-consuming and --explain-normalized options to generate explain statement about top time consuming and top normalized slowest queries. For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially briklen, Guillaume Le Bihan, Rodolphe Quiedeville, Mael Rimbault, mbecroft, Grzegorz Garlewicz, Bill Mitchell, Julien Rouhaud, jacksonfoz, Hubert Depesz Lubaczewski, Paolo Cavallini, MarcoTrek, jirihlinka, Josh Kupershmid, jason, Guillaume Lelarge and Bruno Almeida, pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : http://dalibo.github.io/pgbadger/ * Mailing List : https://listes.dalibo.com/cgi-bin/mailman/listinfo/pgbagder -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgFormatter 1.3 released
pgFormatter 1.3 released -- Version 1.3 of pgFormatter, a free a SQL formatter/beautifier dedicated to standard SQL and PostgreSQL specifics keywords, has been officially released and is publicly available for download. This minor release fixes several formatting issues and adds support to geometric operators. It is also possible now to format an sql script with one statement per line, which is the reverse of the standard use. Links & Credits Thank to the developers who submitted patches and users who reported bugs and feature requests, especially Devin Ben-Hu, Marco Schmidt, Kevin Brannen, Vincent Picavet, Cedric, Felix Hummel and Julien Rouhaud. pgFormatter is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools. Links: Website: http://sqlformat.darold.net/ Download: http://sourceforge.net/projects/pgformatter/ Development: https://github.com/darold/pgFormatter Changelog: https://github.com/darold/pgFormatter/blob/master/ChangeLog About pgFormatter - pgFormatter is a SQL formatter/beautifier that supports keywords from SQL-92, SQL-99, SQL-2003, SQL-2008, SQL-2011 and PostgreSQL specifics keywords. May works with any other databases too. It shares the same code with pgBadger, so any improvement made in the parser is reversed to pgBadger. Tool created by Gilles Darold. pgFormatter can work as a console program or as a CGI. It will automatically detect his environment and output as text or as HTML following the context. pgFormatter works on any platform and is available under the PostgreSQL licence. -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg 15 released
Ora2Pg 15 released Version 15.1 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This major release improve PL/SQL code replacement, fixes several bugs and adds some new useful features: - Add support to the PostgreSQL external_file extension to mimic BFILE type from Oracle. See https://github.com/darold/external_file for more information. - Allow export of Oracle's DIRECTORY as external_file extension objects This will also try to export read/write privilege on those directories. - Allow export of Oracle's DATABASE LINK as Oracle foreign data wrapper server using oracle_fdw. - Allow function with PRAGMA AUTONOMOUS_TRANSACTION to be exported through a dblink wrapper to achieve the autonomous transaction. - Allow export of Oracle's SYNONYMS as views. Views can use foreign table to create "synonym" on object of a remote database. - Add trimming of data when DATA_TYPE is used to convert CHAR(n) Oracle column into varchar(n) or text. Default is to trim both side any space character. This behavior can be controlled using two new configuration directives TRIM_TYPE and TRIM_CHAR. - Add auto detection of geometry constraint type and dimensions through spatial index parameters. This avoid the overhead of sequential scan of the geometric column. - Add support to export Oracle sub partition and create sub partition for PostgreSQL with the corresponding trigger. - ALLOW and EXCLUDE directives are now able to apply filter on the object type. Backward compatibility can not be fully preserved, older definition will apply to current export type only, this could change your export in some conditions. See documentation update for more explanation. - Add PACKAGE_AS_SCHEMA directive to change default behavior that use a schema to emulate Oracle package function call. When disable, all calls to package_name.function_name() will be turn into package_name_function_name() just like a function call in current schema. - Add FKEY_OPTIONS to force foreign keys options. List of supported options are: ON DELETE|UPDATE CASCADE|RESTRICT|NO ACTION. - Add rewriting of internal functions in package body, those functions will be prefixed by the package name. Thanks to Dominique Legendre for the feature request. Some change can break backward compatibility and make configuration directives obsolete: - The ALLOW_PARTITION configuration directive has been removed. With new extended filters in ALLOW/EXCLUDE directive, this one is obsolete. Backward compatibility is preserved but may be removed in the future. - ALLOW and EXCLUDE directives do not works as previously. Backward compatibility may be preserved with some export type but may be broken in most of them. See documentation. - It is recommended now to leave the NLS_LANG and CLIENT_ENCODING commented to let Ora2Pg handle automatically the encoding. Those directives may be removed in the future. As usual these also some bug fixes and Oracle to PostgreSQl conversion adjustments, see https://github.com/darold/ora2pg/blob/master/changelog for a complete list. Thanks to all contributors, they are all cited in the changelog file. With again for this release very specials thanks to Dominique Legendre. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog - Documentation: https://github.com/darold/ora2pg/blob/master/README About Ora2Pg : Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob and external table). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgCluu 2.2 released
pgCluu 2.2 released --- PostgreSQL Cluster Utilization pgCluu is a Perl program used to perform a full audit of a PostgreSQL Cluster performances. It is divided in two parts, a collector used to grab statistics on the PostgreSQL server using psql and sar, a reports builder that will generate all HTML and charts output. This release is a maintenance release that fix several issues. There's also a simple report of transparent_hugepage from the system and a menu enhancement by dividing the device menu per 10 items which is helpful when there's plenty of disk devices. There a new command line option, --from-sa-file, that allow pgcluu to parse a sar output coming from a sa daily file. pgCluu will also set the application_name to pgcluu before collecting data to be able to exclude from the pg_stat_activity preport queries generated by pgcluu. See ChangeLog for a complete list. The goal of this project is to provide a complete PostgreSQL auditing tool that don't need any dependency to be run easily to audit a local or remote server. If you just have a sar output file, pgCluu can be use to draw graphs about the system utilization only. pgCluu is an original collection of tools built during my work at Dalibo. Those tools are published under the PostgreSQL License to be shared, any one is welcome to contribute. For more information take a look at http://pgcluu.darold.net/ View a sample report at http://pgcluu.darold.net/example/index.html About: -- pgCluu is created and maintained by Gilles Darold. * Web/Demo site: http://pgcluu.darold.net/ * Download: https://sourceforge.net/projects/pgcluu/ * Development: https://github.com/darold/pgcluu * Documentation: https://github.com/darold/pgcluu/blob/master/README -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg 14.1 released
ithub.com/darold/ora2pg/blob/master/README About Ora2Pg : Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob and external table). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- Gilles Darold Consultant PostgreSQL http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger 6.2
Paris, France - October 7th, 2014 DALIBO is proud to announce the release of pgBadger 6.2. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. This is a maintenance release to fix a regression in SQL traffic graphs and fix some other minor issues. The release also adds a new option -D or --dns-resolv to map client ip addresses to FQDN without having log_hostname enabled on the postgresql's configuration For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially Josh Berkus, Levente Birta and Jiri Hlinka pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : http://dalibo.github.io/pgbadger/ * Mailing List : https://listes.dalibo.com/cgi-bin/mailman/listinfo/pgbagder -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger 6.1 released
Paris, France - September 26th, 2014 DALIBO is proud to announce the release of pgBadger 6.1. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. This minor release fixes several issues and adds some new features. It adds a new option -B or --bar-graph to use bar instead of lines in graphs. It will also keep tick formatting when zooming. The release also adds a new program: pgbadger_tools to demonstrate how to work with pgBadger binary files to build your own new feature. The first tools 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements. There's also additional options to execute automatically the statements with EXPLAIN ANALYZE and get the execution plan. See help of the program for more information or the README file in the tools directory. Some modifications with behavior changes - The -T | --title text value will now be displayed instead of the pgBadger label right after the logo. It was previously displayed on mouse over the pgBadger label. For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially Julien Rouhauld, Suyah, Lloyd Albin, David Day, Jayadevan M and Bart Dopheide. Specials thanks to Rodolphe Quiedeville that initiate the works on pgbadger_tools with the explain slowest tool. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : http://dalibo.github.io/pgbadger/ * Mailing List : https://listes.dalibo.com/cgi-bin/mailman/listinfo/pgbagder -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgCluu 2.1 released
pgCluu 2.1 released --- PostgreSQL Cluster Utilization pgCluu is a Perl program used to perform a full audit of a PostgreSQL Cluster performances. It is divided in two parts, a collector used to grab statistics on the PostgreSQL server using psql and sar, a reports builder that will generate all HTML and charts output. This new release adds lot of report improvements and bug fixes. There is also several new features or reports : - Allow system information commands to be executed remotely. - Allow sar to be executed on a remote server using a ssh connection. - New report of connections waiting for a lock. - Add average duration time in statement report. - New pg_stat_statements report. - Add pg_default and pg_global to tablespace size report. New options to pgcluu_collectd: -M or --max-size option to allow an output directory size limit. --no-database to avoid collecting statistics from a database. -C count to terminate program after collecting data for X times. -E or --end-after to terminate program after for some time. -V or --version to show version information. And some more changes/fixes, see ChangeLog for a complete list. The goal of this project is to provide a complete PostgreSQL auditing tool that don't need any dependency to be run easily to audit a local or remote server. If you just have a sar output file, pgCluu can be use to draw graphs about the system utilization only. pgCluu is an original collection of tools built during my work at Dalibo. Those tools are published under the PostgreSQL License to be shared, any one is welcome to contribute. For more information take a look at http://pgcluu.darold.net/ View a sample report at http://pgcluu.darold.net/example/index.html About: -- pgCluu is created and maintained by Gilles Darold. * Web/Demo site: http://pgcluu.darold.net/ * Download: https://sourceforge.net/projects/pgcluu/ * Development: https://github.com/darold/pgcluu * Documentation: https://github.com/darold/pgcluu/blob/master/README -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger v6.0 is out
Paris, France - August 11th, 2014 DALIBO is proud to announce the release of pgBadger 6.0. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your PostgreSQL log files. This new major release fixes several issues and adds some new features: * Automatic cleanup of binary files in incremental mode. * Automatic handling of retention with a maximum number of weeks to keep reports. * Incremental mode improvement by allowing the use of multiprocessing with multiple log file. * Now reports the query latency percentiles on the general activity table (percentiles are 90, 95, 99). * A new output format: JSON. This format is good for sharing data with other tools. * Using the --anonymize option pgBadger will anonymize all literal values in the queries. * Add a click-to-select button in front of each query that allow to just use Ctrl+C to copy it on clipboard. * Several space usage improvement in incremental mode, the -X option allow the use of external CSS and Javascript files. * A new pgBadger logo Warning: the behavior of pgBadger in incremental mode has changed. It will now always cleanup the output directory of all the obsolete binary file. If you were using those files to build your own reports, you can prevent pgBadger to remove them by using the --noclean option. Note that if you use the retention feature, all those files in obsolete directories will be removed too. For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially Herve Werner, Julien Rouhaud, Josh Berkus, CZAirwolf, Bruno Almeida, Marc Cousin, Thomas Reiss, Rodolphe Quiedeville, Himanchali, Guilhem Rambal, Shanzhang Lan, Xavier Millies-Lacroix, Kong Man, wmorancfi, flopma and birkosan. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : http://dalibo.github.io/pgbadger/ * Mailing List : https://listes.dalibo.com/cgi-bin/mailman/listinfo/pgbagder -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Errata pgBadger 5.1 is out
Hello, Errata: some patches was not applied to the 5.1 release of pgBadger. The github.org code has been fixed and a new tarball have been built on Source Forge. If you have previously downloaded the v5.1 release please do it again. To be sure, check that the Changelog has the following sentence: 2014-05-05 version 5.1-1 - Fix parsing of remote log file, forgot to apply some patches. Thank to Herve Werner for the report. Download of official releases : https://sourceforge.net/projects/pgbadger/ GitHub developpement code : https://github.com/dalibo/pgbadger/ Sorry for the inconvenient. -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger 5.1 is out
Paris, France - May 6th, 2014 DALIBO is proud to announce the release of pgBadger 5.1. pgBadger is a PostgreSQL performance analyzer, built for speed with fully detailed reports based on your Postgres log files. This new release fixes several issues and adds some new features: * Support to named PREPARE and EXECUTE queries. They are replaced by the real prepare statement and reported into top queries. * Add new --exclude-line command line option for excluding immediately log entries matching any regex. * Included remote and client information into the most frequent events. * pgBadger is now able to parse remote logfiles using a password less ssh connection and generate locally the reports. * Histogram granularity can be adjusted using the -A command line option. * Add new detail information on top queries to show when the query is a bind query. * Support to logfile compressed using the xz compression format. * Change week/day menu in incremental index, it is now represented as usual with a calendar view per month. * Fix various compatibility issue with Windows and Perl 5.8 For the complete list of changes, please checkout the release note on https://github.com/dalibo/pgbadger/blob/master/ChangeLog = Links & Credits = DALIBO would like to thank the developers who submitted patches and the users who reported bugs and feature requests, especially Herve Werner, Fangr Zhang, Ulf Renman, Thom Brown, Johnny Tan, hkrizek, Magnus Persson, Ronan Dunklau, Adrien Nayrat, William Moran, Orange OLPS department, Josh Kupershmidt, brunomgalmeida, Brian DeRocher, ferfebles and Josh Berkus. With very special thanks to Herve Werner who took time and efforts to heavily test the incremental pgBadger feature. pgBadger is an open project. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly on our mailing list. Links : * Download : http://dalibo.github.io/pgbadger/ * Mailing List : https://listes.dalibo.com/cgi-bin/mailman/listinfo/pgbagder -- **About pgBadger** : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. pgBadger is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Demo at http://dalibo.github.io/pgbadger/ -- **About DALIBO** : DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops Check out DALIBO's open source projects at http://dalibo.github.io -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgCluu 2.0 released
ffected rows on the database grouped by statement family (insert, delete, update, select). - Number of commits / rollbacks per second and number of backends per database. - Number of queries canceled due to conflicts with recovery in the database. - Conflicts per type on the database. If pg_buffercache is installed there's some additional reports: - Number of shared buffer/pages used by a relation. - Number of buffers loaded in cache for a relation and the percentage of the relation loaded. and if pg_stat_statements is installed: - Top statistics about slowest or most used queries pgBouncer performances: --- - Number of active/waiting clients, active/idle/used server connections and maximum wait duration for client connections in each pgbouncer pool. - Average queries duration in each pgbouncer pool. - Number of queries per second in each pgbouncer pool. System performances: - Percentage of CPU utilization. - Amount of memory used to cache data or as buffers by the kernel and free memory. - Total number of swap pages the system brought in/out per second. - System load average for the last minute, the past 5 and 15 minutes. - Number of tasks in the task list. - Number of tasks waiting for run time. - Total amount of data read/write from the devices in blocks per second. - Total number of kilobytes the system paged in/out from/to disk, and number of major faults the system has made per second. - Percentage of CPU time used by I/O requests issued to a device. - Number of bytes read/write from/to a device. - The average service time (in milliseconds) for I/O requests that were issued to a device. - Statistics about network devices utilization. - Statistics on failures from the network device. All charts are zoomable and can be saved as PNG images. All tables are sortable on all columns. If you think that some reports are missing, feel free to submit a feature request. pgCluu should works on any platform supported by psql and sysstat, it is available under the PostgreSQL licence. pgCluu is created and maintained by Gilles Darold (also author of ora2pg and pgbadger). Useful Links: - * Website: http://pgcluu.darold.net/ * Download: http://sourceforge.net/projects/pgcluu/ * Development: https://github.com/darold/pgcluu * Changelog: https://github.com/darold/pgcluu/blob/master/ChangeLog -- Gilles Darold Administrateur de bases de données http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgCluu 1.1 released
pgCluu 1.1 released --- PostgreSQL Cluster Utilization pgCluu is a Perl program used to perform a full audit of a PostgreSQL Cluster performances. It is divided in two parts, a collector used to grab statistics on the PostgreSQL server using psql and sar, a reports builder that will generate all HTML and charts output. A demo site is available at http://pgcluu.darold.net/example/index.html This new release adds lot of report improvements and bug fixes. There is also several new features or reports : - Format mouse tracker on graphs to show all dataset values at a time. - Add run queue length report to system menu. - Add checkpoint write and sync times reports. - Add report of PostgreSQL version - Split background writer buffer and count statistics into separated reports. - Add report of maxwritten_clean into bgwriter reports. - Add report of kernel parameters to the system info page. - Add collect of system kernel tuning parameters. - Remove embedded CSS and javascript on each HTML page, resources are now automatically copied into the output directory if not already present. - Allow pgcluu to parse sar file generated from sa file, use commands like "sar -A -p -f /var/log/sysstat/sa*". - Split commit, rollback and backend graph by using a second yaxis for backend. - Add System Information report. - Move Cache hit/miss ratio on second yaxis and change dataset colors. - Add collect of OS release information. - Allow pgcluu_collectd to grab OS information (cpu, memory, etc.) and add --os-info option to only grab that information (for testing). - Reformat dashboard information. - Add -z | --timezone to set the hour(s) from GMT time to adjust times on sar report. and some more changes/fixes, see ChangeLog for a complete list. There's lot of others reports to be included: - Statistics reports concerning tables. - Statistics reports about pg_stat_statement. - More Sar statistics reports. - ... This will comes in next releases. The goal of this project is to provide a complete PostgreSQL auditing tool that don't need any dependency to be run on any server easily, "a la pgBadger". If you just have a sar output file, pgCluu can be use to draw graphs about the system utilization only. pgCluu is an original collection of tools built during my work at Dalibo. Those tools are published under the PostgreSQL License to be shared, any one is welcome to contribute. For more information take a look at http://pgcluu.darold.net/ View a sample report at http://pgcluu.darold.net/example/index.html About: -- pgCluu is created by Gilles Darold (also author of ora2pg and pgbadger). * Web/Demo site: http://pgcluu.darold.net/ * Download: https://sourceforge.net/projects/pgcluu/ * Development: https://github.com/darold/pgcluu * Documentation: https://github.com/darold/pgcluu/blob/master/README -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg 12.1 released
Ora2Pg 12.1 released Version 12.1 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This minor release is mainly a maintenance release with some minor bug fixes and a new configuration directive, INDEXES_SUFFIX, to append a suffix to indexes names. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog About Ora2Pg : Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob and external table). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgCluu - PostgreSQL Cluster Utilization
pgCluu 1.0 --- PostgreSQL Cluster Utilization pgCluu is a Perl program used to perform a full audit of a PostgreSQL Cluster performances. It is divided in two parts, a collector used to grab statistics on the PostgreSQL server using psql and sar, a reports builder that will generate all HTML and charts output. View a sample report at http://pgcluu.darold.net/example/index.html At this time pgCluu collect and report most of what is helpful for a PostgreSQL Cluster performance auditing. See http://pgcluu.darold.net/ for more detailed features and sample reports. There's lot of others reports to be included: - Statistics reports concerning tables. - Statistics reports about pg_stat_statement. - More Sar statistics reports. - ... This will comes in next releases. The goal of this project is to provide a complete PostgreSQL auditing tool that don't need any dependency to be run on any server easily, "a la pgBadger". If you just have a sar output file, pgCluu can be use to draw graphs about the system utilization only. pgCluu is an original collection of tools built during my work at Dalibo. Those tools are published under the PostgreSQL License to be shared, any one is welcome to contribute. For more information take a look at http://pgcluu.darold.net/ About: -- pgCluu is created by Gilles Darold (also author of Ora2Pg and pgBadger). * Web/Demo site: http://pgcluu.darold.net/ * Download: https://sourceforge.net/projects/pgcluu/ * Development: https://github.com/darold/pgcluu * Documentation: https://github.com/darold/pgcluu/blob/master/README -- Gilles Darold Administrateur de bases de données http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger v4.1 released
pgBadger v4.1 released Version 4.1 of pgBadger, a fast PostgreSQL log analyzer has been officially released and is publicly available for download. This release includes two major bug fixes: - All reports with per minutes average was not reporting last time fraction. - On SQL traffic, report about queries per second had wrong min and average value. Graph about select queries was wrong too. and some few other minor bug fixes. There's also some new features: - Add min/max dataset on report about select queries per seconds. - Allow external links use into URL to go to a specific report. - Add --exclude-appname command line option to eliminate unwanted traffic generated by a specific application. - Add a chapter about howto build "Incremental reports" into documentation. Useful Links: - - Website: http://dalibo.github.io/pgbadger/ - Download: https://sourceforge.net/projects/pgbadger/ - Development: https://github.com/dalibo/pgbadger/ - Changelog: https://github.com/dalibo/pgbadger/blob/master/ChangeLog About pgBadger : pgBagder is a new generation log analyzer for PostgreSQL, created by Gilles Darold (also author of ora2pg, the powerful migration tool). pgBadger is a fast and easy tool to analyze your SQL traffic and create HTML5 reports with dynamics graphs. This is the perfect tool to understand the behavior of your PostgreSQL servers and identify which SQL queries need to be optimized. Docs, Download & Support at http://dalibo.github.io/pgbadger/ -- Gilles Darold Administrateur de bases de données http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg 12.0 released
Ora2Pg 12.0 released Version 12.0 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This major release includes three new features: - Export materialized views with native PostgreSQL 9.3 syntax (default now) - Allow export of tables and indexes using their original tablespace information. - Automatic column reordering with tables export to minimized the footprint on disc, so that more rows fit on a data page. and lot of bug fixes. Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog About Ora2Pg : Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, materialized view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob and external table). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgBadger 2.3 released
pgBadger 2.3 released Version 2.3 of pgBadger, a PostgreSQL log analyzer build for speed with fully detailed reports from your PostgreSQL log file, has been officially released and is publicly available for download. This release fixes several major issues especially with csvlog and a memory leak with log parsing using a start date. There's also several improvement like new reports of number of queries by database and application. Mouse over reported queries will show the database, user, remote client and application name where they are executed. A new binary input/output format have been introduced to allow saving or reading precomputed statistics. This will allow incremental reports based on periodical runs of pgbadger. This is a work in progress fully available with next coming major release. Several SQL code beautifier improvement from pgFormatter have also been merged. Useful Links: Website: http://dalibo.github.com/pgbadger/ Download: http://sourceforge.net/projects/pgbadger/ Development: https://github.com/dalibo/pgbadger Changelog: https://github.com/dalibo/pgbadger/blob/master/ChangeLog About pgBadger : pgBadger is a PostgreSQL log analyzer build for speed with fully detailed reports from your PostgreSQL log file. It is written in pure Perl language and uses a javascript library to draw graphs so that you don't need additional Perl modules or any other package to install. pgBadger is able to auto detect your log file format (syslog, stderr or csvlog). It is designed to parse huge log files as well as gzip/bzip2 compressed file. pgBdger reports everything about your SQL queries: Overall statistics. The slowest queries. Queries that took up the most time. The most frequent queries. The most frequent errors. The following reports are also available with hourly charts: Hourly queries statistics. Hourly temporary file statistics. Hourly checkpoints statistics. Locks statistics. Queries by type (select/insert/update/delete). Sessions per database/user/client. Connections per database/user/client. All charts are zoomable and can be saved as PNG images. pgBadger supports any custom format set into log_line_prefix of your postgresql.conf file provide that you use the %t, %p and %l patterns. pgBadger works on any platform and is available under the PostgreSQL licence. -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgFormatter 1.2 released
pgFormatter 1.2 released Version 1.2 of pgFormatter, a free a SQL formatter/beautifier dedicated to standard SQL and PostgreSQL specifics keywords, has been officially released and is publicly available for download. This minor release add file upload capability in CGI context and better code formatting. Useful Links: Website: http://sqlformat.darold.net/ Download: http://sourceforge.net/projects/pgformatter/ Development: https://github.com/darold/pgFormatter Changelog: https://github.com/darold/pgFormatter/blob/master/ChangeLog About pgFormatter : pgFormatter is a SQL formatter/beautifier that supports keywords from SQL-92, SQL-99, SQL-2003, SQL-2008, SQL-2011 and PostgreSQL specifics keywords. May works with any other databases too. It shares the same code with pgBadger, so any improvement made in the parser is reversed to pgBadger. pgFormatter can work as a console program or as a CGI. It will automatically detect his environment and output as text or as HTML following the context. pgFormatter works on any platform and is available under the PostgreSQL licence. -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] Ora2Pg 10.1 released
Ora2Pg 10.1 released Version 10.1 of Ora2Pg, a free and reliable tool used to migrate an Oracle database to PostgreSQL, has been officially released and is publicly available for download. This minor release includes an HTML report for migration cost assessment and some bugfixes. A sample of the HTML report can be found at http://ora2pg.darold.net/report.html Useful Links: - Website: http://ora2pg.darold.net/ - Download: http://sourceforge.net/projects/ora2pg/ - Development: https://github.com/darold/ora2pg - Changelog: https://github.com/darold/ora2pg/blob/master/changelog About Ora2Pg : Ora2Pg is an easy and reliable tool to migrate from Oracle to PostgreSQL. It is developed since 2001 and can export most of the Oracle objects (table, view, tablespace, sequence, indexes, trigger, grant, function, procedure, package, partition, data, blob and external table). Ora2Pg works on any platform and is available under the GPL v3 licence. Docs, Download & Support at http://ora2pg.darold.net/ -- Gilles Darold http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
[ANNOUNCE] pgFormatter v1.1
pgFormatter 1.1 --- pgFormatter is a SQL formatter/beautifier supports keywords from SQL-92, SQL-99, SQL-2003, SQL-2008, SQL-2011 and PostgreSQL specifics keywords. Even if it is dedicated to PostgreSQL it may works with any other databases too. pgFormatter can work as a console program or as a CGI. It will automatically detect his environment and output as text or as HTML following the context. This is the same query parser than the one embedded in pgBadger plus all the Postgresql functions and was first used to improve the SQL beautifier in an independent way. Some of these improvements can not be included into pgBadger for performances reason. In console mode, you can format all SQL queries from stdin as follow: cat samples/ex1.sql | /usr/local/bin/pg_format - or from a file with output to an other file: /usr/local/bin/pg_format -f 2 -c samples/ex1.sql -o result.sql In CGI mode, just copy pg_format under a cgi-script directory and get it from your favorite browser, you will have something like in the demo site: http://sqlformat.darold.net/ Future versions of pgFormatter will tend to include a PLPGSQL code beautifier. About: -- * Download: https://sourceforge.net/projects/pgformatter/ * Development: https://github.com/darold/pgFormatter * Web/Demo site: http://sqlformat.darold.net/ * Documentation: https://github.com/darold/pgFormatter/blob/master/README Cheers, -- Gilles Darold - Dalibo http://dalibo.com - http://dalibo.org -- Sent via pgsql-announce mailing list (pgsql-announce@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-announce
