Re: Update: PostgreSQL 9.6.5 -> 10.0

2017-11-14 Thread Jeremy Evans
On 11/01 11:26, Jeremy Evans wrote:
> This updates PostgreSQL from 9.6.5 to 10.0.  Starting in 10.0,
> the versioning policy will change, so instead of 10.0.1, the
> next bugfix release will be 10.1, and the next feature release
> will be 11.0.

Here's an updated diff for PostgreSQL 10.1.  This also includes
updates to pg_statsinfo and a small fix for pg_routing so that
both build with PostgreSQL 10. It also bumps postgresql-previous
to 9.6.6.

I've tested this by building all of PostgreSQL's dependencies on
amd64.

pea@, can you check this against your version and let me know if
there are any substantive differences?  If not, we may want to test
this in a bulk and see if there is any fallout.

Thanks,
Jeremy

Index: databases/citus/Makefile
===
RCS file: /cvs/ports/databases/citus/Makefile,v
retrieving revision 1.3
diff -u -p -r1.3 Makefile
--- databases/citus/Makefile15 Aug 2017 02:32:50 -  1.3
+++ databases/citus/Makefile1 Nov 2017 18:17:03 -
@@ -3,7 +3,7 @@
 COMMENT =  extension to horizontally scale PostgreSQL
 GH_ACCOUNT =   citusdata
 GH_PROJECT =   citus
-GH_TAGNAME =   v6.2.3
+GH_TAGNAME =   v7.0.3
 
 CATEGORIES =   databases
 HOMEPAGE = https://www.citusdata.com/
Index: databases/citus/distinfo
===
RCS file: /cvs/ports/databases/citus/distinfo,v
retrieving revision 1.2
diff -u -p -r1.2 distinfo
--- databases/citus/distinfo15 Aug 2017 02:32:50 -  1.2
+++ databases/citus/distinfo1 Nov 2017 18:17:18 -
@@ -1,2 +1,2 @@
-SHA256 (citus-6.2.3.tar.gz) = A6zjYuPyO08CwFy1ZyaK0T9k7BqN6W5ewOYHry471n4=
-SIZE (citus-6.2.3.tar.gz) = 2282287
+SHA256 (citus-7.0.3.tar.gz) = OGmJhsuAcwmHWxH1SOlrBqNTkMmj5gwjO1k1b6rNFmM=
+SIZE (citus-7.0.3.tar.gz) = 2459522
Index: databases/citus/pkg/PLIST
===
RCS file: /cvs/ports/databases/citus/pkg/PLIST,v
retrieving revision 1.1.1.1
diff -u -p -r1.1.1.1 PLIST
--- databases/citus/pkg/PLIST   7 Jul 2017 19:58:07 -   1.1.1.1
+++ databases/citus/pkg/PLIST   1 Nov 2017 18:18:09 -
@@ -1,6 +1,7 @@
 @comment $OpenBSD: PLIST,v 1.1.1.1 2017/07/07 19:58:07 landry Exp $
 include/postgresql/server/citus_version.h
 include/postgresql/server/distributed/
+include/postgresql/server/distributed/backend_data.h
 include/postgresql/server/distributed/citus_clauses.h
 include/postgresql/server/distributed/citus_nodefuncs.h
 include/postgresql/server/distributed/citus_nodes.h
@@ -8,10 +9,15 @@ include/postgresql/server/distributed/ci
 include/postgresql/server/distributed/colocation_utils.h
 include/postgresql/server/distributed/connection_management.h
 include/postgresql/server/distributed/deparse_shard_query.h
+include/postgresql/server/distributed/distributed_deadlock_detection.h
 include/postgresql/server/distributed/distribution_column.h
 include/postgresql/server/distributed/errormessage.h
 include/postgresql/server/distributed/hash_helpers.h
+include/postgresql/server/distributed/insert_select_executor.h
+include/postgresql/server/distributed/insert_select_planner.h
 include/postgresql/server/distributed/listutils.h
+include/postgresql/server/distributed/lock_graph.h
+include/postgresql/server/distributed/maintenanced.h
 include/postgresql/server/distributed/master_metadata_utility.h
 include/postgresql/server/distributed/master_protocol.h
 include/postgresql/server/distributed/metadata_cache.h
@@ -24,8 +30,10 @@ include/postgresql/server/distributed/mu
 include/postgresql/server/distributed/multi_logical_optimizer.h
 include/postgresql/server/distributed/multi_logical_planner.h
 include/postgresql/server/distributed/multi_master_planner.h
+include/postgresql/server/distributed/multi_partitioning_utils.h
 include/postgresql/server/distributed/multi_physical_planner.h
 include/postgresql/server/distributed/multi_planner.h
+include/postgresql/server/distributed/multi_progress.h
 include/postgresql/server/distributed/multi_resowner.h
 include/postgresql/server/distributed/multi_router_executor.h
 include/postgresql/server/distributed/multi_router_planner.h
@@ -36,8 +44,8 @@ include/postgresql/server/distributed/pg
 include/postgresql/server/distributed/pg_dist_local_group.h
 include/postgresql/server/distributed/pg_dist_node.h
 include/postgresql/server/distributed/pg_dist_partition.h
+include/postgresql/server/distributed/pg_dist_placement.h
 include/postgresql/server/distributed/pg_dist_shard.h
-include/postgresql/server/distributed/pg_dist_shard_placement.h
 include/postgresql/server/distributed/pg_dist_transaction.h
 include/postgresql/server/distributed/placement_connection.h
 include/postgresql/server/distributed/reference_table_utils.h
@@ -48,9 +56,10 @@ include/postgresql/server/distributed/re
 include/postgresql/server/distributed/resource_lock.h
 

Re: Update: PostgreSQL 9.6.5 -> 10.0

2017-11-02 Thread Stuart Henderson
On 2017/11/01 11:26, Jeremy Evans wrote:
> Included at the bottom are necessary bumps for postgresql-pllua
> and postgresql-plv8, since those always depend on specific
> PostgreSQL versions.

You can set "PKGSPEC-server=postgresql-server->=10,<11" in postgresql-server
then this will happen automatically, you won't need to bump dependencies.



Re: Update: PostgreSQL 9.6.5 -> 10.0

2017-11-01 Thread Pierre-Emmanuel André
On Wed, Nov 01, 2017 at 11:26:45AM -0700, Jeremy Evans wrote:
> This updates PostgreSQL from 9.6.5 to 10.0.  Starting in 10.0,
> the versioning policy will change, so instead of 10.0.1, the
> next bugfix release will be 10.1, and the next feature release
> will be 11.0.
> 
> There are many compelling reasons to upgrade, see:
> 
> https://www.postgresql.org/about/news/1786/
> https://www.postgresql.org/docs/10/static/release-10.html
> 
> The update is fairly straightforward, though I moved some things
> around in the PLISTs:
> 
> * All python-dependent code moves to the -plpython subpackage,
>   as it doesn't make sense to have plpython itself in -plpython,
>   but hstore-plpython and ltree-plpython in -contrib.
> 
> * Some server-specific programs such as pg_basebackup and
>   pg_receivexlog (renamed to pg_receivewal) move from -client
>   to -server, since they are only useful if you are running
>   a PostgreSQL server.
> 
> postgresql-previous gets updated from 9.5.5 to 9.6.5, and
> postgresql-pg_upgrade now depends on a postgresql-previous
> version that is at least greater than the previous major
> version, which should fix issues if someone runs
> "pkg_add postgresql-server".
> 
> I've tried a pg_upgrade from 9.6 to 10 and didn't run into
> any problems, but it was on a very simple test database.
> 
> Included at the bottom are necessary bumps for postgresql-pllua
> and postgresql-plv8, since those always depend on specific
> PostgreSQL versions.
> 
> I've tried building some of the dependencies.  citus needs an
> update to work with PostgreSQL 10, the diff to update to the
> latest citus version is included below.  No other issues
> noticed yet, but I haven't finished building the dependencies
> for PostGIS.
> 
> This should probably go into a bulk so we can see what the
> fallout is.
>

Hi Jeremy,

Thanks for your diff. Let me compare it with my own diff (i'm running pg 10 
since beta 1).
Regards,


> Thanks,
> Jeremy
> 
> Index: postgresql/Makefile
> ===
> RCS file: /cvs/ports/databases/postgresql/Makefile,v
> retrieving revision 1.229
> diff -u -p -u -p -r1.229 Makefile
> --- postgresql/Makefile   13 Sep 2017 14:24:08 -  1.229
> +++ postgresql/Makefile   1 Nov 2017 17:14:24 -
> @@ -7,8 +7,8 @@ COMMENT-contrib=PostgreSQL RDBMS contrib
>  COMMENT-plpython=Python procedural language for PostgreSQL
>  COMMENT-pg_upgrade=Support for upgrading PostgreSQL data from previous 
> version
>  
> -VERSION= 9.6.5
> -PREV_MAJOR=  9.5
> +VERSION= 10.0
> +PREV_MAJOR=  9.6
>  DISTNAME=postgresql-${VERSION}
>  PKGNAME-main=postgresql-client-${VERSION}
>  PKGNAME-server=  postgresql-server-${VERSION}
> @@ -18,10 +18,10 @@ PKGNAME-plpython=postgresql-plpython-${V
>  PKGNAME-pg_upgrade=postgresql-pg_upgrade-${VERSION}
>  
>  CATEGORIES=  databases
> -SHARED_LIBS= ecpg7.8 \
> - ecpg_compat 4.8 \
> - pgtypes 4.7 \
> - pq  6.9 
> +SHARED_LIBS= ecpg7.9 \
> + ecpg_compat 4.9 \
> + pgtypes 4.8 \
> + pq  6.10 
>  
>  HOMEPAGE=http://www.postgresql.org/
>  
> @@ -96,10 +96,10 @@ WANTLIB-server=   ${WANTLIB-main} perl pq>
>  RUN_DEPENDS-contrib= databases/postgresql,-server=${VERSION}
>  LIB_DEPENDS-contrib= databases/postgresql=${VERSION} \
>${LIB_DEPENDS-main}
> -WANTLIB-contrib= ${WANTLIB-main} pq>=4
> +WANTLIB-contrib= ${WANTLIB-main} pq>=4 perl
>  
>  RUN_DEPENDS-pg_upgrade=  databases/postgresql,-server=${VERSION} \
> - databases/postgresql-previous
> + databases/postgresql-previous>=${PREV_MAJOR}
>  LIB_DEPENDS-pg_upgrade= databases/postgresql=${VERSION} \
>${LIB_DEPENDS-main}
>  WANTLIB-pg_upgrade=  ${WANTLIB-main} pq>=4
> Index: postgresql/distinfo
> ===
> RCS file: /cvs/ports/databases/postgresql/distinfo,v
> retrieving revision 1.68
> diff -u -p -u -p -r1.68 distinfo
> --- postgresql/distinfo   13 Sep 2017 14:24:08 -  1.68
> +++ postgresql/distinfo   1 Nov 2017 14:12:43 -
> @@ -1,2 +1,2 @@
> -SHA256 (postgresql-9.6.5.tar.gz) = 
> eelgXTIbVFsu2d8Yrf0uUslQ3JNGtl6VJ/EXExYn3Ao=
> -SIZE (postgresql-9.6.5.tar.gz) = 25652523
> +SHA256 (postgresql-10.0.tar.gz) = 
> hsg6Zkt3ARSGG8lqnso8Pv4owDhManHGEEJs1CsBZPs=
> +SIZE (postgresql-10.0.tar.gz) = 25830653
> Index: postgresql/patches/patch-src_backend_libpq_ip_c
> ===
> RCS file: 
> /cvs/ports/databases/postgresql/patches/patch-src_backend_libpq_ip_c,v
> retrieving revision 1.2
> diff -u -p -u -p -r1.2 patch-src_backend_libpq_ip_c
> --- postgresql/patches/patch-src_backend_libpq_ip_c   13 Feb 2016 21:54:28 
> -  1.2
> +++ postgresql/patches/patch-src_backend_libpq_ip_c   1 Nov 2017