I'm back with more details.
First, I've deleted the smaller sslentry database, since I don't need it,
just so that it doesn't somehow spoil the picture. Now there is only 1 user
database - bof (OID=16400). After that I've ran the pg_upgrade on a clean
10.4 cluster and it failed in the same way.
Now, the answers to your queries.
>> 2) The upgrade stops because of transaction ID wraparound, which is
strange as that is not showing up in the 9.6 cluster I presume. You might
want the queries found below on the 9.6 and 10 clusters to help figure this
out:
>> SELECT c.oid::regclass as table_name,
>> greatest(age(c.relfrozenxid),age(t.relfrozenxid)) as age
>> FROM pg_class c
>> LEFT JOIN pg_class t ON c.reltoastrelid = t.oid
>> WHERE c.relkind IN ('r', 'm');
9.6 result - see attached 96-query1.txt
10.4 result - see attached 104-query1.txt
>> SELECT datname, age(datfrozenxid) FROM pg_database;
9.6 result - see attached 96-query2.txt
10.4 result - see attached 104-query2.txt
>> It might be useful
>> to see pg_controldata output for the old cluster, as well as
>> "select datname, datfrozenxid from pg_database" output from the
>> old cluster.
for the query - see above, for pg_controldata:
9.6 - see attached 96-pg_controldata.txt
10.4 - see attached 104-pg_controldata.txt
>> Alexander, could you hack things up so autovacuum logging is enabled
>> (log_autovacuum_min_duration=0), and see whether it's triggered?
I'll be happy to, but that will require to run pg_upgrade once more and
that takes more that half a day and during this time clusters are not
available to me. Given the data I'm attaching it may happen that the
colleagues will want to see something else from my clusters or maybe change
some settings before running the pg_upgrade again. Therefore, I'll wait 12
hours after this message in case there will be any more requests and the
I'll run the pg_upgrade again.
Thank you all for trying to solve this matter, this is much appreciated! :)
2018-06-11 20:29 GMT+03:00 Andres Freund <[email protected]>:
> On 2018-06-11 13:14:12 -0400, Tom Lane wrote:
> > Andres Freund <[email protected]> writes:
> > > I suspect the issue is that pg_resetwal does:
> > > if (set_xid != 0)
> > > {
> > > ControlFile.checkPointCopy.nextXid = set_xid;
> >
> > > /*
> > > * For the moment, just set oldestXid to a value that will
> force
> > > * immediate autovacuum-for-wraparound. It's not clear
> whether adding
> > > * user control of this is useful, so let's just do
> something that's
> > > * reasonably safe. The magic constant here corresponds
> to the
> > > * maximum allowed value of autovacuum_freeze_max_age.
> > > */
> > > ControlFile.checkPointCopy.oldestXid = set_xid -
> 2000000000;
> > > if (ControlFile.checkPointCopy.oldestXid <
> FirstNormalTransactionId)
> > > ControlFile.checkPointCopy.oldestXid +=
> FirstNormalTransactionId;
> > > ControlFile.checkPointCopy.oldestXidDB = InvalidOid;
> > > }
> >
> > > but we have codepath that doesn't check for oldestXidDB being
> > > InvalidOid. Not great.
> >
> > Hm, I think I'd define the problem as "pg_resetwal is violating the
> > expectation that oldestXidDB be valid".
>
> Well, what could it do otherwise? ForceTransactionIdLimitUpdate()
> currently does a syscache check for database existence. That'll just
> return a lookup failure for InvalidOid, so we're reasonably good on that
> front.
>
> Using a hardcoded 2000000000 seems worse, will have funny results if
> running with a smaller autovacuum_freeze_max_age...
>
>
> > However, this just explains the basically-cosmetic issue that the
> > complaint message mentions OID 0. It doesn't really get us to the
> > answer to why Alexander is seeing a failure. It might be useful
> > to see pg_controldata output for the old cluster, as well as
> > "select datname, datfrozenxid from pg_database" output from the
> > old cluster.
>
> pg_upgrade starts the server with autovacuum disabled, I suspect
> restoring all the large objects ends up using a lot of transaction
> ids. GetNewTransactionId() should start autovacuum, but I'd guess that's
> where things are going wrong for some reason.
>
> Alexander, could you hack things up so autovacuum logging is enabled
> (log_autovacuum_min_duration=0), and see whether it's triggered?
>
> I'm not entirely clear why pg_restore appears to use a separate
> transaction for each large object, surely exascerbating the problem.
>
> Greetings,
>
> Andres Freund
>
pg_control version number: 960
Catalog version number: 201608131
Database system identifier: 6341258630649216079
Database cluster state: in production
pg_control last modified: Mon 11 Jun 2018 09:10:28 PM MSK
Latest checkpoint location: 811B/24CA0B40
Prior checkpoint location: 811B/24CA0AD0
Latest checkpoint's REDO location: 811B/24CA0B40
Latest checkpoint's REDO WAL file: 000000030000811B00000024
Latest checkpoint's TimeLineID: 3
Latest checkpoint's PrevTimeLineID: 3
Latest checkpoint's full_page_writes: on
Latest checkpoint's NextXID: 0:1982110603
Latest checkpoint's NextOID: 1763738656
Latest checkpoint's NextMultiXactId: 78
Latest checkpoint's NextMultiOffset: 136
Latest checkpoint's oldestXID: 1871522205
Latest checkpoint's oldestXID's DB: 12438
Latest checkpoint's oldestActiveXID: 0
Latest checkpoint's oldestMultiXid: 78
Latest checkpoint's oldestMulti's DB: 12439
Latest checkpoint's oldestCommitTsXid:0
Latest checkpoint's newestCommitTsXid:0
Time of latest checkpoint: Mon 11 Jun 2018 11:54:29 AM MSK
Fake LSN counter for unlogged rels: 0/1
Minimum recovery ending location: 0/0
Min recovery ending loc's timeline: 0
Backup start location: 0/0
Backup end location: 0/0
End-of-backup record required: no
wal_level setting: minimal
wal_log_hints setting: off
max_connections setting: 1500
max_worker_processes setting: 8
max_prepared_xacts setting: 0
max_locks_per_xact setting: 1024
track_commit_timestamp setting: off
Maximum data alignment: 8
Database block size: 8192
Blocks per segment of large relation: 131072
WAL block size: 8192
Bytes per WAL segment: 16777216
Maximum length of identifiers: 64
Maximum columns in an index: 32
Maximum size of a TOAST chunk: 1996
Size of a large-object chunk: 2048
Date/time type storage: 64-bit integers
Float4 argument passing: by value
Float8 argument passing: by value
Data page checksum version: 0
table_name | age
-----------------------------------------------------+-----
pg_authid | 771
pg_shseclabel | 767
pg_transform | 766
information_schema.sql_languages | 765
information_schema.sql_packages | 763
pg_description | 761
pg_cast | 759
pg_largeobject | 757
pg_largeobject_metadata | 755
pg_amop | 753
pg_amproc | 751
pg_language | 749
pg_aggregate | 747
pg_rewrite | 745
pg_trigger | 743
pg_event_trigger | 741
pg_enum | 740
pg_namespace | 739
pg_conversion | 737
pg_depend | 735
pg_database | 733
pg_auth_members | 729
pg_shdepend | 728
pg_shdescription | 726
pg_ts_config_map | 722
pg_ts_dict | 720
pg_ts_parser | 718
pg_ts_template | 716
pg_extension | 714
pg_foreign_data_wrapper | 712
pg_foreign_server | 710
pg_foreign_table | 708
pg_policy | 706
information_schema.sql_parts | 705
alfastrahexchangedocumentindexdata | 703
information_schema.sql_sizing | 701
information_schema.sql_sizing_profiles | 699
pg_user_mapping | 698
pg_index | 696
pg_operator | 694
pg_opfamily | 692
pg_opclass | 690
pg_am | 688
aclroleindexdata | 686
acluserdata | 684
pg_statistic | 682
cluster_qrtz_simple_triggers | 679
cluster_qrtz_job_details | 677
cluster_qrtz_simprop_triggers | 675
financedocumentrecordindexdata | 672
farerulesdocumentindexdata | 670
gdsbookabilityitemindexdata | 668
locks | 664
notificationmaildocumenttemplateindexdata | 663
notificationschemeindexdata | 661
amadeusexchangedocumentindexdata | 658
ssodexchangedocumentindexdata | 656
templatereportdescriptionindexdata | 655
userwebsettingsdata | 653
pg_constraint | 649
productvoidingindexdata | 647
debitslipindexdata | 645
teletrainexchangedocumentindexdata | 644
suxmlexchangedocumentindexdata | 643
commissionpropertiesindexdata | 642
vctcostsexchangedocumentindexdata | 640
aclregistryassetdata | 638
inmobexchangedocumentindexdata | 636
creditslipindexdata | 635
aeroexpressticketindexdata | 633
aclaspectindexdata | 630
aclgroupdata | 628
agencymemoproductitemgroupindexdata | 626
aclmodificatorindexdata | 625
basicdocumentindexdata | 623
agencymemoindexdata | 621
agentgroupindexdata | 620
acquainteddata | 618
aeroexpressreportdocumentindexdata | 615
athxmlorganizationexchangedocumentindexdata | 614
airlinecardcodesexchangedocumentindexdata | 613
agencymemoproductindexdata | 612
basicbugreportindexdata | 611
agenttemplatereportdocumentindexdata | 609
archivedproductindexdata | 608
baggagelimitsstatisticsdata | 606
basiccommonconnectionsettingsindexdata | 604
cluster_qrtz_calendars | 602
bookabilityreportdocumentindexdata | 601
bookingfileexchangedocumentindexdata | 600
basiccommonexportsettingsindexdata | 599
billingtransactionchangeindexdata | 597
cluster_qrtz_blob_triggers | 596
aviacentrconsolidatedreportdocumentindexdata | 595
brandedfareinformationindexdata | 593
cashindexdata | 592
billingtransactionindexdata | 591
basicexportsettingsindexdata | 589
blockcharterappendixindexdata | 587
mcoexchangedocumentindexdata | 585
branchexchangedocumentindexdata | 584
billing1cexchangedocumentindexdata | 583
chartofaccountselementindexdata | 580
cashregisterindexdata | 578
bulklongrunningtaskentrydata | 577
charterscitypairsexchangedocumentindexdata | 576
clientexchangedocumentindexdata | 574
cccexchangedocumentindexdata | 573
charterstraveldocumentexchangedocumentindexdata | 572
cluster_qrtz_cron_triggers | 570
cluster_qrtz_fired_triggers | 568
contractordescriptionindexdata | 566
cluster_qrtz_triggers | 564
combdata | 562
complexorderindexdata | 560
deliveryitemindexdata | 558
combincrementdata | 557
contractrelationdescriptionindexdata | 555
deletedobjectreferencedata | 553
dictionarydata | 551
credithistorydata | 549
deskentrydata | 547
bnch2exchangedocumentindexdata | 545
insuranceaccidentindexdata | 543
deliveryindexdata | 541
dbexchangedocumentindexdata | 540
dictupdateitemindexdata | 539
divergencereportdocumentindexdata | 537
discountpropertiesindexdata | 536
hotelproductreportdocumentindexdata | 534
excessbagageexchangedocumentindexdata | 533
exportdocumentindexdata | 532
financedocumentstemplatereportdocumentindexdata | 530
gdsaccountindexdata | 529
gdstracingdocumentindexdata | 527
gabrielmaskexchangedocumentindexdata | 525
openingbalancedata | 523
mainhotelproductguestindexdata | 521
hotexchangedocumentindexdata | 519
geoiprangedata | 518
hotelproductindexdata | 516
holdingexchangedocumentindexdata | 514
ibankexportdataindexdata | 513
insuranceaccidentreportdocumentindexdata | 511
insurancetripcancelindexdata | 510
issuetemplatesindexdata | 508
penaltypropertiesindexdata | 506
organizationexchangedocumentindexdata | 504
iurexchangedocumentindexdata | 503
gdsreferenceindexdata | 501
organizationbalanceindexdata | 499
personmetadataindexdata | 498
modifiedobjectreferencedata | 496
payment1cexchangedocumentindexdata | 494
mcofeesindexdata | 493
mytable | 492
mytmptable | 490
paytureregistryexchangedocumentindexdata | 488
notificationtemplategroupindexdata | 486
personexchangedocumentindexdata | 484
passnflycheckinproductindexdata | 482
pgpaymentindexdata | 481
retexchangedocumentindexdata | 479
refundeventindexdata | 478
userotpassetdata | 477
pg_db_role_setting | 772
productreportdocumentindexdata | 475
renaissanceinsuranceexchangedocumentindexdata | 474
s7excelexchangedocumentindexdata | 473
reportassetdata | 472
rootagentindexdata | 470
rulesmigrationexchangedocumentindexdata | 468
railwayreportdocumentindexdata | 466
retarchiveexchangedocumentindexdata | 465
rapidaexchangedocumentindexdata | 464
scheduledtasksettingsindexdata | 463
sirenamtdfaresettingsindexdata | 461
sabrecsvexchangedocumentindexdata | 458
searchcityfilterassetdata | 457
transactionsplitindexdata | 456
saleschaindescriptionindexdata | 454
salesreportdocumentindexdata | 452
sequencenumbersdata | 450
sirenaxmlexchangedocumentindexdata | 448
skyagentexchangedocumentindexdata | 446
soficlientsexchangedocumentindexdata | 445
travelpolicyauthorizationschemeindexdata | 444
terminalcreditreportdocumentindexdata | 442
spgdarchiveexchangedocumentindexdata | 441
subagentbalancereportdocumentindexdata | 440
tchdirectcontractindexdata | 439
subagentreportdocumentindexdata | 438
productsearchindexdata | 437
bulkdictionarydata | 411
sslentrylockassetdata | 435
stockblankreportdocumentindexdata | 434
tmp | 433
tchxmlcommissionsexchangedocumentindexdata | 431
tripartitereportdocumentindexdata | 429
trashbinitemindexdata | 428
triprequestindexdata | 426
shipmentautoprocessingexchangedocumentindexdata | 424
stockorderindexdata | 422
pg_inherits | 421
universalproductdescriptionindexdata | 420
utsitineraryexchangedocumentindexdata | 418
validatorindexdata | 417
vctpassengersexchangedocumentindexdata | 415
vip1cudidsexchangedocumentindexdata | 413
worklogindexdata | 412
cluster_qrtz_scheduler_state | 410
deletedassetreferencedata | 408
ufsexchangedocumentindexdata | 406
sabretokenindexdata | 405
accountingentryindexdata | 403
basemtdfaresettingsindexdata | 402
agentreportdocumentindexdata | 400
holdingindexdata | 399
personemploymentindexdata | 397
auraexchangedocumentindexdata | 395
rulesmigrationsettingsindexdata | 394
termindexdata | 390
paymentfeepropertiesindexdata | 388
paymentindexdata | 383
noticeindexdata | 392
organizationcontractindexdata | 386
hotelbookexchangedocumentindexdata | 384
tripartitecontractindexdata | 381
loginhistorydata | 379
pg_init_privs | 769
cluster_qrtz_paused_trigger_grps | 378
agencymemoitemindexdata | 377
organizationmetadataindexdata | 376
specialtariffindexdata | 374
templatereportdocumentindexdata | 372
branchindexdata | 370
avianovaitineraryreceiptexchangedocindexdata | 369
eticketquotaindexdata | 368
requestindexdata | 367
pg_replication_origin | 365
pg_collation | 364
pg_tablespace | 362
information_schema.sql_implementation_info | 360
pg_attrdef | 358
dbproperties | 356
crmaccountsexchangedocumentindexdata | 354
placeofsalesindexdata | 352
directcontractindexdata | 350
stockblankindexdata | 348
passengerpassportindexdata | 345
bookingfileindexdata | 343
liaisonexchangedocumentindexdata | 341
issueindexdata | 347
ssodarchiveexchangedocumentindexdata | 340
pg_default_acl | 339
tripindexdata | 337
railwayproductindexdata | 335
insurancetouristicindexdata | 333
commonproductfopindexdata | 331
universalproductindexdata | 329
entityeventnotificationindexdata | 327
pg_range | 325
pg_seclabel | 323
pg_attribute | 322
pg_proc | 320
productindexdata | 314
feepropertiesindexdata | 312
pg_type | 318
sftppersonsexchangedocumentindexdata | 310
personindexdata | 308
portraitpersonsexchangedocumentindexdata | 306
visaproductindexdata | 305
personbalanceindexdata | 303
invoiceexchangedocumentindexdata | 301
cwtgeneralproductindexdata | 299
seatblocksindexdata | 297
contractindexdata | 295
bronevikexchangedocumentindexdata | 293
mainhotelproductindexdata | 292
taisexchangedocumentindexdata | 290
contractcustomerindexdata | 289
pg_pltemplate | 731
pg_ts_config | 724
financeinitializationdataindexdata | 287
cardindexdata | 285
carrentalproductindexdata | 283
modelcontractindexdata | 281
basicsystemsettingsindexdata | 279
salespointindexdata | 277
basicpaymentdocumentindexdata | 275
transferproductindexdata | 273
cluster_qrtz_locks | 681
pccindexdata | 674
financedocumentindexdata | 666
statisticsdocumentindexdata | 659
information_schema.sql_features | 651
entitydata | 269
asynccommandinfodata | 267
versiondata | 266
vipstatisticspdoassetdata | 264
temporalobjectdata | 263
aclassetdata | 261
keypairentrydata | 259
fxworkspacedata | 257
aclentrydata | 255
exportreferencedata | 253
templatedocumentindexdata | 251
longrunningtaskinfodata | 249
syslogitemdata | 247
workspacedata | 245
activityitemdata | 243
shipmentautoprocessingexchangedocumentreferencedata | 241
phonecalldata | 240
keybindingsdata | 239
gdsstatentrydata | 235
storagesyncrecorddata | 234
asynctaskassignmentdata | 233
sslsessionentryassetdata | 231
transferindexdata | 230
iwayexchangedocumentindexdata | 229
shipmentindexdata | 228
questionrecorddata | 226
carlson1cinvoicerecordindexdata | 225
commonproductindexdata | 223
expressexchangedocumentindexdata | 646
athxmlpersonexchangedocumentindexdata | 631
aggregatedentityindexdata | 616
clientdebtreportdocumentindexdata | 594
cashregisterworkplaceindexdata | 581
spgdexchangedocumentindexdata | 459
pg_class | 316
organizationindexdata | 271
useraccountdata | 237
(333 rows)
datname | age
-----------+-----------
template1 | 216
template0 | 110588398
bof | 772
postgres | 110
(4 rows)
pg_control version number: 1002
Catalog version number: 201707211
Database system identifier: 6565566377704503227
Database cluster state: in production
pg_control last modified: Mon 11 Jun 2018 09:20:32 PM MSK
Latest checkpoint location: 8125/B7DEC5C0
Prior checkpoint location: 8125/8877C950
Latest checkpoint's REDO location: 8125/B738E100
Latest checkpoint's REDO WAL file: 0000000100008125000000B7
Latest checkpoint's TimeLineID: 1
Latest checkpoint's PrevTimeLineID: 1
Latest checkpoint's full_page_writes: on
Latest checkpoint's NextXID: 0:2128594259
Latest checkpoint's NextOID: 24781
Latest checkpoint's NextMultiXactId: 78
Latest checkpoint's NextMultiOffset: 136
Latest checkpoint's oldestXID: 1982109846
Latest checkpoint's oldestXID's DB: 16400
Latest checkpoint's oldestActiveXID: 2128594259
Latest checkpoint's oldestMultiXid: 78
Latest checkpoint's oldestMulti's DB: 16400
Latest checkpoint's oldestCommitTsXid:0
Latest checkpoint's newestCommitTsXid:0
Time of latest checkpoint: Mon 11 Jun 2018 09:20:28 PM MSK
Fake LSN counter for unlogged rels: 0/1
Minimum recovery ending location: 0/0
Min recovery ending loc's timeline: 0
Backup start location: 0/0
Backup end location: 0/0
End-of-backup record required: no
wal_level setting: replica
wal_log_hints setting: off
max_connections setting: 1500
max_worker_processes setting: 20
max_prepared_xacts setting: 0
max_locks_per_xact setting: 1024
track_commit_timestamp setting: off
Maximum data alignment: 8
Database block size: 8192
Blocks per segment of large relation: 131072
WAL block size: 8192
Bytes per WAL segment: 16777216
Maximum length of identifiers: 64
Maximum columns in an index: 32
Maximum size of a TOAST chunk: 1996
Size of a large-object chunk: 2048
Date/time type storage: 64-bit integers
Float4 argument passing: by value
Float8 argument passing: by value
Data page checksum version: 0
Mock authentication nonce:
2535ee631c6be3ddcf78f52d21a10ba1694e4d96a396f265f5a6013b2c5931ee
table_name | age
-----------------------------------------------------+-----------
pg_statistic | 146483656
pg_type | 146483656
amadeusexchangedocumentindexdata | 146484314
agenttemplatereportdocumentindexdata | 146484265
aggregatedentityindexdata | 146484272
airlinecardcodesexchangedocumentindexdata | 146484269
archivedproductindexdata | 146484264
alfastrahexchangedocumentindexdata | 146484359
asynctaskassignmentdata | 146483889
asynccommandinfodata | 146483923
athxmlorganizationexchangedocumentindexdata | 146484270
auraexchangedocumentindexdata | 146484051
athxmlpersonexchangedocumentindexdata | 146484287
aviacentrconsolidatedreportdocumentindexdata | 146484251
avianovaitineraryreceiptexchangedocindexdata | 146484025
pg_policy | 146483656
pg_authid | 146483656
pg_largeobject_metadata | 146484411
baggagelimitsstatisticsdata | 146484262
pg_amop | 146483656
pg_amproc | 146483656
pg_language | 146483656
pg_aggregate | 146483656
pg_user_mapping | 146483656
pg_subscription | 146483656
pg_attribute | 146483656
pg_proc | 146483656
pg_class | 146483656
pg_attrdef | 146483656
pg_constraint | 146483656
basiccommonexportsettingsindexdata | 146484255
basemtdfaresettingsindexdata | 146484058
basicbugreportindexdata | 146484267
basiccommonconnectionsettingsindexdata | 146484260
basicdocumentindexdata | 146484279
pg_inherits | 146483656
aeroexpressreportdocumentindexdata | 146484271
activityitemdata | 146483899
agencymemoindexdata | 146484277
aeroexpressticketindexdata | 146484289
agencymemoitemindexdata | 146484033
agencymemoproductindexdata | 146484268
agentgroupindexdata | 146484276
agencymemoproductitemgroupindexdata | 146484282
agentreportdocumentindexdata | 146484056
pg_index | 146483656
pg_operator | 146483656
pg_opfamily | 146483656
pg_opclass | 146483656
pg_am | 146483656
pg_statistic_ext | 146483656
pg_rewrite | 146483656
pg_trigger | 146483656
pg_event_trigger | 146483656
pg_description | 146483656
pg_cast | 146483656
pg_enum | 146483656
pg_namespace | 146483656
pg_conversion | 146483656
pg_depend | 146483656
pg_database | 146483656
pg_db_role_setting | 146483656
pg_tablespace | 146483656
pg_pltemplate | 146483656
pg_auth_members | 146483656
pg_shdepend | 146483656
pg_shdescription | 146483656
pg_ts_config | 146483656
pg_ts_config_map | 146483656
pg_ts_dict | 146483656
pg_ts_parser | 146483656
pg_ts_template | 146483656
pg_extension | 146483656
pg_foreign_data_wrapper | 146483656
pg_foreign_server | 146483656
pg_foreign_table | 146483656
pg_replication_origin | 146483656
pg_default_acl | 146483656
pg_init_privs | 146483656
pg_seclabel | 146483656
pg_shseclabel | 146483656
pg_collation | 146483656
pg_partitioned_table | 146483656
pg_range | 146483656
pg_transform | 146483656
pg_sequence | 146483656
pg_publication | 146483656
pg_publication_rel | 146483656
pg_subscription_rel | 146483656
information_schema.sql_parts | 146483656
information_schema.sql_languages | 146483656
information_schema.sql_features | 146483656
information_schema.sql_implementation_info | 146483656
information_schema.sql_packages | 146483656
information_schema.sql_sizing | 146483656
information_schema.sql_sizing_profiles | 146483656
pg_largeobject | 146484413
aclentrydata | 146483911
accountingentryindexdata | 146484059
aclaspectindexdata | 146484286
aclassetdata | 146483917
aclmodificatorindexdata | 146484281
aclgroupdata | 146484284
aclregistryassetdata | 146484294
acluserdata | 146484340
aclroleindexdata | 146484342
acquainteddata | 146484274
basicexportsettingsindexdata | 146484245
basicpaymentdocumentindexdata | 146483931
billingtransactionindexdata | 146484247
basicsystemsettingsindexdata | 146483935
billing1cexchangedocumentindexdata | 146484239
branchexchangedocumentindexdata | 146484240
bookabilityreportdocumentindexdata | 146484257
billingtransactionchangeindexdata | 146484253
blockcharterappendixindexdata | 146484243
bnch2exchangedocumentindexdata | 146484201
bookingfileindexdata | 146483999
bookingfileexchangedocumentindexdata | 146484256
branchindexdata | 146484026
brandedfareinformationindexdata | 146484249
bronevikexchangedocumentindexdata | 146483949
bulkdictionarydata | 146484067
bulklongrunningtaskentrydata | 146484233
cashindexdata | 146484248
cardindexdata | 146483941
carlson1cinvoicerecordindexdata | 146483881
chartofaccountselementindexdata | 146484236
cccexchangedocumentindexdata | 146484229
carrentalproductindexdata | 146483939
cashregisterindexdata | 146484234
cashregisterworkplaceindexdata | 146484237
charterstraveldocumentexchangedocumentindexdata | 146484228
charterscitypairsexchangedocumentindexdata | 146484232
clientdebtreportdocumentindexdata | 146484250
clientexchangedocumentindexdata | 146484230
cluster_qrtz_blob_triggers | 146484252
cluster_qrtz_paused_trigger_grps | 146484034
cluster_qrtz_triggers | 146484220
cluster_qrtz_calendars | 146484258
cluster_qrtz_scheduler_state | 146484066
cluster_qrtz_cron_triggers | 146484226
cluster_qrtz_fired_triggers | 146484224
cluster_qrtz_simple_triggers | 146484335
cluster_qrtz_job_details | 146484333
cluster_qrtz_locks | 146484337
combincrementdata | 146484213
cluster_qrtz_simprop_triggers | 146484331
combdata | 146484218
commonproductfopindexdata | 146483987
commissionpropertiesindexdata | 146484298
commonproductindexdata | 146483879
complexorderindexdata | 146484216
contractcustomerindexdata | 146483945
contractindexdata | 146483951
creditslipindexdata | 146484291
contractordescriptionindexdata | 146484222
contractrelationdescriptionindexdata | 146484211
credithistorydata | 146484205
crmaccountsexchangedocumentindexdata | 146484010
dbexchangedocumentindexdata | 146484196
cwtgeneralproductindexdata | 146483955
dbproperties | 146484012
deletedobjectreferencedata | 146484209
debitslipindexdata | 146484301
deletedassetreferencedata | 146484064
deliveryindexdata | 146484197
deliveryitemindexdata | 146484214
discountpropertiesindexdata | 146484192
deskentrydata | 146484203
dictionarydata | 146484207
dictupdateitemindexdata | 146484195
entityeventnotificationindexdata | 146483983
divergencereportdocumentindexdata | 146484193
directcontractindexdata | 146484006
entitydata | 146483925
exportdocumentindexdata | 146484188
excessbagageexchangedocumentindexdata | 146484189
eticketquotaindexdata | 146484024
exportreferencedata | 146483909
expressexchangedocumentindexdata | 146484302
farerulesdocumentindexdata | 146484326
gdsstatentrydata | 146483891
financeinitializationdataindexdata | 146483943
feepropertiesindexdata | 146483968
financedocumentindexdata | 146484322
financedocumentrecordindexdata | 146484328
gdsaccountindexdata | 146484185
fxworkspacedata | 146483913
financedocumentstemplatereportdocumentindexdata | 146484186
gabrielmaskexchangedocumentindexdata | 146484181
gdsreferenceindexdata | 146484157
gdsbookabilityitemindexdata | 146484324
gdstracingdocumentindexdata | 146484183
geoiprangedata | 146484174
holdingexchangedocumentindexdata | 146484170
holdingindexdata | 146484055
hotelbookexchangedocumentindexdata | 146484040
ibankexportdataindexdata | 146484169
hotelproductindexdata | 146484172
hotelproductreportdocumentindexdata | 146484190
hotexchangedocumentindexdata | 146484175
inmobexchangedocumentindexdata | 146484292
insuranceaccidentreportdocumentindexdata | 146484167
insuranceaccidentindexdata | 146484199
insurancetouristicindexdata | 146483989
issueindexdata | 146484003
insurancetripcancelindexdata | 146484166
invoiceexchangedocumentindexdata | 146483957
issuetemplatesindexdata | 146484164
iurexchangedocumentindexdata | 146484159
iwayexchangedocumentindexdata | 146483885
keybindingsdata | 146483895
loginhistorydata | 146484035
keypairentrydata | 146483915
liaisonexchangedocumentindexdata | 146483997
locks | 146484320
mainhotelproductindexdata | 146483948
longrunningtaskinfodata | 146483905
mainhotelproductguestindexdata | 146484177
mcoexchangedocumentindexdata | 146484241
modifiedobjectreferencedata | 146484152
mcofeesindexdata | 146484149
modelcontractindexdata | 146483937
mytable | 146484148
mytmptable | 146484146
noticeindexdata | 146484048
notificationmaildocumenttemplateindexdata | 146484319
organizationbalanceindexdata | 146484155
notificationschemeindexdata | 146484317
notificationtemplategroupindexdata | 146484142
passnflycheckinproductindexdata | 146484138
organizationindexdata | 146483927
openingbalancedata | 146484179
organizationcontractindexdata | 146484042
organizationexchangedocumentindexdata | 146484160
passengerpassportindexdata | 146484001
organizationmetadataindexdata | 146484032
payment1cexchangedocumentindexdata | 146484150
paymentfeepropertiesindexdata | 146484044
paymentindexdata | 146484039
placeofsalesindexdata | 146484008
personemploymentindexdata | 146484053
paytureregistryexchangedocumentindexdata | 146484144
pccindexdata | 146484330
penaltypropertiesindexdata | 146484162
personmetadataindexdata | 146484154
personexchangedocumentindexdata | 146484140
personbalanceindexdata | 146483959
personindexdata | 146483964
phonecalldata | 146483896
pgpaymentindexdata | 146484137
portraitpersonsexchangedocumentindexdata | 146483962
productindexdata | 146483970
productreportdocumentindexdata | 146484131
productsearchindexdata | 146484093
productvoidingindexdata | 146484303
rapidaexchangedocumentindexdata | 146484120
questionrecorddata | 146483882
railwayproductindexdata | 146483991
railwayreportdocumentindexdata | 146484122
refundeventindexdata | 146484134
reportassetdata | 146484128
renaissanceinsuranceexchangedocumentindexdata | 146484130
requestindexdata | 146484023
rootagentindexdata | 146484126
retarchiveexchangedocumentindexdata | 146484121
retexchangedocumentindexdata | 146484135
rulesmigrationexchangedocumentindexdata | 146484124
rulesmigrationsettingsindexdata | 146484050
s7excelexchangedocumentindexdata | 146484129
salespointindexdata | 146483933
sabrecsvexchangedocumentindexdata | 146484114
sabretokenindexdata | 146484061
sftppersonsexchangedocumentindexdata | 146483966
searchcityfilterassetdata | 146484113
saleschaindescriptionindexdata | 146484110
salesreportdocumentindexdata | 146484108
scheduledtasksettingsindexdata | 146484119
sequencenumbersdata | 146484106
seatblocksindexdata | 146483953
shipmentautoprocessingexchangedocumentindexdata | 146484080
shipmentautoprocessingexchangedocumentreferencedata | 146483897
shipmentindexdata | 146483884
ssodexchangedocumentindexdata | 146484312
specialtariffindexdata | 146484030
sirenamtdfaresettingsindexdata | 146484117
sirenaxmlexchangedocumentindexdata | 146484104
skyagentexchangedocumentindexdata | 146484102
sslentrylockassetdata | 146484091
spgdarchiveexchangedocumentindexdata | 146484097
soficlientsexchangedocumentindexdata | 146484101
spgdexchangedocumentindexdata | 146484115
ssodarchiveexchangedocumentindexdata | 146483996
sslsessionentryassetdata | 146483887
statisticsdocumentindexdata | 146484315
stockblankindexdata | 146484004
stockblankreportdocumentindexdata | 146484090
stockorderindexdata | 146484078
storagesyncrecorddata | 146483890
syslogitemdata | 146483903
subagentbalancereportdocumentindexdata | 146484096
subagentreportdocumentindexdata | 146484094
suxmlexchangedocumentindexdata | 146484299
taisexchangedocumentindexdata | 146483946
tchxmlcommissionsexchangedocumentindexdata | 146484087
tchdirectcontractindexdata | 146484095
teletrainexchangedocumentindexdata | 146484300
templatereportdocumentindexdata | 146484028
templatedocumentindexdata | 146483907
templatereportdescriptionindexdata | 146484311
temporalobjectdata | 146483919
terminalcreditreportdocumentindexdata | 146484098
transferproductindexdata | 146483929
termindexdata | 146484046
tmp | 146484089
transactionsplitindexdata | 146484112
tripartitecontractindexdata | 146484037
trashbinitemindexdata | 146484084
transferindexdata | 146483886
travelpolicyauthorizationschemeindexdata | 146484100
triprequestindexdata | 146484082
tripindexdata | 146483993
tripartitereportdocumentindexdata | 146484085
ufsexchangedocumentindexdata | 146484062
universalproductdescriptionindexdata | 146484076
universalproductindexdata | 146483985
visaproductindexdata | 146483961
validatorindexdata | 146484073
useraccountdata | 146483893
userotpassetdata | 146484133
userwebsettingsdata | 146484309
versiondata | 146483922
vctcostsexchangedocumentindexdata | 146484296
utsitineraryexchangedocumentindexdata | 146484074
vctpassengersexchangedocumentindexdata | 146484071
vipstatisticspdoassetdata | 146483920
vip1cudidsexchangedocumentindexdata | 146484069
worklogindexdata | 146484068
workspacedata | 146483901
(340 rows)
datname | age
-----------+-----------
template0 | 146483656
bof | 146484413
postgres | 146483656
template1 | 146483656
(4 rows)