Hi Eric, sorry for the slow reply. Size of /var/lib/pulp is 176GB - is that what you're after re mongoDB size?
As far as /var/log/messages goes - its "Applying pulp_rpm.plugins.migrations version 28" that takes so long Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 23 complete. Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 24 Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 24 complete. Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 25 Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 25 complete. Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 26 Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) /usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0026_remove_distribution_field.py:23: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead. Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) multi=True Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 26 complete. Jul 2 09:14:07 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 27 Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) /usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0027_remove_checksum_type_field.py:21: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead. Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) multi=True) Jul 2 09:14:07 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) Jul 2 09:14:08 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 27 complete. Jul 2 09:14:08 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 28 Jul 2 15:46:39 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 28 complete. Jul 2 15:46:39 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 29 Jul 2 15:46:39 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) /usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0029_remove_rpm_unused_fields.py:23: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead. Jul 2 15:46:39 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) multi=True Jul 2 15:46:39 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) /usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0029_remove_rpm_unused_fields.py:28: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead. Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) multi=True Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) Jul 2 15:46:40 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 29 complete. Jul 2 15:46:40 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 30 Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) /usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0030_remove_errata_unused_fields.py:23: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead. Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) multi=True Jul 2 15:46:40 wellkatello.niwa.local pulp: py.warnings:WARNING: (25904-01664) Jul 2 15:46:42 wellkatello.niwa.local pulp: pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations version 30 complete. Happy to supply the whole log if its helpful! Dylan On Saturday, July 2, 2016 at 12:50:07 AM UTC+12, Eric Helms wrote: > > Also, if you were to look at /var/log/messages for the parts during the > upgrade, are you able to pickout which particular Pulp migration step > seemed to take the longest? > > On Fri, Jul 1, 2016 at 7:26 AM, Eric D Helms <ericd...@gmail.com > <javascript:>> wrote: > >> Jason and Dylan, >> >> Could you also quote the size of your MongoDBs? I'd like to report all of >> this data to the Pulp team. >> >> Thanks, >> Eric >> >> On Fri, Jul 1, 2016 at 12:10 AM, Dylan Baars <baa...@gmail.com >> <javascript:>> wrote: >> >>> haha - it must have heard me, it just finished and carried on to the >>> next steps, go figure! So 176GB of pulp data takes roughly 6 hours ;-) >>> (suppose it'll be different based on hardware etc!) >>> >>> Dylan >>> >>> On Friday, July 1, 2016 at 4:03:29 PM UTC+12, Dylan Baars wrote: >>>> >>>> Hi Jason, >>>> >>>> how long did it take in the end? I am upgrading our production katello >>>> instance from 2.4.4 to 3.0, and the pulp_migrate step has taken 6 hours so >>>> far - I see no errors in the logs and pulp-manage-db seems to be running, >>>> taking CPU and memory time up. Our production system has a much larger >>>> pulp >>>> repository than the test instance I've done this on, but is there any >>>> advice on how long this step should take? (more a question for the Katello >>>> devs I guess!) It is 4pm here now, but the last logs in /var/log/messages >>>> from pulp are below (from 10:15am) >>>> >>>> Jul 1 10:15:49 wellkatello.niwa.local pulp: py.warnings:WARNING: >>>> (21830-39488) multi=True) >>>> Jul 1 10:15:49 wellkatello.niwa.local pulp: py.warnings:WARNING: >>>> (21830-39488) >>>> Jul 1 10:15:49 wellkatello.niwa.local pulp: >>>> pulp.server.db.manage:INFO: Migration to pulp_rpm.plugins.migrations >>>> version 27 complete. >>>> Jul 1 10:15:49 wellkatello.niwa.local pulp: >>>> pulp.server.db.manage:INFO: Applying pulp_rpm.plugins.migrations version 28 >>>> >>>> /var/lib/pulp is 176G vs the 42GB on the test instance >>>> >>>> Thanks, >>>> Dylan >>>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Foreman users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to foreman-user...@googlegroups.com <javascript:>. >>> To post to this group, send email to forema...@googlegroups.com >>> <javascript:>. >>> Visit this group at https://groups.google.com/group/foreman-users. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> >> >> -- >> Eric D. Helms >> Red Hat Engineering >> Ph.D. Student - North Carolina State University >> > > > > -- > Eric D. Helms > Red Hat Engineering > Ph.D. Student - North Carolina State University > -- You received this message because you are subscribed to the Google Groups "Foreman users" group. To unsubscribe from this group and stop receiving emails from it, send an email to foreman-users+unsubscr...@googlegroups.com. To post to this group, send email to foreman-users@googlegroups.com. Visit this group at https://groups.google.com/group/foreman-users. For more options, visit https://groups.google.com/d/optout.
