[GSoC] migration

2017-06-08 Thread Rainer Müller
Hello Umesh, good to hear from you! I was afraid we had already lost you... Where you will push your work to? Either create a new branch (e.g. gsoc17-migration) in macports/macports-base, or push to your own github account. It would be good to know which place to watch for updates. I will answer

Re: [GSoC] migration

2017-06-08 Thread Umesh Singla
Hi Rainer, I have already created a new branch gsoc17-migrate in macports-base after discussing with Jackson on IRC and just now, pushed some initial code to https://github.com/macports/macports-base/tree/gsoc17-migrate, to begin with. For the copyright part, I'll just ignore it, for now, it doesn

Re: [GSoC] migration

2017-06-09 Thread Bradley Giesbrecht
> On Jun 8, 2017, at 4:48 PM, Rainer Müller wrote: > > While I could not answer all your questions right now (I have to leave > some work for Bradley ;-)) All help is welcome, the more the merrier :) Regards, Bradley Giesbrecht (pixilla)

Re: [GSoC] migration

2017-06-11 Thread Bradley Giesbrecht
Hi Umesh, Thanks to Rainer for his comments on 2 and 5. My comments and questions inline. On Jun 8, 2017, at 3:12 PM, Umesh Singla wrote: > > 1. The agenda as per the proposal timeline [1] for the period from May 30 to > Jun 10 is to finalize the different cases to be included in the scope o

Re: [GSoC] migration

2017-06-12 Thread Rainer Müller
On 2017-06-11 19:07, Bradley Giesbrecht wrote: >> 4. Another thing that ran my mind while pondering that there are 2 options >> for sqlite database as well: make the tables in the very beginning (while >> initial installation) or while running the snapshot for the first time. I >> suggest to go

Re: [GSoC] migration

2017-06-13 Thread Umesh Singla
Hi > I have not followed Rainer's strategy for having `port snapshot --create` > and `port snapshot --restore` as discussed in the previous thread, instead > have 3 separate actions... > > If I am following this correctly I think isolating the functionality into > actions makes sense. If we want t

Re: [GSoC] migration

2017-06-13 Thread Umesh Singla
Hi Please see inline. > While the first one seems to be more realistic from user's perspective > > but running it every time is also not a good idea since OS/hardware > > changes are not frequent. I suggest running the detection for changes in > > architecture before a set of some commands like i

Re: [GSoC] migration

2017-06-13 Thread Umesh Singla
Hi For testing it should be enough to just modify the registry.db locally > as you need it. Once you reach a stable schema, you will have to add > modifications to the registry schema at two places. > > 1) The initial database schema for new installations is defined here: > > https://github.com/ma

Re: [GSoC] migration

2017-06-14 Thread Rainer Müller
On 2017-06-14 05:47, Umesh Singla wrote: > > 4. Another thing that ran my mind while pondering that there are 2 > options for sqlite database as well: make the tables in the very > beginning (while initial installation) or while running the snapshot > for the first time. I suggest t

Re: [GSoC] migration

2017-06-14 Thread Rainer Müller
On 2017-06-14 05:48, Umesh Singla wrote: > Thanks Rainer for this. This is really useful. I had doubts on how often > cregistry/sql.c file gets updated or whether this is the one. The name > sql.c seems to be so OS core file. So, I can just add the new tables here? > > Also, new tables means addi

Re: [GSoC] migration

2017-06-14 Thread Bradley Giesbrecht
> On Jun 14, 2017, at 3:31 AM, Rainer Müller wrote: > > On 2017-06-14 05:48, Umesh Singla wrote: >> Thanks Rainer for this. This is really useful. I had doubts on how often >> cregistry/sql.c file gets updated or whether this is the one. The name >> sql.c seems to be so OS core file. So, I can ju

Re: [GSoC] migration

2017-06-14 Thread Bradley Giesbrecht
> On Jun 13, 2017, at 8:47 PM, Umesh Singla wrote: > > I suggest IRC #macports on Wednesdays at 2:00 PM UTC. If this time does not > work for anyone who would like to be included suggest an alternative or > additional day and time. > > So, today! I hung out by myself on IRC from 2:30-4:30 PM

Re: [GSoC] migration

2017-06-14 Thread Mojca Miklavec
On 14 June 2017 at 05:47, Umesh Singla wrote: > > Okay, since there's already a OS comparison made, which I think can be > directly used here. But to clarify, just the OS check? a check on x86_64/ppc > changes is also needed. And potentially cxx_stdlib? Mojca

Re: [GSoC] migration

2017-06-19 Thread Umesh Singla
Hi Bradley, I'm having a bit difficulty in implementing the body of snapshot procedure. Basically what I need to do now is (as I have written in my notes, so you can tell me if I'm on right track in my thoughts as well): "get the list of installed ports, their-installed-variants and if-requested,

Re: [GSoC] migration

2017-06-19 Thread Joshua Root
On 2017-6-20 03:58 , Umesh Singla wrote: Hi Bradley, I'm having a bit difficulty in implementing the body of snapshot procedure. Basically what I need to do now is (as I have written in my notes, so you can tell me if I'm on right track in my thoughts as well): "get the list of installed por

Re: [GSoC] migration

2017-06-21 Thread Umesh Singla
Hi Josh, Taking a step back for a moment, why is an SQL database the best way to > store this data? What sorts of queries are you going to want to run on it? > Would a text (Tcl array) representation similar to the PortIndex be a > better fit? > We need to store all the information about the exi

Re: [GSoC] migration

2017-06-21 Thread Joshua Root
On 2017-6-22 02:09 , Umesh Singla wrote: Hi Josh, Taking a step back for a moment, why is an SQL database the best way to store this data? What sorts of queries are you going to want to run on it? Would a text (Tcl array) representation similar to the PortIndex be a better fit?

Re: [GSoC] migration

2017-06-21 Thread Umesh Singla
Hi Taking a step back for a moment, why is an SQL database the best way >> to store this data? What sorts of queries are you going to want to >> run on it? Would a text (Tcl array) representation similar to the >> PortIndex be a better fit? >> >> >> We need to store all the informa

Re: [GSoC] migration

2017-06-22 Thread Bradley Giesbrecht
> On Jun 21, 2017, at 7:25 PM, Umesh Singla wrote: > > Hi > > Taking a step back for a moment, why is an SQL database the best way > to store this data? What sorts of queries are you going to want to > run on it? Would a text (Tcl array) representation similar to the > PortIndex

Re: [GSoC] migration

2017-06-22 Thread Joshua Root
On 2017-6-23 11:29 , Bradley Giesbrecht wrote: On Jun 21, 2017, at 7:25 PM, Umesh Singla wrote: Hi Taking a step back for a moment, why is an SQL database the best way to store this data? What sorts of queries are you going to want to run on it? Would a text (Tcl array) represen

Re: [GSoC] migration

2017-06-24 Thread Bradley Giesbrecht
> On Jun 22, 2017, at 8:15 PM, Joshua Root wrote: > > On 2017-6-23 11:29 , Bradley Giesbrecht wrote: >>> On Jun 21, 2017, at 7:25 PM, Umesh Singla wrote: >>> >>> Hi >>> >>> Taking a step back for a moment, why is an SQL database the best way >>> to store this data? What sorts of querie

Re: [GSoC] migration

2017-06-24 Thread Umesh Singla
Hi Bradley, On Sun, Jun 25, 2017 at 1:59 AM, Bradley Giesbrecht wrote: > > >> For the migration functionality wouldn’t we only install “requested” > ports? Dependencies could be different with a platform change. > >> Also, if the installed variants for a given port are the default > variants woul

Fwd: [GSoC] migration

2017-06-24 Thread Umesh Singla
:39 AM Subject: Re: [GSoC] migration To: Bradley Giesbrecht Hi Brad I assumed we would allow multiple snapshots and be able to chose from a > list of snapshots by date-sequence. > Yes, and I think, adopting the files strategy is basically doing the work of sqlite manually. > For the

Re: [GSoC] migration

2017-06-24 Thread Joshua Root
On 2017-6-25 06:29 , Bradley Giesbrecht wrote: On Jun 22, 2017, at 8:15 PM, Joshua Root wrote: On 2017-6-23 11:29 , Bradley Giesbrecht wrote: For the migration functionality wouldn’t we only install “requested” ports? Dependencies could be different with a platform change. Also, if the instal

Re: [GSoC] migration

2017-07-06 Thread Bradley Giesbrecht
Lets stick to automating the current migration as close as possible. Are you using your blog to document your progress and challenges? Email is not a great way to follow progress. Can you provide a daily summary of progress on open issue somewhere (blog) and email a link to the MP Dev list? Re

Re: [GSoC] migration

2017-07-10 Thread Umesh Singla
Hi Jackson, I usually email macports-dev when I ran into issues and with updates because the mailing list is really active. Also, this way I get inputs from many people like Rainer, Mojca or Josh who otherwise might be reluctant to open a link, read a post/diary and then comment. I tried that dia

Re: [GSoC] migration

2017-07-11 Thread Umesh Singla
Hi Brad, While I was writing for restoring of ports, it seems that I need to include another field 'active' along with ports while taking snapshot. This might sound obvious now but it wasn't to me before I looked at what is going on, closely. While there is something like 'active' port but there's

Re: [GSoC] migration

2017-07-11 Thread Joshua Root
On 2017-7-12 04:43 , Umesh Singla wrote: Hi Brad, While I was writing for restoring of ports, it seems that I need to include another field 'active' along with ports while taking snapshot. This might sound obvious now but it wasn't to me before I looked at what is going on, closely. While the

Re: [GSoC] migration

2017-07-12 Thread Bradley Giesbrecht
Josh, thank you for responding. Regards, Bradley Giesbrecht (pixilla) > On Jul 11, 2017, at 11:58 AM, Joshua Root wrote: > > On 2017-7-12 04:43 , Umesh Singla wrote: >> Hi Brad, >> While I was writing for restoring of ports, it seems that I need to include >> another field 'active' along with

Re: [GSoC] migration

2017-07-12 Thread Umesh Singla
Hi Brad, With another week over, I have the following updates to share. These are actually the points from my Notes as I keep going on, so the email might not be well crafted. Thought, would share with you without any delay. *Week #5-6 (28 Jun - 12 Jul)* Golden lines for the project: 1. A *s

Re: [GSoC] migration

2017-07-12 Thread Bradley Giesbrecht
> On Jul 12, 2017, at 3:10 PM, Umesh Singla wrote: > > Hi Brad, > > With another week over, I have the following updates to share. These are > actually the points from my Notes as I keep going on, so the email might not > be well crafted. Thought, would share with you without any delay. > > W

Re: [GSoC] migration

2017-07-12 Thread Umesh Singla
Hi > • A snapshot would be a list of install commands that created the > current installed state. > > • Restoring a snapshot would deactivate the active ports and > reproduce the install commands for the selected snapshot. > > • Migrate would amount to creating a new snapshot, un

Re: [GSoC] migration

2017-07-12 Thread Joshua Root
On 2017-7-13 08:10 , Umesh Singla wrote: 3. ensuring that active versions are installed after the inactive versions since the output after running `port install vim -huge +tiny`: —— Computing dependencies for vim .. --->Staging vim into destroot *--->Installing vim @8.0.0596_0+tiny* *-

Re: [GSoC] migration

2017-07-13 Thread Arno Hautala
On Wed, Jul 12, 2017 at 8:07 PM, Joshua Root wrote: > On 2017-7-13 08:10 , Umesh Singla wrote: >> >> 3. ensuring that active versions are installed after the inactive >> versions > > The install action of port(1) does execute the activate target, however your > code could run only the install

Re: [GSoC] migration

2017-07-13 Thread Joshua Root
On 2017-7-13 22:49 , Arno Hautala wrote: On Wed, Jul 12, 2017 at 8:07 PM, Joshua Root wrote: On 2017-7-13 08:10 , Umesh Singla wrote: 3. ensuring that active versions are installed after the inactive versions The install action of port(1) does execute the activate target, however you

Re: [GSoC] migration

2017-07-13 Thread Arno Hautala
On Thu, Jul 13, 2017 at 11:34 AM, Joshua Root wrote: > > Depending on a variant is currently impossible. > > ... > > You do have to install the ports in dependency order to get it right, and > that is what restore_ports does. There may be cases where previously > inactive ports don't build due to

Re: [GSoC] migration

2017-07-13 Thread Joshua Root
On 2017-7-14 01:42 , Arno Hautala wrote: On Thu, Jul 13, 2017 at 11:34 AM, Joshua Root wrote: Depending on a variant is currently impossible. ... You do have to install the ports in dependency order to get it right, and that is what restore_ports does. There may be cases where previously ina

Re: [GSoC] migration

2017-07-19 Thread Umesh Singla
Hi Brad, With another week over, I have the following updates to share. *GSoC Week #7 (13 Jul - 19 Jul)* I moved the things to migrate action instead of 'restore' since 'restore' looks a subset of 'migrate', so can be dealt easily once migrate is over. Agenda for last week: The migrate actio

Re: [GSoC] migration

2017-07-19 Thread Bradley Giesbrecht
> On Jul 19, 2017, at 3:43 PM, Umesh Singla wrote: > > Hi Brad, > > With another week over, I have the following updates to share. > > > GSoC Week #7 (13 Jul - 19 Jul) > > I moved the things to migrate action instead of 'restore' since 'restore' > looks a subset of 'migrate', so can be deal

Re: [GSoC] migration

2017-07-20 Thread db
On 20 Jul 2017, at 06:04, Bradley Giesbrecht wrote: > Snapshot and restore should be able to be executed without migrate. I have a question and I haven't been following in detail this GSoC, so bear with me. Could snapshot and restore be used to rollback to a previous state in case a sync and u

Re: [GSoC] migration

2017-07-20 Thread Umesh Singla
Hi Brad, Clemens, Josh Please see inline. > GSoC Week #7 (13 Jul - 19 Jul) > > > > I moved the things to migrate action instead of 'restore' since > 'restore' looks a subset of 'migrate', so can be dealt easily once migrate > is over. > > I’m not sure I understand and if I do understand I think I

Re: [GSoC] migration

2017-07-21 Thread db
On 21 Jul 2017, at 13:02, Umesh Singla wrote: > Unless we have a snapshot of the previous state, that is, before it got > hampered. > But then again, we reinstall all the ports presently. At this time, it could > be hard for me to detect what went wrong while sync or upgrade. If I understood yo

Fwd: [GSoC] migration

2017-07-21 Thread Umesh Singla
Forwarding this to macports-dev. -- Forwarded message -- From: Umesh Singla Date: Fri, Jul 21, 2017 at 4:32 PM Subject: Re: [GSoC] migration To: db Hi > > Snapshot and restore should be able to be executed without migrate. > > I have a question and I haven'

Re: [GSoC] migration

2017-07-21 Thread Umesh Singla
Hi On Fri, Jul 21, 2017 at 5:39 PM, db wrote: > On 21 Jul 2017, at 13:02, Umesh Singla wrote: > > Unless we have a snapshot of the previous state, that is, before it got > hampered. > > But then again, we reinstall all the ports presently. At this time, it > could be hard for me to detect what

Re: [GSoC] migration

2017-07-21 Thread Joshua Root
On 2017-7-22 11:01 , Umesh Singla wrote: Another thing that comes to my mind now is if, suppose, updated version of ncurses was actually required for some another port and reverting it to the older state could possibly result in breaking of that port. May be, we could get all the ports which de

Re: [GSoC] migration

2017-07-21 Thread Joshua Root
On 2017-7-21 08:22 , Umesh Singla wrote: > When we install, is it fine to use [mportexec $workername $install_target] from migrate.tcl? I’m sorry, I don’t know base well enough to answer this. Can you please ask Clemens or Josh? @Clemens @Josh, can you clarify this? If that's ru

Re: [GSoC] migration

2017-07-22 Thread db
On 22 Jul 2017, at 03:01, Umesh Singla wrote: > I don't know, in the above example, what do you mean when you say "..you > realize that from its deps..", like, realize how? I am just asking this if > there's some other way to get info on the latest modifications that I might > not be aware of.

Re: [GSoC] migration

2017-07-26 Thread Umesh Singla
Hi Josh Another thing that comes to my mind now is if, suppose, updated version of >> ncurses was actually required for some another port and reverting it to the >> older state could possibly result in breaking of that port. May be, we >> could get all the ports which depend on it and check if thi

Re: [GSoC] migration

2017-07-26 Thread Umesh Singla
On Sat, Jul 22, 2017 at 7:26 AM, Joshua Root wrote: > On 2017-7-21 08:22 , Umesh Singla wrote: > >> > When we install, is it fine to use [mportexec $workername >> $install_target] from migrate.tcl? >> >> I’m sorry, I don’t know base well enough to answer this. Can you >> please ask Cl

Re: [GSoC] migration

2017-07-26 Thread Umesh Singla
Hi On Sun, Jul 23, 2017 at 5:03 AM, db wrote: > On 22 Jul 2017, at 03:01, Umesh Singla wrote: > > I don't know, in the above example, what do you mean when you say "..you > realize that from its deps..", like, realize how? I am just asking this if > there's some other way to get info on the lat

Re: [GSoC] migration

2017-07-26 Thread Joshua Root
On 2017-7-27 08:35 , Umesh Singla wrote: Also note that we can't actually revert to an older version of a port if it has been uninstalled. I don't understand this. Does this mean that macports only allows me to install the most recent version of a port? You said "if it has been uninst

Re: [GSoC] migration

2017-07-26 Thread Joshua Root
On 2017-7-27 08:40 , Umesh Singla wrote: On Sat, Jul 22, 2017 at 7:26 AM, Joshua Root > wrote: On 2017-7-21 08:22 , Umesh Singla wrote: For now, I'd like to ask in what order does "registry::entry imaged" returns the port list? Because I'm running t

Re: [GSoC] migration

2017-07-26 Thread Joshua Root
On 2017-7-27 14:57 , Joshua Root wrote: The order to follow when uninstalling is the reverse of the order used when installing, i.e. dependents-first rather than dependencies-first. Order does matter because we check whether a port has dependents when uninstalling and raise an error if so. You

Re: [GSoC] migration

2017-07-27 Thread db
On 27 Jul 2017, at 00:35, Umesh Singla wrote: > Hi Josh >> We don't have version dependencies so no, this sort of check is not possible >> a priori. Breakage will be caught by rev-upgrade after the fact in many >> cases (and if it is set to rebuild automatically, it may well revert you >> back

Re: [GSoC] migration

2017-07-27 Thread Bradley Giesbrecht
> On Jul 27, 2017, at 11:39 AM, db wrote: > > On 27 Jul 2017, at 00:35, Umesh Singla wrote: >> Hi Josh >>> We don't have version dependencies so no, this sort of check is not >>> possible a priori. Breakage will be caught by rev-upgrade after the fact in >>> many cases (and if it is set to reb

Re: [GSoC] migration

2017-07-27 Thread db
On 27 Jul 2017, at 21:21, Bradley Giesbrecht wrote: > Migration will uninstall all installed ports and then install all the ports > from the snapshot Yes, but I'm talking about using snapshot and restore at different times with ports being updated between them, likely resulting in different out

Re: [GSoC] migration

2017-07-31 Thread Bradley Giesbrecht
> On Jul 27, 2017, at 2:10 PM, db wrote: > > On 27 Jul 2017, at 21:21, Bradley Giesbrecht wrote: >> Migration will uninstall all installed ports and then install all the ports >> from the snapshot > > Yes, but I'm talking about using snapshot and restore at different times with > ports being

Re: [GSoC] migration

2017-08-06 Thread Umesh Singla
Hi Brad A quick update. Points - 1. Is it okay to fetch dependents using mportlookup while installing? 2. For migrate action, we agreed upon installing all and only the (active requested + inactive requested) ports, in short, all the requested in the sorted order, right? Dependencies

Re: [GSoC] migration

2017-08-06 Thread Umesh Singla
On Sat, Jul 22, 2017 at 7:26 AM, Joshua Root wrote: > > For now, I'd like to ask in what order does "registry::entry imaged" >> returns the port list? Because I'm running the sorting function which the >> restore_ports.tcl uses but it's giving me the ports in the same order as >> result. >> > > P

Re: [GSoC] migration

2017-08-06 Thread Jackson Isaac
Hi, On Sun, Aug 6, 2017 at 5:41 PM, Umesh Singla wrote: > On Sat, Jul 22, 2017 at 7:26 AM, Joshua Root wrote: >> >> >>> For now, I'd like to ask in what order does "registry::entry imaged" >>> returns the port list? Because I'm running the sorting function which the >>> restore_ports.tcl uses bu

Re: [GSoC] migration

2017-08-06 Thread Joshua Root
On 2017-8-6 22:11 , Umesh Singla wrote: On Sat, Jul 22, 2017 at 7:26 AM, Joshua Root > wrote: For now, I'd like to ask in what order does "registry::entry imaged" returns the port list? Because I'm running the sorting function which the restore_

Re: [GSoC] migration

2017-08-07 Thread Umesh Singla
Hi On Sun, Aug 6, 2017 at 6:56 PM, Joshua Root wrote: > On 2017-8-6 22:11 , Umesh Singla wrote: > >> On Sat, Jul 22, 2017 at 7:26 AM, Joshua Root > j...@macports.org>> wrote: >> >> >> For now, I'd like to ask in what order does "registry::entry >> imaged" returns the port list? B

Re: [GSoC] migration

2017-08-07 Thread Umesh Singla
Hi On Sun, Aug 6, 2017 at 6:43 PM, Jackson Isaac wrote: > Hi, > > On Sun, Aug 6, 2017 at 5:41 PM, Umesh Singla > wrote: > > On Sat, Jul 22, 2017 at 7:26 AM, Joshua Root wrote: > >> > >> > >>> For now, I'd like to ask in what order does "registry::entry imaged" > >>> returns the port list? Beca

Re: [GSoC] migration

2017-08-10 Thread Umesh Singla
> >> I was trying to streamline the whole process and I felt the need to > have the snapshot as a separate entity just like a reg_entry or a > reg_portgroup is, that is, "registry::snapshot" with a bunch of functions > like create, get, list_all etc. I think this might help in writing the > whole t

Re: [GSoC] migration

2017-08-10 Thread Umesh Singla
On Thu, Aug 10, 2017 at 2:54 AM, Joshua Root wrote: > On 2017-8-10 04:59 , Umesh Singla wrote: > >> Hi >> >> I was trying to streamline the whole process and I felt the need to have >> the snapshot as a separate entity just like a reg_entry or a reg_portgroup >> is, that is, "registry::snapshot"

Re: [GSoC] migration

2017-08-10 Thread Bradley Giesbrecht
> On Aug 10, 2017, at 9:31 AM, Umesh Singla wrote: > > > > On Thu, Aug 10, 2017 at 2:54 AM, Joshua Root wrote: > On 2017-8-10 04:59 , Umesh Singla wrote: > Hi > > I was trying to streamline the whole process and I felt the need to have the > snapshot as a separate entity just like a reg_entr

Re: [GSoC] migration

2017-08-10 Thread Joshua Root
On 2017-8-11 02:31 , Umesh Singla wrote: On Thu, Aug 10, 2017 at 2:54 AM, Joshua Root > wrote: On 2017-8-10 04:59 , Umesh Singla wrote: Hi I was trying to streamline the whole process and I felt the need to have the snapshot as a separat

Re: [GSoC] migration

2017-08-10 Thread Joshua Root
On 2017-8-11 03:41 , Bradley Giesbrecht wrote: I think Josh is referring to 3NF normalization (third normal form). I don’t think this use case warrants this complexity. I think it is fine for two snapshot id’s to reference the same port+variant combination. When a snapshot id is deleted, casca

Re: [GSoC] migration

2017-08-11 Thread Umesh Singla
> As usual, Josh makes good points. > > A text-based database is less convenient to query. I really don’t see why > storing the information in a database should be challenging. But I’m not > writing the TCL or C. > > I would feel more comfortable running sql queries to verify the snapshots > are be

Re: [GSoC] migration

2017-08-11 Thread Umesh Singla
Hi > And then again, I am sensing a confusion with the idea of snapshot with >> Josh, like when he says "remove ports when they are no longer referenced by >> any snapshot". >> > > What confusion exactly? A snapshot is simply a set of ports (by which I > mean rows in the 'ports' table, with a uni

Re: [GSoC] migration

2017-08-11 Thread Umesh Singla
Hi On Fri, Aug 11, 2017 at 4:19 AM, Joshua Root wrote: > On 2017-8-11 03:41 , Bradley Giesbrecht wrote: > >> I think Josh is referring to 3NF normalization (third normal form). I >> don’t think this use case warrants this complexity. I think it is fine for >> two snapshot id’s to reference the s

Re: [GSoC] migration

2017-08-11 Thread Joshua Root
On 2017-8-11 21:14 , Umesh Singla wrote: Hi And then again, I am sensing a confusion with the idea of snapshot with Josh, like when he says "remove ports when they are no longer referenced by any snapshot". What confusion exactly? A snapshot is simply a set of ports

Re: [GSoC] migration

2017-08-11 Thread Umesh Singla
Hi Josh, And then again, I am sensing a confusion with the idea of >> snapshot with Josh, like when he says "remove ports when they >> are no longer referenced by any snapshot". >> >> >> What confusion exactly? A snapshot is simply a set of ports (by >> which I mean

Re: [GSoC] migration

2017-08-11 Thread Bradley Giesbrecht
> On Aug 10, 2017, at 3:49 PM, Joshua Root wrote: > > On 2017-8-11 03:41 , Bradley Giesbrecht wrote: >> I think Josh is referring to 3NF normalization (third normal form). I don’t >> think this use case warrants this complexity. I think it is fine for two >> snapshot id’s to reference the same

Re: [GSoC] migration

2017-08-12 Thread Bradley Giesbrecht
> On Aug 11, 2017, at 11:16 AM, Joshua Root wrote: > > On 2017-8-11 21:14 , Umesh Singla wrote: >> Hi >>And then again, I am sensing a confusion with the idea of >>snapshot with Josh, like when he says "remove ports when they >>are no longer referenced by any snapshot". >>

Re: [GSoC] migration

2017-08-12 Thread Bradley Giesbrecht
> On Aug 11, 2017, at 12:46 PM, Umesh Singla wrote: > > Hi Josh, > > And then again, I am sensing a confusion with the idea of > snapshot with Josh, like when he says "remove ports when they > are no longer referenced by any snapshot". > > > What confusion exactly?

Re: [GSoC] migration

2017-08-12 Thread Umesh Singla
> > Later, I am planning to keep information on the manual portgroups in the > snapshot, if there are any. > > > > What would this information be used for? > > > > I am under the impression that a user can categorize and classify the > ports into portgroups, so it should be better if we migrate the

Re: [GSoC] migration

2017-08-12 Thread Umesh Singla
> > That was a suggested design; if you're already doing it differently then > I guess you don't need a design. I disagree with the last sentence though, > a snapshot can be viewed as precisely the state of the original tables at a > previous time. > > If that is the case, we can simply (insert int

Re: [GSoC] migration

2017-08-26 Thread Umesh Singla
Hi Brad, It occurred to me that I have been committing but did not update you for a while. For the last few weeks, I have the following notes. I have tried to write them in a to-the-point manner. *GSoC Week #10 (4 Aug - 10 Aug)* Points: 1. if no variants, then avoid searching for them, so a

Re: [GSoC] migration

2017-09-02 Thread Umesh Singla
Hi Mojca, On Thu, Jun 15, 2017 at 12:05 AM, Mojca Miklavec wrote: > On 14 June 2017 at 05:47, Umesh Singla wrote: > > > > Okay, since there's already a OS comparison made, which I think can be > > directly used here. But to clarify, just the OS check? a check on > x86_64/ppc > > changes is also

Re: [GSoC] migration

2017-09-02 Thread Umesh Singla
@Brad, for `migrate`, we're only installing requested ports but for `restore`, I imagine we will be installing all of them, after sorting? - Umesh On Sat, Sep 2, 2017 at 6:48 PM, Umesh Singla wrote: > Hi Mojca, > > On Thu, Jun 15, 2017 at 12:05 AM, Mojca Miklavec > wrote: > >> On 14 June 2017

Re: [GSoC] migration

2017-09-08 Thread Umesh Singla
Hi all, When I run the `migrate` action with only one port (expat) installed, I get the following: $ sudo ./bin/port migrate Taking a snapshot of the current state... Done: Snapshot '8':'snapshot created for migration' created at 2017-09-08 21:09:21 Migration will first uninstall all the insta

Re: [GSoC] migration

2017-09-08 Thread Mojca Miklavec
Hi, On 2 September 2017 at 15:18, Umesh Singla wrote: > On Thu, Jun 15, 2017 at 12:05 AM, Mojca Miklavec wrote: >> On 14 June 2017 at 05:47, Umesh Singla wrote: >> > >> > Okay, since there's already a OS comparison made, which I think can be >> > directly used here. But to clarify, just the OS che

Re: [GSoC] migration

2017-09-08 Thread Joshua Root
On 2017-9-9 07:33 , Umesh Singla wrote: Does it mean that new port command is not being used for the next step of installation? That's exactly what it means. Overwriting the files on disk doesn't do a "hot swap" of base versions; if you just keep running, you're still in the old version. -

Re: [GSoC] migration

2017-09-08 Thread Rainer Müller
On 2017-09-08 23:33, Umesh Singla wrote: > When I run the `migrate` action with only one port (expat) installed, I > get the following: > > $ sudo ./bin/port migrate > > Taking a snapshot of the current state... > > Done: Snapshot '8':'snapshot created for migration' created at > 2017-09-08 21:0

Re: [GSoC] migration

2017-09-08 Thread Joshua Root
On 2017-9-9 08:10 , Rainer Müller wrote: On 2017-09-08 23:33, Umesh Singla wrote: When I run the `migrate` action with only one port (expat) installed, I get the following: $ sudo ./bin/port migrate Taking a snapshot of the current state... Done: Snapshot '8':'snapshot created for migration'

Re: [GSoC] migration

2017-09-08 Thread Umesh Singla
On Sat, Sep 9, 2017 at 3:40 AM, Rainer Müller wrote: > On 2017-09-08 23:33, Umesh Singla wrote: > > When I run the `migrate` action with only one port (expat) installed, I > > get the following: > > > > $ sudo ./bin/port migrate > > > > Taking a snapshot of the current state... > > > > Done: Snap

Re: [GSoC] migration

2017-09-09 Thread Bradley Giesbrecht
> On Sep 8, 2017, at 5:04 PM, Umesh Singla wrote: > > On Sat, Sep 9, 2017 at 3:40 AM, Rainer Müller wrote: > On 2017-09-08 23:33, Umesh Singla wrote: > > When I run the `migrate` action with only one port (expat) installed, I > > get the following: > > > > $ sudo ./bin/port migrate > > > > Takin

Re: [GSoC] migration

2017-10-06 Thread Umesh Singla
Hi all, Sorry, I got caught up in academics and college stuff. Continuing from where I left: 1. I broke migrate action into two parts - `port migrate` followed by `port restore --last` to achieve the functionality we wanted. Now, migrate creates a snapshot, uninstalls the ports and upgrades the p

Re: Fwd: [GSoC] migration

2017-06-24 Thread Joshua Root
On 2017-6-25 08:24 , Umesh Singla wrote: Anyway I tried consulting the existing migration guide. Why does it save the list of all installed ports and then sets the requested flags? Only installing the requested and let the dependencies figure out themselves - is it an improvement we're making n

Re: Fwd: [GSoC] migration

2017-07-05 Thread Umesh Singla
Hi all Since there are things which need discussions on where to add what or what checks, I guess we can keep them ongoing for now. I've moved to the migrate action and we can finalize on the issues later when you're back? Thanks, Umesh On Sun, Jun 25, 2017 at 10:27 AM, Joshua Root wrote: > On

Switching cxx_stdlib for C++11 on legacy macOS (was: Re: [GSoC] migration)

2017-09-02 Thread Rainer Müller
On 09/02/2017 03:18 PM, Umesh Singla wrote: > On Thu, Jun 15, 2017 at 12:05 AM, Mojca Miklavec > wrote: > > On 14 June 2017 at 05:47, Umesh Singla wrote: > > > > Okay, since there's already a OS comparison made, which I think can be > > directly used her

Re: Switching cxx_stdlib for C++11 on legacy macOS (was: Re: [GSoC] migration)

2017-09-02 Thread Umesh Singla
On Sat, Sep 2, 2017 at 9:55 PM, Rainer Müller wrote: > On 09/02/2017 03:18 PM, Umesh Singla wrote: > > On Thu, Jun 15, 2017 at 12:05 AM, Mojca Miklavec > > wrote: > > > > On 14 June 2017 at 05:47, Umesh Singla wrote: > > > > > > Okay, since there's already

Re: Switching cxx_stdlib for C++11 on legacy macOS (was: Re: [GSoC] migration)

2017-09-02 Thread Ken Cunningham
> > As stupid as it seems but I don't see any cxx_stdlib option in my > macports.conf (see attached). base defaults it to stdlibc++ on <10.9, and libc++ on 10.9+ behind the scenes. > > Sure, this is a helpful point to keep in mind. Though, any reasons to not > switch to libc++? Although I p

Re: Switching cxx_stdlib for C++11 on legacy macOS (was: Re: [GSoC] migration)

2017-09-02 Thread Ken Cunningham
On 2017-09-02, at 11:04 AM, Ken Cunningham wrote: >> >> As stupid as it seems but I don't see any cxx_stdlib option in my >> macports.conf (see attached). > > base defaults it to stdlibc++ on <10.9, and libc++ on 10.9+ behind the > scenes. libstdc++ , not stdlibc++ haven't had coffee yet.

Re: Switching cxx_stdlib for C++11 on legacy macOS (was: Re: [GSoC] migration)

2017-09-04 Thread Ryan Schmidt
On Sep 2, 2017, at 11:25, Rainer Müller wrote: > The following goes beyond your GSoC project, but I think it fits into this > discussion. Back in May, I published an experiment on my GitHub repo that I > had > lying around. This adds functionality to stores the cxx_stdlib option in > registry, s

Re: Switching cxx_stdlib for C++11 on legacy macOS (was: Re: [GSoC] migration)

2017-09-04 Thread Mojca Miklavec
On 4 September 2017 at 10:47, Ryan Schmidt wrote: > On Sep 2, 2017, at 11:25, Rainer Müller wrote: > >> * archivefetch does not yet respect cxx_stdlib in any way > > Yeah that would need adjustment, based on how we decide to differentiate > libc++ archives from libstdc++ archives. Is there any ch

Re: Switching cxx_stdlib for C++11 on legacy macOS (was: Re: [GSoC] migration)

2017-09-04 Thread Ryan Schmidt
On Sep 4, 2017, at 04:25, Mojca Miklavec wrote: > On 4 September 2017 at 10:47, Ryan Schmidt wrote: >> On Sep 2, 2017, at 11:25, Rainer Müller wrote: >> >>> * archivefetch does not yet respect cxx_stdlib in any way >> >> Yeah that would need adjustment, based on how we decide to differentiate

Re: Switching cxx_stdlib for C++11 on legacy macOS (was: Re: [GSoC] migration)

2017-09-14 Thread Mojca Miklavec
On 4 September 2017 at 14:10, Ryan Schmidt wrote: > On Sep 4, 2017, at 04:25, Mojca Miklavec wrote: >> >> Is there any chance that we could schedule one 30-(max 90) minute long >> IRC meeting to finally settle this issue? At least from the >> philosophical point of view; code itself should be much