Re: Transition Incubator dist area
On Nov 20, 2013 Marvin Humphrey wrote: On Nov 18, 2013 Marvin Humphrey wrote: If I've done everything right, it should be possible for Infra to flip the switch and use new-style dist.apache.org synchronization at the incubator/ level. Infra flipped the switch today. We now use dist.apache.org exclusively. It would be nice if we continue on with the cleanup. These tasks remain to be done. Marvin Humphrey The following run of Clutch reported somthing strange. Back in September 2013 the Ctakes project did clean up their distribution area: http://svn.apache.org/r1523922 However Clutch now reported that they need to clean up again. So their artefacts must have returned. http://svn.apache.org/r1544987 see the changes to content/clutcho2.ent file. So perhaps that is a sign of something. -David - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Transition Incubator dist area
On Mon, Nov 18, 2013 at 5:00 PM, Marvin Humphrey mar...@rectangular.com wrote: If I've done everything right, it should be possible for Infra to flip the switch and use new-style dist.apache.org synchronization at the incubator/ level. Infra flipped the switch today. We now use dist.apache.org exclusively. It would be nice if we continue on with the cleanup. These tasks remain to be done. Marvin Humphrey - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Transition Incubator dist area
The artifacts that have been left behind by the TLP's should be moved to archive.apache.org/dist as dist should only contain the most recent releases to not overload the mirrors. I agree that we should send out an email to pmcs@ and give a window for moving the releases over to the correct location. -Jake On Sun, Nov 17, 2013 at 9:58 PM, Marvin Humphrey mar...@rectangular.comwrote: On Sun, Nov 17, 2013 at 2:09 PM, David Crossley cross...@apache.org wrote: One thing that would help is to also clear the clutter. Clutch has been alerting to old releases hanging around. http://incubator.apache.org/clutch.html#other There are many in that list with the entry: Has graduated, but still has remains on Incubator distribution mirrors. Perhaps we should start by sending out requests to all such TLPs? Probably such requests would get the most attention if they come from the IPMC Chair. Something like this? Greetings, $TLP developers, Infra has asked the Incubator to clean up our distribution area. Despite having graduated, your project still has release artifacts there. Can you please move them to your own area or remove them, as you deem appropriate? The directory which needs to be emptied out is on people.apache.org, at `/dist/$PODLING`. Marvin Humphrey Incubator PMC Chair Then, if they don't take care of things in a week or two, we move ahead with migrating the artifacts to dist.apache.org, rather than let ourselves be blocked. Marvin Humphrey - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Transition Incubator dist area
On Mon, Nov 18, 2013 at 6:15 AM, Jake Farrell jfarr...@apache.org wrote: The artifacts that have been left behind by the TLP's should be moved to archive.apache.org/dist as dist should only contain the most recent releases to not overload the mirrors. I agree that we should send out an email to pmcs@ and give a window for moving the releases over to the correct location. This is getting too complicated. The problem of our own dist area requiring complicated configuration is separate from the problem of graduating TLPs leaving a mess behind in the Incubator, and also separate from the problem of TLPs having too many artifacts on the mirrors. Infra has asked us to solve a specific problem, and I want to be responsive to Infra's request. Since no one has volunteered, I'm just going to take care of the dist dir situation myself. There won't be any additional space requirements imposed on the mirrors, though I don't know whether there might be a pointless one-time sync cost caused by file datestamp changes. After that, we can nudge the graduated TLPs to come back and pick up after themselves. Marvin Humphrey - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Transition Incubator dist area
On Nov 18, 2013, at 12:38 PM, Marvin Humphrey mar...@rectangular.com wrote: On Mon, Nov 18, 2013 at 6:15 AM, Jake Farrell jfarr...@apache.org wrote: The artifacts that have been left behind by the TLP's should be moved to archive.apache.org/dist as dist should only contain the most recent releases to not overload the mirrors. I agree that we should send out an email to pmcs@ and give a window for moving the releases over to the correct location. This is getting too complicated. The problem of our own dist area requiring complicated configuration is separate from the problem of graduating TLPs leaving a mess behind in the Incubator, and also separate from the problem of TLPs having too many artifacts on the mirrors. Infra has asked us to solve a specific problem, and I want to be responsive to Infra's request. Since no one has volunteered, I'm just going to take care of the dist dir situation myself. There won't be any additional space requirements imposed on the mirrors, though I don't know whether there might be a pointless one-time sync cost caused by file datestamp changes. Thanks for taking care of it Marvin. I was planning to volunteer but do not have good internet until Friday. If anything is left over by Friday (11/22), I can volunteer to finish it up then. Suresh After that, we can nudge the graduated TLPs to come back and pick up after themselves. Marvin Humphrey - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Transition Incubator dist area
On Mon, Nov 18, 2013 at 11:46 AM, Suresh Marru sma...@apache.org wrote: Thanks for taking care of it Marvin. I was planning to volunteer but do not have good internet until Friday. If anything is left over by Friday (11/22), I can volunteer to finish it up then. Thanks for the offer Suresh. This is the kind of thing that is best done by a single person getting in a groove, though, so I've just powered through and finished. The following directories have been copied into dist.apache.org/repos/dist/release/incubator: ambari amber chukwa deltaspike droids hcatalog imperius isis jspwiki kafka kato net mesos npanday odftoolkit olio photark s4 stonehenge tashi The only wrinkle was that Kafka had an svn checkout of their docs in there for the 0.7.0 release. I committed the docs but stripped the .svn dirs. If I've done everything right, it should be possible for Infra to flip the switch and use new-style dist.apache.org synchronization at the incubator/ level. It would be nice if we continue on with the cleanup. Should we remove the directories for podlings which have retired? And then there's the matter of dealing with TLPs who still need to link to incubating releases. Jake and I were talking on IRC about giving them a deadline to move needed releases to their own dist area, after which we svn remove their dirs. Two weeks notice seems enough to me, WDYT? Marvin Humphrey - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Transition Incubator dist area
Marvin Humphrey wrote: Hello general@incubator, Infra has requested that we perform some cleanup of our distribution area. Earlier this week, both Allura and VXQuery experienced difficulties with synchronization between their dist.apache.org release directories and the main mirror at http://www.apache.org/dist/. This is happening because the `incubator` dist directory is a hodgepodge of old-style and new-style distribution. To see what needs to be fixed, log into people.apache.org and examine the output of `ls -l /dist/incubator/`. Here's an excerpt: drwxrwxr-x 3 svnwc svnwc10 Nov 16 18:02 allura drwxrwsr-x 10 omalleyincubator12 Oct 21 16:53 ambari drwxrwsr-x 4 simonetripodi incubator 5 Jul 29 2012 amber drwxrwxr-x 4 svnwc svnwc 5 Nov 16 18:04 blur Any directory which has the group `incubator` needs to be transitioned, which involves copying the `$PODLING` directory and everything in it to `https://dist.apache.org/repos/dist/release/incubator/$PODLING`. (The `ambari` and `amber` directories would need to be copied, but the `allura` and `blur` directories would not). Once everything is transitioned, Infra will flip the switch and everybody in the Incubator will use new-style `dist.apache.org` distribution henceforth. For the sake of simplicity, it would be better if we could get a single volunteer to take on this task. Since every Incubator committer has rights to all of `https://dist.apache.org/repos/dist/release/incubator/`, you don't have to be an IPMC member. Any takers? Marvin Humphrey Thanks for setting such a thorough foundation. I cannot be that person, but i will be able to assist with answering queries and with observations. One thing that would help is to also clear the clutter. Clutch has been alerting to old releases hanging around. http://incubator.apache.org/clutch.html#other There are many in that list with the entry: Has graduated, but still has remains on Incubator distribution mirrors. Yes, i know that a proportion will have not yet made a release as the new TLP. They would remain as reminders. -David - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Transition Incubator dist area
On Sun, Nov 17, 2013 at 2:09 PM, David Crossley cross...@apache.org wrote: One thing that would help is to also clear the clutter. Clutch has been alerting to old releases hanging around. http://incubator.apache.org/clutch.html#other There are many in that list with the entry: Has graduated, but still has remains on Incubator distribution mirrors. Perhaps we should start by sending out requests to all such TLPs? Probably such requests would get the most attention if they come from the IPMC Chair. Something like this? Greetings, $TLP developers, Infra has asked the Incubator to clean up our distribution area. Despite having graduated, your project still has release artifacts there. Can you please move them to your own area or remove them, as you deem appropriate? The directory which needs to be emptied out is on people.apache.org, at `/dist/$PODLING`. Marvin Humphrey Incubator PMC Chair Then, if they don't take care of things in a week or two, we move ahead with migrating the artifacts to dist.apache.org, rather than let ourselves be blocked. Marvin Humphrey - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Transition Incubator dist area
Hello general@incubator, Infra has requested that we perform some cleanup of our distribution area. Earlier this week, both Allura and VXQuery experienced difficulties with synchronization between their dist.apache.org release directories and the main mirror at http://www.apache.org/dist/. This is happening because the `incubator` dist directory is a hodgepodge of old-style and new-style distribution. To see what needs to be fixed, log into people.apache.org and examine the output of `ls -l /dist/incubator/`. Here's an excerpt: drwxrwxr-x 3 svnwc svnwc10 Nov 16 18:02 allura drwxrwsr-x 10 omalleyincubator12 Oct 21 16:53 ambari drwxrwsr-x 4 simonetripodi incubator 5 Jul 29 2012 amber drwxrwxr-x 4 svnwc svnwc 5 Nov 16 18:04 blur Any directory which has the group `incubator` needs to be transitioned, which involves copying the `$PODLING` directory and everything in it to `https://dist.apache.org/repos/dist/release/incubator/$PODLING`. (The `ambari` and `amber` directories would need to be copied, but the `allura` and `blur` directories would not). Once everything is transitioned, Infra will flip the switch and everybody in the Incubator will use new-style `dist.apache.org` distribution henceforth. For the sake of simplicity, it would be better if we could get a single volunteer to take on this task. Since every Incubator committer has rights to all of `https://dist.apache.org/repos/dist/release/incubator/`, you don't have to be an IPMC member. Any takers? Marvin Humphrey - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
