Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-08 Thread Gianluca Sforna
On Mon, Jun 8, 2009 at 6:24 PM, Thorsten Leemhuis wrote:
> Not to forget
> Jesse (as rel-eng lead in a quite important position) and his "quest
> to reduce the number of updates" (which he gave up -- see earlier this
> thread),

FTR, he actually said "I've all *but* given up on my quest to reduce
the number of updates", emphasis is mine.


-- 
Gianluca Sforna

http://morefedora.blogspot.com
http://www.linkedin.com/in/gianlucasforna

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-08 Thread Thorsten Leemhuis
Sorry, was quite busy with other stuff over the past few days and didn't
get around to answer this

On 03.06.2009 02:15, Josh Boyer wrote:
> On Wed, Jun 03, 2009 at 01:08:15AM +0200, Kevin Kofler wrote:
>> Thorsten Leemhuis wrote:
>>> It IMHO shows a big and more and more pressing problem in Fedora:
>>> Packagers and leadership are not working towards the same direction.
>> The best solution for that is to change the leadership. :-) So don't vote
>> for the same old hats for FESCo and FPB.
> 
> Honestly, that is pretty short-sighted.  And Thorsten's statement isn't
> entirely accurate either.  Entirely new FESCo and FPB would still be faced 
> with
> the same problems we have today.
> 
> Let's look at in a bit more detail.
> 
> 1) I don't recall ever seeing FESCo or FPB state as a committee that they want
> fewer packages and updates.  If you have a mailing list post to meeting 
> minutes
> that say that, I would be happy to look at it.

In short: And that from my point of view is exactly the leadership problem.

The verbose version: Fedora obviously has a problem here as some
packagers follow a (kind of) debian like update scheme while others are
more rolling release scheme. That's bad, as those users that prefer to
get the latest version of the software as regular update are not
satisfied, as some packages stay on old versions; neither are those that
prefer "old, but stable", as they sometimes can't avoid to update to new
versions for security reasons (Note that this is the very long story
very short and without lots of details/special cases where doing either
the first or the second is the better thing to do).

The policy that FESCo worked out a few months didn't help much. In fact
it's so vague that it's IMHO more confusing then helpful. Not to forget
Jesse (as rel-eng lead in a quite important position) and his "quest
to reduce the number of updates" (which he gave up -- see earlier this
thread), which likely made some packagers wonder "is it right how I do it"?

A real leader/leading group would have said guided people better. Like
"This is how we want to do it [...], here are a few examples that will
help to understand [...]". Or even better: work out a overall solution
that changes Fedora into a distribution that satisfies both users groups
mentioned above: those that prefer older, but stable packages and those
that prefer newer packages, but avoid rawhide because it's to dangerous.

> [...]

Cu
knurd

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-04 Thread Jesse Keating
On Thu, 2009-06-04 at 19:29 -0700, John Poelstra wrote:
> Seeking clarification... From my perspective, "marketing machine" has a 
> derogatory tone to it.  Is that the intended tone?
> 
> If, "yes," why?  If "no," never mind :)
> 

There was no derogatory tone intended.

-- 
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating


signature.asc
Description: This is a digitally signed message part
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-04 Thread John Poelstra

Jesse Keating said the following on 06/01/2009 11:14 AM Pacific Time:

On Mon, 2009-06-01 at 19:49 +0200, Thorsten Leemhuis wrote:



- why do we have to slip by a whole week most of the time? can't we find
ways to slip just a day or two if there really is no way around a delay?


The marketing machine has very strongly requested that we only do
releases on Tuesdays.



Seeking clarification... From my perspective, "marketing machine" has a 
derogatory tone to it.  Is that the intended tone?


If, "yes," why?  If "no," never mind :)

John

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-04 Thread Chuck Anderson
On Thu, Jun 04, 2009 at 10:56:34AM -0400, Seth Vidal wrote:
>
>
> On Thu, 4 Jun 2009, Tom \"spot\" Callaway wrote:
>
>> On 06/03/2009 07:48 PM, Chuck Anderson wrote:
>>> Not necessarily.  I don't see why the Fedora Project couldn't qualify
>>> as a Sponsored Participant on Internet2 [1].  In fact, Red Hat is
>>> already connected in Raleigh.
>>
>> I think this is because they're technically on NC State University.
>>
>
> and last time I checked it's a 100mbit connection to i2.

Well, they are listed as "Red Hat" on the Internet2 map.  Time to 
upgrade to Gig :-)

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-04 Thread Seth Vidal



On Thu, 4 Jun 2009, Tom \"spot\" Callaway wrote:


On 06/03/2009 07:48 PM, Chuck Anderson wrote:

Not necessarily.  I don't see why the Fedora Project couldn't qualify
as a Sponsored Participant on Internet2 [1].  In fact, Red Hat is
already connected in Raleigh.


I think this is because they're technically on NC State University.



and last time I checked it's a 100mbit connection to i2.

-sv

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-04 Thread Tom "spot" Callaway
On 06/03/2009 07:48 PM, Chuck Anderson wrote:
> Not necessarily.  I don't see why the Fedora Project couldn't qualify 
> as a Sponsored Participant on Internet2 [1].  In fact, Red Hat is 
> already connected in Raleigh. 

I think this is because they're technically on NC State University.

~spot

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Chuck Anderson
On Mon, Jun 01, 2009 at 06:45:07PM -0400, Tom spot Callaway wrote:
> On 06/01/2009 06:45 PM, Jesse Keating wrote:
> > If we had I2 in PHX this would get a lot faster.
> 
> We just need to hold some classes and get the PHX datacenter certified
> as a University. ;)

Not necessarily.  I don't see why the Fedora Project couldn't qualify 
as a Sponsored Participant on Internet2 [1].  In fact, Red Hat is 
already connected in Raleigh.  I'd gladly help pursue this, but I may 
not be the right person seeing as I'm in Boston, not PHX.

I2 also has a "private lambda" service where you can get your own 
dedicated 10Gig wavelength across the backbone [2].  It seems they are 
currently offering no-fee trials of this service to I2 connectors.

Arizona State University is already on I2 via CENIC, and CENIC offers 
this Dynamic Circuit capability.  MCNC in Durham where Red Hat is 
connected doesn't appear to have DCN though.

[1] http://www.internet2.edu/network/participants/

"Sponsored participants are individual educational institutions 
(including not-for-profit and for-profit K-20, technical, and trade 
schools), museums, art galleries, libraries, hospitals, as well as 
other non-educational, not-for-profit or for-profit organizations that 
require routine collaboration on instructional, clinical, and/or 
research projects, services, and content with Primary participants or 
with other Sponsored Participants. Such organizations typically are 
either not eligible or not able to become Internet2 members."

[2] http://www.internet2.edu/network/dc/

"To support the development, deployment, and use of innovative hybrid 
optical networking capabilities, Internet2 is initiating a no-fee 
trial of the Internet2 DCN."

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Seth Vidal



On Wed, 3 Jun 2009, Bill Nottingham wrote:


Jesse Keating (jkeat...@redhat.com) said:

On Wed, 2009-06-03 at 13:49 -0400, Seth Vidal wrote:

And the optimization there is fairly well known. We need to read in and
not change the prestodelta file. It's on my short-ish createrepo list.


Hrm, bill thought it was something on the mash side, where he validates
the signature of all the existing deltas to catch if a gpg sig changed
without a n-v-r bump.


I haven't characterized that that is *definitely* what's causing pain,
but it's a likely source.

It's also a hard one to optimize unless you decree that packages will
never change signatures, which doesn't seem practical.


We could always go to detached signatures or auto-pkg signatures and then 
only manually sign the repomd's.


-sv

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Bill Nottingham
Jesse Keating (jkeat...@redhat.com) said: 
> On Wed, 2009-06-03 at 13:49 -0400, Seth Vidal wrote:
> > And the optimization there is fairly well known. We need to read in and 
> > not change the prestodelta file. It's on my short-ish createrepo list.
> 
> Hrm, bill thought it was something on the mash side, where he validates
> the signature of all the existing deltas to catch if a gpg sig changed
> without a n-v-r bump.

I haven't characterized that that is *definitely* what's causing pain,
but it's a likely source.

It's also a hard one to optimize unless you decree that packages will
never change signatures, which doesn't seem practical.

Bill

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Chris Lumens
> It might have helped to find the problem earlier -- I for example got
> the impression that a lot of people had problems with the storage
> rewrite and thus aborted their tests with Alpha or Beta.

There was no storage rewrite in the Alpha, so this isn't the case there.
For the beta, you are correct.

- Chris

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Chris Lumens
> > An earlier freeze would have just frozen the work unfinished.  The
> > rewrite was a massive undertaking and we knew it was going to take
> > longer than the release cycle to finish.  Freezing earlier wouldn't have
> > helped.
> 
> Then it should have been done in a work branch and targeted for a later
> release.

Which, of course, it was.  But there's no substitute for real-world
testing.  We do not have nearly the variety of hardware setups, existing
partition layouts, or unusual requirements here that users do.  At some
point, we really do just have to let the new code loose on everyone and
get the broad testing that's supposed to be one of the hallmarks of free
software.

- Chris

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Seth Vidal



On Wed, 3 Jun 2009, Jesse Keating wrote:


On Wed, 2009-06-03 at 13:49 -0400, Seth Vidal wrote:

And the optimization there is fairly well known. We need to read in and
not change the prestodelta file. It's on my short-ish createrepo list.


Hrm, bill thought it was something on the mash side, where he validates
the signature of all the existing deltas to catch if a gpg sig changed
without a n-v-r bump.


Ah - well I hadn't heard the mash part - I know that we could speed up the 
prestodelta xml creation part - I wasn't convinced it was a 6 hour 
process, though :)


-sv

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Jesse Keating
On Wed, 2009-06-03 at 13:49 -0400, Seth Vidal wrote:
> And the optimization there is fairly well known. We need to read in and 
> not change the prestodelta file. It's on my short-ish createrepo list.

Hrm, bill thought it was something on the mash side, where he validates
the signature of all the existing deltas to catch if a gpg sig changed
without a n-v-r bump.

-- 
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating


signature.asc
Description: This is a digitally signed message part
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Seth Vidal



On Wed, 3 Jun 2009, Jesse Keating wrote:


On Wed, 2009-06-03 at 08:55 -0400, Paul W. Frields wrote:

If the FAD identifies some tangibles (hardware, etc.) that would help
alleviate some of the time problems, I can tell you that Spot and I
will do our best to procure them.  From what I've heard others
describe up until now, it doesn't seem like there's one clear
roadblock in that regard -- just a huge mountain of tasks that our
current systems have to chug through for composing, and no matter how
you slice it, it takes a lot of time and I/O bandwidth.


Well upgrading all the buildsystem and storage system to 10gigE, and
replacing the 10TB or so filer with something that has fantastically
fast disks would certainly reduce the amount of I/O wait time, but
that's going to cost a /lot/ of money.  We are still trying to find
where our bottlenecks are.  We had a pretty good handle on things prior
to delta rpms, but now we've gone from 3~ hour null composes (no changed
packages) to nearly 9 hour null composes.  There is obviously some
optimization to be had here.


And the optimization there is fairly well known. We need to read in and 
not change the prestodelta file. It's on my short-ish createrepo list.


-sv

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Jesse Keating
On Wed, 2009-06-03 at 08:55 -0400, Paul W. Frields wrote:
> If the FAD identifies some tangibles (hardware, etc.) that would help
> alleviate some of the time problems, I can tell you that Spot and I
> will do our best to procure them.  From what I've heard others
> describe up until now, it doesn't seem like there's one clear
> roadblock in that regard -- just a huge mountain of tasks that our
> current systems have to chug through for composing, and no matter how
> you slice it, it takes a lot of time and I/O bandwidth.

Well upgrading all the buildsystem and storage system to 10gigE, and
replacing the 10TB or so filer with something that has fantastically
fast disks would certainly reduce the amount of I/O wait time, but
that's going to cost a /lot/ of money.  We are still trying to find
where our bottlenecks are.  We had a pretty good handle on things prior
to delta rpms, but now we've gone from 3~ hour null composes (no changed
packages) to nearly 9 hour null composes.  There is obviously some
optimization to be had here.

-- 
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating


signature.asc
Description: This is a digitally signed message part
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Jóhann B. Guðmundsson

On 06/03/2009 02:38 PM, Tom "spot" Callaway wrote:

On 06/03/2009 09:01 AM, Josh Boyer wrote:
   

Oh, and time.  Always need time.  If you or spot could procure time, let me
know ;)
 

Man, if I knew how to do that, I'd be a lot wealthier than I am now. ;)

   

Extend the day to 36 hours

Gosh feel like a millionaire already

Sleep is overrated anyway. :)

Johann "who get's enough sleep when he's dead" Gudmundsson
begin:vcard
fn:Johann B. Gudmundsson
n:Gudmundsson;Johann B.
org:Reiknistofnun - University of Iceland;IT Management
adr:Taeknigardi;;Dunhagi 5;Reykjavik;;107;Iceland
email;internet:johan...@hi.is
title:Unix System Engineer RHCE,CCSA
tel;work:+3545254267
tel;fax:+3545528801
tel;pager:N/A
tel;home:N/A
tel;cell:N/A
url:www.rhi.hi.is
version:2.1
end:vcard

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Tom "spot" Callaway
On 06/03/2009 09:01 AM, Josh Boyer wrote:
> Oh, and time.  Always need time.  If you or spot could procure time, let me
> know ;)

Man, if I knew how to do that, I'd be a lot wealthier than I am now. ;)

~spot

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Josh Boyer
On Wed, Jun 03, 2009 at 08:55:48AM -0400, Paul W. Frields wrote:
>On Tue, Jun 02, 2009 at 08:15:32PM -0400, Josh Boyer wrote:
>> We are facing some real limitations on our turn around time for
>> things at the moment and they are only going to get worse as we have
>> newer releases that will get the delta rpms.  At the same time, the
>> same people are getting raked over the coals for not getting bits
>> out fast enough.
>> 
>> We are working on this from a rel-eng standpoint, but advocating for
>> a bit of discretion on what should be pushed as an update is not
>> entirely a bad thing.  Personally, I would love it if package
>> maintainers slowed down a bit.  But it's not an end solution.
>> 
>> So certainly the leadership, defined as FESCo and FPB, is not in
>> conflict with the contributor's apparent direction.  As far as I can
>> see, they haven't made a statement either way.  If there is a group
>> that was pushing for something that ran contrary, it was Rel-Eng.
>> And given that Jesse and I both just said we're going to basically
>> stop begging people to slow down on updates, I think even that group
>> is trying to figure out a way to make things better.  Hell, that's
>> partly what this FAD is all about.
>
>If the FAD identifies some tangibles (hardware, etc.) that would help
>alleviate some of the time problems, I can tell you that Spot and I
>will do our best to procure them.  From what I've heard others
>describe up until now, it doesn't seem like there's one clear
>roadblock in that regard -- just a huge mountain of tasks that our
>current systems have to chug through for composing, and no matter how
>you slice it, it takes a lot of time and I/O bandwidth.

Yep.  As a simple test, We'd like to do some experiments to see if running
updates pushes and rawhide composes on separate boxen makes things worse or
better or about the same.  I don't think we need additional procured hardware
for that, just a cloned guest which I already have a ticket opened for.

Oh, and time.  Always need time.  If you or spot could procure time, let me
know ;)

josh

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Paul W. Frields
On Tue, Jun 02, 2009 at 08:15:32PM -0400, Josh Boyer wrote:
> We are facing some real limitations on our turn around time for
> things at the moment and they are only going to get worse as we have
> newer releases that will get the delta rpms.  At the same time, the
> same people are getting raked over the coals for not getting bits
> out fast enough.
> 
> We are working on this from a rel-eng standpoint, but advocating for
> a bit of discretion on what should be pushed as an update is not
> entirely a bad thing.  Personally, I would love it if package
> maintainers slowed down a bit.  But it's not an end solution.
> 
> So certainly the leadership, defined as FESCo and FPB, is not in
> conflict with the contributor's apparent direction.  As far as I can
> see, they haven't made a statement either way.  If there is a group
> that was pushing for something that ran contrary, it was Rel-Eng.
> And given that Jesse and I both just said we're going to basically
> stop begging people to slow down on updates, I think even that group
> is trying to figure out a way to make things better.  Hell, that's
> partly what this FAD is all about.

If the FAD identifies some tangibles (hardware, etc.) that would help
alleviate some of the time problems, I can tell you that Spot and I
will do our best to procure them.  From what I've heard others
describe up until now, it doesn't seem like there's one clear
roadblock in that regard -- just a huge mountain of tasks that our
current systems have to chug through for composing, and no matter how
you slice it, it takes a lot of time and I/O bandwidth.

-- 
Paul W. Frieldshttp://paul.frields.org/
  gpg fingerprint: 3DA6 A0AC 6D58 FEC4 0233  5906 ACDB C937 BD11 3717
  http://redhat.com/   -  -  -  -   http://pfrields.fedorapeople.org/
  irc.freenode.net: stickster @ #fedora-docs, #fedora-devel, #fredlug

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Matej Cepl
Kevin Kofler, Wed, 03 Jun 2009 01:29:35 +0200:
> gmane.linux.redhat.fedora.testers

http://list.gmane.org/fedora-test-l...@redhat.com

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Thorsten Leemhuis
On 02.06.2009 22:14, Matt Domsch wrote:
> On Tue, Jun 02, 2009 at 09:30:17PM +0200, Thorsten Leemhuis wrote:
>> On 02.06.2009 00:22, Matt Domsch wrote:
>>> On Mon, Jun 01, 2009 at 04:03:04PM -0400, Paul W. Frields wrote:
 I'm getting out of my ken here, but could this be done in stages with
 I2 connected hosts getting the bits early/first and then moving on to
 others?
>>> We need to move ~130GB to each of ~230 mirrors, in about 4
>>> days.
> The 130GB is what we posted for F10.  Of that, 48GB were ISOs, 93GB
> was the Everything/ tree which was hardlinked from rawhide, so yes,
> that would cut down on the transfer quite a bit.
> 
> Honestly, I don't recall how the signing aspect went for F10.  If the
> process involved signing, then copying the packages into the
> Everything tree, then there wouldn't be hardlinks to help.

They would -- just copy the files two days ahead of signing somewhere (a
temporary hidden place not exported to the world for example). When you
sign later and put the files in the proper place then iirc just the
signature of the files need to be updated, which rsync handles well.

[...]
>> Or what am I missing?
> I think you're right, except that RC ISOs aren't published ahead of
> time for mirrors to sync,

Which shouldn't be to hard to do, or?

> and signing of the RPMs that land in the
> Everything tree if they weren't signed, or were signed with a
> different key.  I believe the signing process has changed for F11, so
> the packages in rawhide are signed with the F11 release key.  I think
> that means at some point, either through a mass rebuild, or through a
> resigning, rawhide will then need to be re-signed with the F12 key.

Yeah, that's how I understood it as well. But it means it should be easy
to hardlink the files in the target place when a test/final release
happens, which is something quite easy for rsync afaics.

CU
knurd

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-03 Thread Thorsten Leemhuis
On 02.06.2009 22:30, Jesse Keating wrote:
> On Tue, 2009-06-02 at 21:30 +0200, Thorsten Leemhuis wrote:
>> but if we get RC with the final name transferred to the
>> mirrors ahead of time then they can be updated relative quickly as well,
>> as only a few bit change.
> 
> We don't do this as it tends to lead to leaks, and confusion as to
> whether the release has been done or not.

Then put it in a temporary folder that is rsynced from the mirror
masters, but not exported it to the world. Later it's just a update to
the file and a hardlink to a proper place.

Or simply ignore that "there might be leaks" problem more -- the
clientele that is huntin for leaks before something is announced is
doing something wrong already in any case. And if the whole process from
finishing to release would be a whole lot shorter then it shortens the
time where something leaks.

CU
knurd

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Josh Boyer
On Wed, Jun 03, 2009 at 01:10:14AM +0200, Kevin Kofler wrote:
>Jesse Keating wrote:
>> An earlier freeze would have just frozen the work unfinished.  The
>> rewrite was a massive undertaking and we knew it was going to take
>> longer than the release cycle to finish.  Freezing earlier wouldn't have
>> helped.
>
>Then it should have been done in a work branch and targeted for a later
>release.

You have a point, but for something like anaconda you really need it to be
installable and tested via installs.  Simply branching the package isn't
enough, since you need actual composes with the branched code in it.

Not impossible to do, but when we have trouble getting people to test rawhide
already I'm not sure diluting our test pool that way is a great answer.

josh

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Josh Boyer
On Wed, Jun 03, 2009 at 01:08:15AM +0200, Kevin Kofler wrote:
>Thorsten Leemhuis wrote:
>> It IMHO shows a big and more and more pressing problem in Fedora:
>> Packagers and leadership are not working towards the same direction.
>
>The best solution for that is to change the leadership. :-) So don't vote
>for the same old hats for FESCo and FPB.

Honestly, that is pretty short-sighted.  And Thorsten's statement isn't
entirely accurate either.  Entirely new FESCo and FPB would still be faced with
the same problems we have today.

Let's look at in a bit more detail.

1) I don't recall ever seeing FESCo or FPB state as a committee that they want
fewer packages and updates.  If you have a mailing list post to meeting minutes
that say that, I would be happy to look at it.

2) The people that _have_ advocated for fewer updates have actual limitations
they are facing that would make it desirable.  As Jesse said in his reply
earlier, it takes 8+ hours to mash rawhide now.  It _also_ takes at least 8
hours to do an updates push.

We are facing some real limitations on our turn around time for things at the
moment and they are only going to get worse as we have newer releases that will
get the delta rpms.  At the same time, the same people are getting raked over
the coals for not getting bits out fast enough.

We are working on this from a rel-eng standpoint, but advocating for a bit of
discretion on what should be pushed as an update is not entirely a bad thing.
Personally, I would love it if package maintainers slowed down a bit.  But it's
not an end solution.

So certainly the leadership, defined as FESCo and FPB, is not in conflict with
the contributor's apparent direction.  As far as I can see, they haven't made
a statement either way.  If there is a group that was pushing for something
that ran contrary, it was Rel-Eng.  And given that Jesse and I both just said
we're going to basically stop begging people to slow down on updates, I think
even that group is trying to figure out a way to make things better.  Hell,
that's partly what this FAD is all about.

So, please.  The rhetoric isn't really needed, it's not productive, and it's
just going to stir things up more than necessary.

>> Maybe more target dates where people should "get things into shape"
>> might help to reduce the work for the real test/final releases.
>
>Actually a better strategy is to just schedule the release a few weeks
>earlier than when you actually want to release, then the slips will make it
>hit the real target date very closely. :-)

Except our schedule is public and open.  So whatever we say the date is,
pretend or not, is the date that people will expect and target.

josh

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Kevin Kofler
Matthew Woehlke wrote:
> It's too bad fedora-test-list doesn't seem to be on gmane (or isn't
> named obviously; gmane.org is being too slow for me to ask about the
> mail address).

gmane.linux.redhat.fedora.testers

Kevin Kofler

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Kevin Kofler
Jesse Keating wrote:
> An earlier freeze would have just frozen the work unfinished.  The
> rewrite was a massive undertaking and we knew it was going to take
> longer than the release cycle to finish.  Freezing earlier wouldn't have
> helped.

Then it should have been done in a work branch and targeted for a later
release.

Kevin Kofler

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Kevin Kofler
Thorsten Leemhuis wrote:
> It IMHO shows a big and more and more pressing problem in Fedora:
> Packagers and leadership are not working towards the same direction.

The best solution for that is to change the leadership. :-) So don't vote
for the same old hats for FESCo and FPB.

> One comment: *from a outside* it often looks a bit like
> - some (not all) people go crazy for weeks or months and ignore some of
> those bugs that are not pressing, but nevertheless pressing (e.g. kind
> of bugs that tend to land on target or blocker tracker bugs or already
> are there)
> - then you send a reminder "there will be a a test release next week"
> - people suddenly wake up and try to fix those bugs for the test release
> - they notice: arghh, serious things are broken, we need more time; can
> we please slip?
> - we slip
> 
> Maybe more target dates where people should "get things into shape"
> might help to reduce the work for the real test/final releases.

Actually a better strategy is to just schedule the release a few weeks
earlier than when you actually want to release, then the slips will make it
hit the real target date very closely. :-)

But I don't see those slips as a big issue in the first place.

Kevin Kofler

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Matthew Woehlke

Michael Cronenworth wrote:

Matthew Woehlke wrote:

What about dropping hierarchical mirroring altogether? Why hasn't
someone developed a distributed (i.e. bittorrent-like) system for mass
mirroring? :-)



Already discussed[1][2] on the fedora-test-list.

[1] https://www.redhat.com/archives/fedora-test-list/2009-June/msg00032.html
[2] https://www.redhat.com/archives/fedora-test-list/2009-June/msg00062.html


It's too bad fedora-test-list doesn't seem to be on gmane (or isn't 
named obviously; gmane.org is being too slow for me to ask about the 
mail address).


In an idealized network (all servers have roughly the same speed links 
to all other servers), BT distribution should get everything to everyone 
in about 2x as long as to send everything to one server. In the worst 
case, it should take 2x as long as to send everything over the slowest 
link in the mesh, which if only care about when /all/ mirrors are fully 
synced (a very reasonable assumption in this type of scenario) is still 
pretty close to being an unconditional improvement. In practice, the 
actual result will be somewhere between 2x the time to transfer over the 
fastest link, and over the slowest link.


In a generalized sense, the time-order to distribute via bittorrent in 
an idealized network is O(2 * K), where hierarchical systems are, at 
best I believe O(log(base N) K) for the furthest mirrors, and still O(N0 
* K) for the tier-0 mirrors. That's an improvement of an entire order 
(O(log n) -> O(n)).


The point about there not being tools currently is what would need to be 
addressed.


--
Matthew
Please do not quote my e-mail address unobfuscated in message bodies.
--
Congratulations! You've won a free trip to the future! All you have to 
do to claim your prize is wait five minutes...


--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Jesse Keating
On Tue, 2009-06-02 at 22:01 +0200, Björn Persson wrote:
> Jesse Keating wrote:
> > On Mon, 2009-06-01 at 20:56 -0500, Bruno Wolff III wrote:
> > > Do you hard link the new release files to the ones identical in rawhide
> > > so that rsync doesn't have to transfer them to places mirroring rawhide?
> >
> > Yes and no.  We do use hardlinks, however the mechanism that gets it
> > from PHX to Raleigh is Netapp snapmirror, which works at the block
> > level.  I don't know enough about snapmirror to know if it is helped by
> > hardlinks or not.  The individual files aren't the real problem, it's
> > the isos, particularly the live isos.
> 
> A program similar to Jigdo could speed this up. Transfer only the RPM 
> packages 
> (taking advantage of hard links) and information on what packages are in each 
> ISO image, and then recreate the ISO images at the destination. That way each 
> package would only be transferred once, regardless of how many ISO images it 
> occurs in.

Unfortunately we don't have access/ability to use anything but
snapmirror to get content from PHX into RDU where the I2 links are.


-- 
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating


signature.asc
Description: This is a digitally signed message part
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Jesse Keating
On Tue, 2009-06-02 at 21:09 +0200, Thorsten Leemhuis wrote:
> Just a general comment, not relevant for the "Announcing Fedora Activity
> Day". I'm glad that you gave up that quest, as "Fedora gets lot's of
> updates" is afaics a reason why a lot people actually use or contribute
> to Fedora. But that doesn't matter much. What I really want to say:
> 
> I totally agree with this:
> 
> > It's just doesn't
> > seem to be in line with the desires of the package maintainers, whether
> > or not it's in line with the desires of (some of) the project leaders.
> 
> It IMHO shows a big and more and more pressing problem in Fedora:
> Packagers and leadership are not working towards the same direction.

Yes, that is a problem.  In other projects, the contributions from folks
who don't agree with where the project leaders are trying to take the
project are often rejected or ignored.  That isn't happening here, which
is a good thing I suppose, but it is a point of contention that will
have to be addressed.

> 
> Anyway, back to topic:
> 
> >> - other distributions seems to manage a whole lot more test releases
> >> (e.g. alphas, beta, RC, milestones, ...) per devel cycle; is that
> >> something we should aim for as well?
> > If there was a way to do it without adding stress and work needed to
> > teams like releng, installer, etc.. [...]
> 
> One comment: *from a outside* it often looks a bit like
> - some (not all) people go crazy for weeks or months and ignore some of
> those bugs that are not pressing, but nevertheless pressing (e.g. kind
> of bugs that tend to land on target or blocker tracker bugs or already
> are there)
> - then you send a reminder "there will be a a test release next week"
> - people suddenly wake up and try to fix those bugs for the test release
> - they notice: arghh, serious things are broken, we need more time; can
> we please slip?
> - we slip
> 
> Maybe more target dates where people should "get things into shape"
> might help to reduce the work for the real test/final releases.

Yeah, I can see how that would be the case from the outside.  From the
inside, the more freeze points we have, the more times  work in progress
has to be stifled and beat into some sort of working shape, even if it's
nothing like what the final product goal is, which results in a lot of
wasted effort and testing which gets thrown out as development continues
and changes everything that was "tested" earlier.

> >> - how about doing something like a "cp -l development devel-snapshot"
> >> now and then (once a week) when we know rawhide is mostly working?
> > The rawhide trees for at least the past month are kept in the Fedora
> > infrastructure and are even available by a public url.  We haven't
> > tagged any of them as "stable" though.
> 
> They are afaics way to far away/way to slow to reach to do a proper
> network install in an acceptable period of time (at least from Germany).
> Is rsync available -- I'm not aware of it, so I doubt it?

No, but the most important part of these are the boot.iso which has the
anaconda and other code that anaconda needs.  The repository that you
point the boot.iso at to install packages matters a lot less at least so
far as "completing the install".

> >> - how can we reduce our time between finishing a (test) release and
> >> releasing it dramatically? It seems other distributions get new (test)
> >> release out to the users a lot quicker then the three to five days days
> >> we require, which seems a whole lot for a devel cycle that takes 180
> >> days in total (and we all know how much rawhide can move on with a few 
> >> days)
> > If we didn't care to let the mirrors sync up we could "release" it
> > earlier. However what good does that do when nobody can /get/ to the
> > release because none of the mirrors have it, and the ones that do can't
> > help sync to those that don't because users are tying up all the
> > bandwidth?
> 
> I didn't say to not care. But maybe shorten the time we wait for them
> and help to get the bits out more quickly; pushing users to use
> bittorrent more might help a lot as well.

I honestly feel that trying to shorten the length will only lead to
mistakes.  We're short as it is, nearly too short, with extremely little
time to recover from a mistake without slipping.

> 
> >> - I'd be glad if we could stick to our release targets a lot better.
> >> Delaying releases looks quite unprofessional. Delaying also creates
> >> trouble for those depending on our releases. Take computer magazines
> >> (which have hard deadlines for productions) that might want to ship with
> >> a new release on a CD or DVD together with the next issue -- due to our
> >> fame in missing deadlines it seems to me that we are a lot more
> >> unattractive than Ubuntu (which afaics is on the shelf's here in Germany
> >> with new computer magazines just a few days after it has been released)
> > What looks more unprofessional?  Delaying the release, or hitting our
> > date and relea

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Jesse Keating
On Tue, 2009-06-02 at 21:12 +0200, Thorsten Leemhuis wrote:
> It might have helped to find the problem earlier -- I for example got
> the impression that a lot of people had problems with the storage
> rewrite and thus aborted their tests with Alpha or Beta.
> 

An earlier freeze would have just frozen the work unfinished.  The
rewrite was a massive undertaking and we knew it was going to take
longer than the release cycle to finish.  Freezing earlier wouldn't have
helped.

-- 
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating


signature.asc
Description: This is a digitally signed message part
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Jesse Keating
On Tue, 2009-06-02 at 21:30 +0200, Thorsten Leemhuis wrote:
> but if we get RC with the final name transferred to the
> mirrors ahead of time then they can be updated relative quickly as well,
> as only a few bit change.

We don't do this as it tends to lead to leaks, and confusion as to
whether the release has been done or not.

-- 
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating


signature.asc
Description: This is a digitally signed message part
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Michael Cronenworth
Matthew Woehlke wrote:
> 
> What about dropping hierarchical mirroring altogether? Why hasn't
> someone developed a distributed (i.e. bittorrent-like) system for mass
> mirroring? :-)
> 

Already discussed[1][2] on the fedora-test-list.

[1] https://www.redhat.com/archives/fedora-test-list/2009-June/msg00032.html
[2] https://www.redhat.com/archives/fedora-test-list/2009-June/msg00062.html

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Matt Domsch
On Tue, Jun 02, 2009 at 09:30:17PM +0200, Thorsten Leemhuis wrote:
> On 02.06.2009 00:22, Matt Domsch wrote:
> > On Mon, Jun 01, 2009 at 04:03:04PM -0400, Paul W. Frields wrote:
> >> I'm getting out of my ken here, but could this be done in stages with
> >> I2 connected hosts getting the bits early/first and then moving on to
> >> others?
> > We need to move ~130GB to each of ~230 mirrors, in about 4
> > days.

The 130GB is what we posted for F10.  Of that, 48GB were ISOs, 93GB
was the Everything/ tree which was hardlinked from rawhide, so yes,
that would cut down on the transfer quite a bit.

Honestly, I don't recall how the signing aspect went for F10.  If the
process involved signing, then copying the packages into the
Everything tree, then there wouldn't be hardlinks to help.
 
> I'd like to question these numbers. All the SRPMS (18 GByte) and RPMS
> (20 GByte per arch) of a new release are in the rawhide trees already --
> thus if they are hardlinked properly then they can be transferred in a
> minute or two. The install CD and DVD images (~ 8 GByte each per arch?)
> are bigger, but if we get RC with the final name transferred to the
> mirrors ahead of time then they can be updated relative quickly as well,
> as only a few bit change.

RCs with the final name haven't been posted for the mirrors ahead of
time, yet.  We could consider it for F12 though.

 
> The spins that get compressed are a problem. But we only send Desktop
> and KDE spins to the mirrors for x86-32 and x86-64 afaics -- so roughly
> 3 GByte in total.

Right.
 
> So 3 GByte + some other random stuff that changed  -- install.img,
> boot.iso, and some other things. Not sure how much that will sum up to,
> but can't sum up to that much -- maybe 3 or 5 more GByte.
> 
> Let's say it are 10 GBtyte. It afaics shouldn't take more then a day if
> all mirrors look out for new stuff at least every 4 hours and have a
> link that isn't slow by todays standards.
> 
> Or what am I missing?

I think you're right, except that RC ISOs aren't published ahead of
time for mirrors to sync, and signing of the RPMs that land in the
Everything tree if they weren't signed, or were signed with a
different key.  I believe the signing process has changed for F11, so
the packages in rawhide are signed with the F11 release key.  I think
that means at some point, either through a mass rebuild, or through a
resigning, rawhide will then need to be re-signed with the F12 key.


-- 
Matt Domsch
Technology Strategist, Dell Office of the CTO
linux.dell.com & www.dell.com/linux

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Michael Cronenworth
Björn Persson wrote:
> 
> A program similar to Jigdo could speed this up. Transfer only the RPM 
> packages 
> (taking advantage of hard links) and information on what packages are in each 
> ISO image, and then recreate the ISO images at the destination. That way each 
> package would only be transferred once, regardless of how many ISO images it 
> occurs in.
> 


Jigdo doesn't work in Fedora unless you want to implement a
self-compiling jigdo creator. Why? 'Cause old Fedora updates are not
kept on mirrors. A Jigdo file you create today may not work next week.
Bad, bad, bad. k?

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Adam Miller
On Tue, Jun 2, 2009 at 3:02 PM, Matthew Woehlke
 wrote:
> Matt Domsch wrote:
>
> What about dropping hierarchical mirroring altogether? Why hasn't someone
> developed a distributed (i.e. bittorrent-like) system for mass mirroring?
> :-)
>
> --
> Matthew
> Please do not quote my e-mail address unobfuscated in message bodies.
> --
> Congratulations! You've won a free trip to the future! All you have to do to
> claim your prize is wait five minutes...
>
> --
> fedora-devel-list mailing list
> fedora-devel-list@redhat.com
> https://www.redhat.com/mailman/listinfo/fedora-devel-list
>

Why not? Might be an interesting idea to pursue.

-Adam

-- 
http://maxamillion.googlepages.com
-
()  ascii ribbon campaign - against html e-mail
/\  www.asciiribbon.org   - against proprietary attachments

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Matthew Woehlke

Matt Domsch wrote:

On Mon, Jun 01, 2009 at 04:03:04PM -0400, Paul W. Frields wrote:

I'm getting out of my ken here, but could this be done in stages with
I2 connected hosts getting the bits early/first and then moving on to
others?


We need to move ~130GB to each of ~230 mirrors, in about 4
days.

We already have in place a limited amount of "tiering".  The Tier 0/1
mirrors get the bits first, then downstream mirrors pull from them.
We have nearly all our "Tier 1" mirrors on I2 (all but the
us.kernel.org).  Right now it's not mandatory, but no "new" mirrors
(those signed up in the last 18 months or so) have been granted ACL
permissions to download from the masters.

http://fedoraproject.org/wiki/Infrastructure/Mirroring/Tiering

One of my hopes for the F12 cycle is that we will have increased use
of tiering and push mirroring.


What about dropping hierarchical mirroring altogether? Why hasn't 
someone developed a distributed (i.e. bittorrent-like) system for mass 
mirroring? :-)


--
Matthew
Please do not quote my e-mail address unobfuscated in message bodies.
--
Congratulations! You've won a free trip to the future! All you have to 
do to claim your prize is wait five minutes...


--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Björn Persson
Jesse Keating wrote:
> On Mon, 2009-06-01 at 20:56 -0500, Bruno Wolff III wrote:
> > Do you hard link the new release files to the ones identical in rawhide
> > so that rsync doesn't have to transfer them to places mirroring rawhide?
>
> Yes and no.  We do use hardlinks, however the mechanism that gets it
> from PHX to Raleigh is Netapp snapmirror, which works at the block
> level.  I don't know enough about snapmirror to know if it is helped by
> hardlinks or not.  The individual files aren't the real problem, it's
> the isos, particularly the live isos.

A program similar to Jigdo could speed this up. Transfer only the RPM packages 
(taking advantage of hard links) and information on what packages are in each 
ISO image, and then recreate the ISO images at the destination. That way each 
package would only be transferred once, regardless of how many ISO images it 
occurs in.

Björn Persson


signature.asc
Description: This is a digitally signed message part.
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Thorsten Leemhuis
On 02.06.2009 00:22, Matt Domsch wrote:
> On Mon, Jun 01, 2009 at 04:03:04PM -0400, Paul W. Frields wrote:
>> I'm getting out of my ken here, but could this be done in stages with
>> I2 connected hosts getting the bits early/first and then moving on to
>> others?
> We need to move ~130GB to each of ~230 mirrors, in about 4
> days.

I'd like to question these numbers. All the SRPMS (18 GByte) and RPMS
(20 GByte per arch) of a new release are in the rawhide trees already --
thus if they are hardlinked properly then they can be transferred in a
minute or two. The install CD and DVD images (~ 8 GByte each per arch?)
are bigger, but if we get RC with the final name transferred to the
mirrors ahead of time then they can be updated relative quickly as well,
as only a few bit change.

The spins that get compressed are a problem. But we only send Desktop
and KDE spins to the mirrors for x86-32 and x86-64 afaics -- so roughly
3 GByte in total.

So 3 GByte + some other random stuff that changed  -- install.img,
boot.iso, and some other things. Not sure how much that will sum up to,
but can't sum up to that much -- maybe 3 or 5 more GByte.

Let's say it are 10 GBtyte. It afaics shouldn't take more then a day if
all mirrors look out for new stuff at least every 4 hours and have a
link that isn't slow by todays standards.

Or what am I missing?

Cu
knurd

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Thorsten Leemhuis
On 01.06.2009 21:50, Adam Williamson wrote:
> On Mon, 2009-06-01 at 19:49 +0200, Thorsten Leemhuis wrote:
>> - should we set an way earlier freezes date for things like anaconda,
>> kernel, isolinux, grub and other crucial pieces to make sure they are
>> in
>> better shape a bit earlier and thus are less likely a reason for
>> release
>> slips?
> If you're basing this off the F11 cycle, it's worth noting that kernel
> and anaconda have not been 'reasons for release slips' in this cycle in
> that late changes were made to them which turned out to be bad ideas.

I know, but:

> It
> was simply that there were bugs in them all along which were critical
> enough to block the release. An earlier freeze date would not have
> helped at all.

It might have helped to find the problem earlier -- I for example got
the impression that a lot of people had problems with the storage
rewrite and thus aborted their tests with Alpha or Beta.

CU
knurd

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-06-02 Thread Thorsten Leemhuis
On 01.06.2009 20:14, Jesse Keating wrote:
> On Mon, 2009-06-01 at 19:49 +0200, Thorsten Leemhuis wrote:
>> On 29.05.2009 22:57, Jesse Keating wrote:

Thx for your reply and sorry, I didn't found time to answer earlier.
Some more comments:

[...]
>> - how about reducing the number or zero day updates (which is ridiculous
>> high for F11) by setting a different, later freeze date for all packages
>> that are neither on the install DVD or on a Spin?
> That's a bit hard to determine easily and programaticaly.  I've all but
> given up on my quest to reduce the number of updates. 

Just a general comment, not relevant for the "Announcing Fedora Activity
Day". I'm glad that you gave up that quest, as "Fedora gets lot's of
updates" is afaics a reason why a lot people actually use or contribute
to Fedora. But that doesn't matter much. What I really want to say:

I totally agree with this:

> It's just doesn't
> seem to be in line with the desires of the package maintainers, whether
> or not it's in line with the desires of (some of) the project leaders.

It IMHO shows a big and more and more pressing problem in Fedora:
Packagers and leadership are not working towards the same direction.

Anyway, back to topic:

>> - other distributions seems to manage a whole lot more test releases
>> (e.g. alphas, beta, RC, milestones, ...) per devel cycle; is that
>> something we should aim for as well?
> If there was a way to do it without adding stress and work needed to
> teams like releng, installer, etc.. [...]

One comment: *from a outside* it often looks a bit like
- some (not all) people go crazy for weeks or months and ignore some of
those bugs that are not pressing, but nevertheless pressing (e.g. kind
of bugs that tend to land on target or blocker tracker bugs or already
are there)
- then you send a reminder "there will be a a test release next week"
- people suddenly wake up and try to fix those bugs for the test release
- they notice: arghh, serious things are broken, we need more time; can
we please slip?
- we slip

Maybe more target dates where people should "get things into shape"
might help to reduce the work for the real test/final releases.

>> - how about doing something like a "cp -l development devel-snapshot"
>> now and then (once a week) when we know rawhide is mostly working?
> The rawhide trees for at least the past month are kept in the Fedora
> infrastructure and are even available by a public url.  We haven't
> tagged any of them as "stable" though.

They are afaics way to far away/way to slow to reach to do a proper
network install in an acceptable period of time (at least from Germany).
Is rsync available -- I'm not aware of it, so I doubt it?

>> - how can we reduce our time between finishing a (test) release and
>> releasing it dramatically? It seems other distributions get new (test)
>> release out to the users a lot quicker then the three to five days days
>> we require, which seems a whole lot for a devel cycle that takes 180
>> days in total (and we all know how much rawhide can move on with a few days)
> If we didn't care to let the mirrors sync up we could "release" it
> earlier. However what good does that do when nobody can /get/ to the
> release because none of the mirrors have it, and the ones that do can't
> help sync to those that don't because users are tying up all the
> bandwidth?

I didn't say to not care. But maybe shorten the time we wait for them
and help to get the bits out more quickly; pushing users to use
bittorrent more might help a lot as well.

>> - I'd be glad if we could stick to our release targets a lot better.
>> Delaying releases looks quite unprofessional. Delaying also creates
>> trouble for those depending on our releases. Take computer magazines
>> (which have hard deadlines for productions) that might want to ship with
>> a new release on a CD or DVD together with the next issue -- due to our
>> fame in missing deadlines it seems to me that we are a lot more
>> unattractive than Ubuntu (which afaics is on the shelf's here in Germany
>> with new computer magazines just a few days after it has been released)
> What looks more unprofessional?  Delaying the release, or hitting our
> date and releasing with bugs that eat people's data?  Or releasing with
> broken graphics for large swaths of users?

I think you drifted a bit way to far away and into a opposition without
need. I for example nowhere said that we should not slip if there is a
strong reason to. But my comment was quite open, so it's partly my
fault; so let me rephrase:

What is rel-eng doing in the next devel cycle to make sure we slip less
then we used to in the past? Or does rel-eng think everything was fine
and missing three and a half target dates (alpha, beta,
release and the first slipped release target date) out of four is
acceptable?

>> - why do we have to slip by a whole week most of the time? can't we find
>> ways to slip just a day or two if there really is no way around a delay?
> The marke

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-05-29 Thread inode0
On Fri, May 29, 2009 at 3:57 PM, Jesse Keating  wrote:
> We're announcing a Fedora Activity day coming up very very soon
> (apologies for the short notice).  This activity day is for maintainers,
> QA, and release engineering folks to meet and discuss ongoing issues
> with the Fedora Development Cycle and to create a proposal on how to fix
> many of the issues.  Note, this is not an event to decide on a solution,
> it is an event to decide on a proposal, which will then be shared with
> the whole community for more input and work.
>
> ... snip ...

Jesse,

I just want to wish you guys a great and productive FAD.

I hope it inspires other community members to look for opportunities
within the parts of the project they work on to organize their own
FADs in the future.

If a group of folks in Docs or Art or Infra or whatever could get
something important done faster/better by getting together in the same
place please do it. If you think you have a good idea but are
uncertain how to make it happen feel free to ping your friendly
neighborhood ambassador and we'd be happy to help you get the ball
rolling.

John

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-05-29 Thread Jesse Keating
On Fri, 2009-05-29 at 16:43 -0500, Adam Miller wrote:
> On the wiki page is says that the Budget will be used for certain
> attendees "Flights, Hotel, Transportation to/from
> airport/hotel/office/food" I was just curious how that list of
> attendees who's bill will be taken care of is/was decided upon?

We invited a couple members specifically to this event, and those folks
will be covered.  I organized the event and wanted specific people
there, and got the funding for those people.  I think that's how FADs
are going to work, somebody has an idea, organizes it and decides (with
help of the Fedora Community Action Team) who is funded.

-- 
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating


signature.asc
Description: This is a digitally signed message part
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-05-29 Thread Adam Miller
On the wiki page is says that the Budget will be used for certain
attendees "Flights, Hotel, Transportation to/from
airport/hotel/office/food" I was just curious how that list of
attendees who's bill will be taken care of is/was decided upon?

-Adam


-- 
http://maxamillion.googlepages.com
-
()  ascii ribbon campaign - against html e-mail
/\  www.asciiribbon.org   - against proprietary attachments

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Announcing Fedora Activity Day - Fedora Development Cycle 2009

2009-05-29 Thread Jesse Keating
We're announcing a Fedora Activity day coming up very very soon
(apologies for the short notice).  This activity day is for maintainers,
QA, and release engineering folks to meet and discuss ongoing issues
with the Fedora Development Cycle and to create a proposal on how to fix
many of the issues.  Note, this is not an event to decide on a solution,
it is an event to decide on a proposal, which will then be shared with
the whole community for more input and work.

The timing of this is very short, so that we may have a chance at
changing something within the Fedora 12 development cycle.  Funding for
the event was only confirmed a day or two ago, hence the late notice.
If unable to attend (which most will be) but highly interested in
helping with the process, we will be attempting to setup a Fedora Talk
conference room to use throughout the event, as well as an IRC channel.
We'll try to blog the process as well and gather feedback to be used
during the event.

If you will be able to attend in person, please add your name to the
wiki page [1] so that we can properly plan the space needed within RHT.

While the wiki page says that the page is still under construction, the
dates are solid, the hours during the day are mostly solid, and the
location (one of the RHT buildings) is solid.

Please feel free to use the discussion page on the wiki to express your
thoughts about the event and what problems you're having with the
development cycle.  Even thoughts on the initial proposal I drew up at
the bottom of the wiki page would be welcome, although I do believe that
this event will result in a proposal different from what is currently
listed.

Again we apologize for the short notice!

[1]:
https://fedoraproject.org/wiki/Fedora_Activity_Day_Fedora_Development_Cycle_2009
-- 
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating


signature.asc
Description: This is a digitally signed message part
___
Fedora-devel-announce mailing list
fedora-devel-annou...@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-announce-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list