Re: Switching the tracker to git

2014-09-16 Thread Michael Gilbert
On Mon, Sep 15, 2014 at 1:48 PM, Florian Weimer wrote:
> The tracker currently uses Subverion's mixed-revision working copies.
> It only updates the data automatically not the code.  This could be
> preserved by splitting code and data at conversion time.  This split
> alone might be worth the conversion.

Let's make sure to call the new repository something better, like
security-tracker, since there has been confusion often enough with
secure-testing, since so much more than that is supported.

Best wishes,
Mike


-- 
To UNSUBSCRIBE, email to debian-security-tracker-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
https://lists.debian.org/CANTw=mo9nseqsw_zexde9ce8d8gazvve1quptfby+xzv_8x...@mail.gmail.com



Re: Switching the tracker to git

2014-09-15 Thread Salvatore Bonaccorso
Hi,

On Mon, Sep 15, 2014 at 07:15:18AM +0200, Salvatore Bonaccorso wrote:
> When converting the svn repository to git also a author name list
> needs to be created just before making the move[1]. I was involved in
> such a project for the Debian Perl Group svn to git conversion moving
> ~2000 packages in one svn repo to git. It is simpler here! :). Just
> after the security team meeting I did an unofficial PoC for this, so
> can confirm this works. We had a little amount of disussion about
> this, but this unforunately part of it happend on the team alias
> email, so was not public. I never went further ahead.
> 
>  [1] http://git-scm.com/book/en/Git-and-Other-Systems-Migrating-to-Git
> 
> http://anonscm.debian.org/cgit/collab-maint/secure-testing.git/.git/
> is a start, but the repository needs to be properly converted by
> generating an svn author list.

Based on a modified version of the scripts we used for the pkg-perl
case I have generated the attached AUTHORS.txt.xz list. I will commit
the two scripts needed when happy so they can be used for this step
when we will be at that stage.

For -guest accounts it tries to detect the email to use from
https://alioth.debian.org/users/$author.

Regards,
Salvatore


AUTHORS.txt.xz
Description: Binary data


Re: Switching the tracker to git

2014-09-15 Thread Florian Weimer
> My guess is that the only reason that subversion is still used is
> inertia and that people would be happier with git. However, I'm curious
> to know if anyone thinks otherwise?

For releasing security advisories, we need the centralized repository
to gurantuee uniqness of DSA numbers.

I'm also worried that people will make more local commits without
pushing immediately, duplicating work.  But perhaps these concerns are
unfounded.

The tracker currently uses Subverion's mixed-revision working copies.
It only updates the data automatically not the code.  This could be
preserved by splitting code and data at conversion time.  This split
alone might be worth the conversion.


-- 
To UNSUBSCRIBE, email to debian-security-tracker-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: https://lists.debian.org/87a960rd0f@mid.deneb.enyo.de



Re: Switching the tracker to git

2014-09-15 Thread Holger Levsen
Hi,

On Montag, 15. September 2014, Thijs Kinkhorst wrote:
> > What would be the actual benefits of moving to Git and I'm not talking

git log, git show, git stash and git branch and cherry-pick...!!

Working with a decentralized and fast(!) version control system locally is 
so much more fun + effective, the difference is hard to imagine if you 
haven't experienced it yourself.

> Some points of attention:

I've updated org/TODO now with the points raised by Salvatore and Thijs.

Just one thing made me suspicious:

> - Two main non-human use of svn are the joeyh commit script and the
> tracker itself.

the "two main"?? Are there others? Currently this part of TODO reads:

Security Tracker svn to git conversion
 - TBD: add here the todo items to be considered for the move
   * joeyh's commit script needs to be adopted to git
*  When fixing the joeyh one, I think it makes sense to move it to a role
   account on alioth (as previously discussed), rather than this personal
   account, at the same time.
   * the tracker itself needs to be adopted
   * There's also a very useful pre-commit hook that checks syntax of commits 
to data/*. This is something that also would need a place somewhere.
   * the sectracker user is subscribed to the commits mailinglists, and the 
commit messages trigger updates of the tracker.
   * http://security-team.debian.org is updated from svn, needs to be 
switched, should be simple
   * debsecan?


cheers,
Holger


signature.asc
Description: This is a digitally signed message part.


Re: Switching the tracker to git

2014-09-15 Thread Salvatore Bonaccorso
Hi

I forgot about two more points: One is the sectracker user is
subscribed to the commits mailinglists, and the commit messages
trigger updates of the tracker.

The other thing, the svn checkout is also used for
http://security-team.debian.org, but this should be a simple case.

I will add all items to be considered - and which comes to my mind -
for a svn to git migration into

org/TODO

Please add there further todos!

Hope that helps anybody who wants to volunteer for that.

Regards,
Salvatore


-- 
To UNSUBSCRIBE, email to debian-security-tracker-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: https://lists.debian.org/20140915110031.ga32...@lorien.valinor.li



Re: Switching the tracker to git

2014-09-15 Thread Thijs Kinkhorst
On Mon, September 15, 2014 07:33, Henri Salo wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> On Sun, Sep 14, 2014 at 07:06:46PM -0400, micah wrote:
>> My guess is that the only reason that subversion is still used is
>> inertia and that people would be happier with git. However, I'm curious
>> to know if anyone thinks otherwise?
>
> In my experience Git also takes more time per commit if we are talking
> about making branches and/or pull requests.

I think this will be the cases we're not going to use (much).

> What would be the actual benefits of moving to Git and I'm not talking
> about some minor speed improvements. Please
> also note that there are hooks in SVN currently and I'm not sure if those
> can be migrated to Git.

Speed improvements, further standardisation within Debian on git so less
tools for new people to learn, ability to work offline (limited use with
the daily flow, but may be useful for some cases) are some good reasons.

I believe at the very least git will not make the situation worse for
current routine use.

> I'm more than happy to discuss this case in detail and even help to
> implement it if/when team starts to move that direction.

Michael's statement is spot on: there's no objection to such migration but
as svn didn't pose huge problems yet it hasn't been a priority.

I would say that if someone wants to do the work, just do it (as long as
you keep everyone informed of course).

Some points of attention:
- Two main non-human use of svn are the joeyh commit script and the
tracker itself.
- When fixing the joeyh one, I think it makes sense to move it to a role
account on alioth (as previously discussed), rather than this personal
account, at the same time.
- There's also a very useful pre-commit hook that checks syntax of commits
to data/*. This is something that also would need a place somewhere.


Cheers,
Thijs


-- 
To UNSUBSCRIBE, email to debian-security-tracker-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
https://lists.debian.org/9d2213b15251d7f4a20801a7c5d3aae7.squir...@aphrodite.kinkhorst.nl



Re: Switching the tracker to git

2014-09-14 Thread Henri Salo
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Sun, Sep 14, 2014 at 07:06:46PM -0400, micah wrote:
> My guess is that the only reason that subversion is still used is
> inertia and that people would be happier with git. However, I'm curious
> to know if anyone thinks otherwise?

In my experience Git also takes more time per commit if we are talking about
making branches and/or pull requests. What would be the actual benefits of
moving to Git and I'm not talking about some minor speed improvements. Please
also note that there are hooks in SVN currently and I'm not sure if those can be
migrated to Git.

I'm more than happy to discuss this case in detail and even help to implement it
if/when team starts to move that direction.

- ---
Henri Salo
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.12 (GNU/Linux)

iEYEARECAAYFAlQWehsACgkQXf6hBi6kbk85kACgpTjcLWEXY8EHeqPvuCQbhs25
KX8AoKZWcUybX/NOYRTavwp3tyR4TTX6
=rNOU
-END PGP SIGNATURE-


-- 
To UNSUBSCRIBE, email to debian-security-tracker-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: https://lists.debian.org/20140915053315.ga19...@kludge.henri.nerv.fi



Re: Switching the tracker to git

2014-09-14 Thread Salvatore Bonaccorso
Hi Micah,

On Sun, Sep 14, 2014 at 07:06:46PM -0400, micah wrote:
> 
> Hello,
> 
> As it stands now, the security tracker is using subversion. 
> 
> Here are the facts as far as I can tell:
> 
> . people doing work on the tracker are using svn to commit
> . h01ger is doing a regular git-svn import of the tracker repository
> . there is a regular cron job run by joeyh that does the automatic updates:
>   joeyh r28744 data/CVE/list * automatic update
> . the web interface probably has some automated process to pull the
> latest updates over svn
> 
> My guess is that the only reason that subversion is still used is
> inertia and that people would be happier with git. However, I'm curious
> to know if anyone thinks otherwise?
> 
> I don't exactly have the time right now to volunteer for changing
> things, but I thought that the first step would be to see what people
> thought, and then maybe if it was clear what people's preferences were,
> perhaps someone might volunteer!

Yep basically it was the following: We discussed this at the security
team meeting were agreein on switching to git but it is not moving
forward due to lack of time and volunteers. But also it is not only
the repository but some components around which need to be considered,
as you pointed out above.

When converting the svn repository to git also a author name list
needs to be created just before making the move[1]. I was involved in
such a project for the Debian Perl Group svn to git conversion moving
~2000 packages in one svn repo to git. It is simpler here! :). Just
after the security team meeting I did an unofficial PoC for this, so
can confirm this works. We had a little amount of disussion about
this, but this unforunately part of it happend on the team alias
email, so was not public. I never went further ahead.

 [1] http://git-scm.com/book/en/Git-and-Other-Systems-Migrating-to-Git

http://anonscm.debian.org/cgit/collab-maint/secure-testing.git/.git/
is a start, but the repository needs to be properly converted by
generating an svn author list.

joeyh's cronjob needs to be moved to the role account which we have
now already. Raphael Geisert requested it.

The setup on soler (the security-tracker.d.o hosting host) will also
need adjustment to the conversion before we would go live (cronjobs,
checkouts triggered by commit mails, ...). The setup
there relies on the svn checkout right now, it is documented in the
soler.txt file in the repository.

SVN hooks needs to be convered. E.g. the one which does some sanity
check as precommit.

One other point we wanted to do (see the minutes from the meeting,
should be documented there) in one go was to rename the project from
secure-testing to something else, since it is long already not about
secure-testing. But this probably could be split. I have asked for
this alioth admins how easily we could rename an existing project to
something else, but have not got a reply on this.

Ah yes there is also
https://contributors.debian.org/source/Debian%20Security%20Tracker :)

It is in my pov good to move to git, There are some aspects which need
to be considered before the move, as we absolutely need to have a
working security-tracker instance for the security team's work. Work
was relatively hard and stalled in some parts when alioth wen down as
a example.

Regards,
Salvatore


-- 
To UNSUBSCRIBE, email to debian-security-tracker-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: https://lists.debian.org/20140915051518.ga26...@lorien.valinor.li



Re: Switching the tracker to git

2014-09-14 Thread Michael Gilbert
On Sun, Sep 14, 2014 at 7:06 PM, micah  wrote:
>
> Hello,
>
> As it stands now, the security tracker is using subversion.
>
> Here are the facts as far as I can tell:
>
> . people doing work on the tracker are using svn to commit
> . h01ger is doing a regular git-svn import of the tracker repository
> . there is a regular cron job run by joeyh that does the automatic updates:
>   joeyh r28744 data/CVE/list * automatic update
> . the web interface probably has some automated process to pull the
> latest updates over svn
>
> My guess is that the only reason that subversion is still used is
> inertia and that people would be happier with git. However, I'm curious
> to know if anyone thinks otherwise?

There has been discussion of switching to git for a while now.  Last
security team meeting it was decided to stay with svn since no one
volunteered to lead conversion to get.  So if someone volunteered for
that, it could happen.

Best wishes,
Mike


-- 
To UNSUBSCRIBE, email to debian-security-tracker-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
https://lists.debian.org/CANTw=MNWp8WeL8ScC5Ai7r+kn0e_v=tles0yebfexctqnn2...@mail.gmail.com