Re: [Scons-dev] Bugtracker and stuff...

2014-05-08 Thread Dirk Bächle

Hi all,

On 05.05.2014 02:45, Dirk Bächle wrote:

On 05.05.2014 02:01, William Deegan wrote:

Do we know the specs of the server pair is providing us with?
roundup suggests mysql or postgressql for database.
Need be we can put roundup on the same server as buildbot.

I’ve installed and customized bugzilla for many many clients, so if 
you like I can take a whack at this.
Cool, just go ahead...I won't mind. In the meantime I'll try to figure 
out how to push attachments via xmlrpc.


I now have a first version of a Tigris-roundup importer ready, please 
find the Python script attached. It's not perfect, but I could 
successfully import all current 2947 issues into a roundup demo 
instance running locally on my machine.

The things that get properly imported are:

- users, issues, attached files, single messages, keywords

. Most attributes like priority, status and assigned to get set, 
so I think it's at least good enough to setup a demo server for 
testing out roundup with our tracker database.


Some things are missing (can't get copied):

- The last activity time for an issue, as well as the upload time 
for files are protected items in the database. So, the timeline of 
events gets skewed in some places. It might be possible to correct this 
by exporting the database again in CSV/JSON (roundup itself offers this 
for migration to newer versions), manipulating the data, and then 
importing again. I haven't looked further into this...anyone cares to 
give it a try?
- I'm not sure what to do with depends on and duplicate of 
information. Roundup has a superseder list field, but the meaning of 
it isn't clear (has no intentional meaning). So we may have to come up 
with something ourselves...
- Currently no passwords are set for added users, so they can't login. 
We could set the username as password too?



For my test I used the following steps:

1.)  Download the Tigris bugs in XML format with

  python import_tigris.py files scons import

2.) Start a local roundup demo (in virtualenv) with

  env/bin/python demo.py nuke

3.) Push data to roundup via xmlrpc

  python import_tigris.py push 
http://admin:admin@localhost:8917/demo/xmlrpc import


There is also a short usage description at the start of the script. For 
testing purposes you might want to move all except the first XML file 
(1.xml) from the import folder to a safe place. Pushing all the issues 
took about 3 hours on my side. ;)



Best regards,

Dirk




roundup_tigris_import.tgz
Description: application/compressed-tar
___
Scons-dev mailing list
Scons-dev@scons.org
http://two.pairlist.net/mailman/listinfo/scons-dev


Re: [Scons-dev] Bugtracker and stuff...

2014-05-04 Thread Dirk Bächle

On 04.05.2014 14:29, Gary Oberbrunner wrote:

On Sun, May 4, 2014 at 7:38 AM, Dirk Bächle tshor...@gmx.de wrote:

[...]

This is a great start.  Thanks for doing it!  My preference would be a
hosted bugtracker though, just because it's one less thing to manage
(keep patched, ensure uptime etc.).  Also, a minor point, but people
may have more familiarity with the big hosted ones.
On the other hand, roundup is used by python.org and 
openhatch.org...which is where some new contributors might come from in 
the future.



Now, that said, I
don't really have much experience with any of them that I like.  So if
roundup is nice, hosting it ourselves wouldn't be all that terrible.
I'm pretty sure Pair, our current host, can do mod_python.
Maybe it would be worth the try to setup a demo instance of roundup. 
We could run it in some kind of read-only mode, updating its data from 
the Tigris tracker time to time.
Just to get a better feeling for the tool...although I'm pretty sure 
that it beats Tigris' Issuezilla easily.
I mean, we can't list all of our bugs/issues currently...because we have 
more than 500 entries? Were not in the 80s anymore. ;)



Ideally we'd have a stable tracker so we could put bug links into
commit messages, and mailing lists, and they'd still work 10 years
from now.  But that may be an impossible dream. :-)

As for #2739, I see I was involved in that.  I tried to get the OP to
write a test but that apparently was pushing a little too hard for him
at the time.  I guess I should take it.  The batch-mode fixes in there
are quite valuable.


We have a lot of good patches and enhancements pending in the issue 
list, and my impression is that they've been rotting there much too long 
now. With a better overview this wouldn't have happened...but it's 
probably also the communication from the BugParties that's missing and 
playing a role here.


Dirk

___
Scons-dev mailing list
Scons-dev@scons.org
http://two.pairlist.net/mailman/listinfo/scons-dev


Re: [Scons-dev] Bugtracker and stuff...

2014-05-04 Thread Gary Oberbrunner
On Sun, May 4, 2014 at 9:15 AM, Dirk Bächle tshor...@gmx.de wrote:
 On 04.05.2014 14:29, Gary Oberbrunner wrote:

 On Sun, May 4, 2014 at 7:38 AM, Dirk Bächle tshor...@gmx.de wrote:

 [...]

 This is a great start.  Thanks for doing it!  My preference would be a
 hosted bugtracker though, just because it's one less thing to manage
 (keep patched, ensure uptime etc.).  Also, a minor point, but people
 may have more familiarity with the big hosted ones.

 On the other hand, roundup is used by python.org and openhatch.org...which
 is where some new contributors might come from in the future.

Ah, didn't know that.  That helps make the decision.  I just looked at
the python.org tracker and the bug pages are pretty easy to read.  The
search page is ugly but functional (much more so than ours).  And I
like the languishing status idea.

 Now, that said, I
 don't really have much experience with any of them that I like.  So if
 roundup is nice, hosting it ourselves wouldn't be all that terrible.
 I'm pretty sure Pair, our current host, can do mod_python.

 Maybe it would be worth the try to setup a demo instance of roundup. We
 could run it in some kind of read-only mode, updating its data from the
 Tigris tracker time to time.

This should be pretty easy I think, presuming its dependencies are not
too onerous.  Dirk, do you have access to the web server?  If not, I
can get you access (send me your ssh pub key off-list) or I can try to
set up the demo.  (Note that we do NOT have root access on our server,
but many tools work with locally-installed dependencies these days.)

 Just to get a better feeling for the tool...although I'm pretty sure that it
 beats Tigris' Issuezilla easily.
 I mean, we can't list all of our bugs/issues currently...because we have
 more than 500 entries? Were not in the 80s anymore. ;)

Yeah, seriously.  Along with that I really hate the Tigris bug-tracker
interface.  It is so needlessly complicated and hard to work with.
It's not even easy to _find_ it from the main tigris project page.

 Ideally we'd have a stable tracker so we could put bug links into
 commit messages, and mailing lists, and they'd still work 10 years
 from now.  But that may be an impossible dream. :-)

 As for #2739, I see I was involved in that.  I tried to get the OP to
 write a test but that apparently was pushing a little too hard for him
 at the time.  I guess I should take it.  The batch-mode fixes in there
 are quite valuable.


 We have a lot of good patches and enhancements pending in the issue list,
 and my impression is that they've been rotting there much too long now. With
 a better overview this wouldn't have happened...but it's probably also the
 communication from the BugParties that's missing and playing a role here.

Yes, you're right about that too.  My impression is that we're doing
OK handling pull requests, so we're getting good input from the
community there, but we're falling even further behind on bug triage.
Bug parties are definitely part of that.  Who knows, a more attractive
and easy-to-use tracker might well make it easy enough to triage that
we could make more progress with the limited amount of person-hours we
have.

-- 
Gary
___
Scons-dev mailing list
Scons-dev@scons.org
http://two.pairlist.net/mailman/listinfo/scons-dev


Re: [Scons-dev] Bugtracker and stuff...

2014-05-04 Thread Dirk Bächle

On 04.05.2014 15:49, Gary Oberbrunner wrote:

[...]

Maybe it would be worth the try to setup a demo instance of roundup. We
could run it in some kind of read-only mode, updating its data from the
Tigris tracker time to time.

This should be pretty easy I think, presuming its dependencies are not
too onerous.  Dirk, do you have access to the web server?  If not, I
can get you access (send me your ssh pub key off-list) or I can try to
set up the demo.  (Note that we do NOT have root access on our server,
but many tools work with locally-installed dependencies these days.)
I don't have access to the web server yet. Before sending you my public 
key, I'd like to give other devs a chance to jump in. Setting up a bug 
tracker is certainly an interesting task, but I don't have to be all 
over the place with SCons. ;)


Dirk


___
Scons-dev mailing list
Scons-dev@scons.org
http://two.pairlist.net/mailman/listinfo/scons-dev


Re: [Scons-dev] Bugtracker and stuff...

2014-05-04 Thread Russel Winder
On Sun, 2014-05-04 at 09:49 -0400, Gary Oberbrunner wrote:
[…]
 Yeah, seriously.  Along with that I really hate the Tigris bug-tracker
 interface.  It is so needlessly complicated and hard to work with.
 It's not even easy to _find_ it from the main tigris project page.
[…]

As you may remember, I have been ranting against the Tigris issue system
for a while. It violates so many HCI good tenets and practices, it is no
wonder to me that every time I think SCons Issue I immediately think
Oh f###. And not in a good sense.

-- 
Russel.
=
Dr Russel Winder  t: +44 20 7585 2200   voip: sip:russel.win...@ekiga.net
41 Buckmaster Roadm: +44 7770 465 077   xmpp: rus...@winder.org.uk
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

___
Scons-dev mailing list
Scons-dev@scons.org
http://two.pairlist.net/mailman/listinfo/scons-dev


Re: [Scons-dev] Bugtracker and stuff...

2014-05-04 Thread Dirk Bächle

On 04.05.2014 20:31, Russel Winder wrote:

On Sun, 2014-05-04 at 09:49 -0400, Gary Oberbrunner wrote:
[…]

Yeah, seriously.  Along with that I really hate the Tigris bug-tracker
interface.  It is so needlessly complicated and hard to work with.
It's not even easy to _find_ it from the main tigris project page.

[…]

As you may remember, I have been ranting against the Tigris issue system
for a while. It violates so many HCI good tenets and practices, it is no
wonder to me that every time I think SCons Issue I immediately think
Oh f###. And not in a good sense.


Russel.told_you_so_karma += 10

:)

___
Scons-dev mailing list
Scons-dev@scons.org
http://two.pairlist.net/mailman/listinfo/scons-dev


Re: [Scons-dev] Bugtracker and stuff...

2014-05-04 Thread Dirk Bächle

On 05.05.2014 02:01, William Deegan wrote:

Do we know the specs of the server pair is providing us with?
roundup suggests mysql or postgressql for database.
Need be we can put roundup on the same server as buildbot.

I’ve installed and customized bugzilla for many many clients, so if you like I 
can take a whack at this.
Cool, just go ahead...I won't mind. In the meantime I'll try to figure 
out how to push attachments via xmlrpc.


Dirk

___
Scons-dev mailing list
Scons-dev@scons.org
http://two.pairlist.net/mailman/listinfo/scons-dev