Re: [Bacula-users] regression testing - more volunteers wanted

[Dan Langille]

> On Apr 17, 2021, at 14:22, Andrea Venturoli  wrote:
> 
> On 4/17/21 2:14 PM, Dan Langille wrote:
> 
>> Looking at 
>> https://regress.bacula.org/index.php?project=Bacula-9.6=2021-04-07
>> I consistently get errors on langille_mysql57_bacula but not the others.
>> By all means, post to the developers channel if you get consistent failures. 
>> It is vital that they at least know the tests are failing.
>> I have noticed for a while that I'm regression testing Bacula-9.6 - 
>> eventually I should move to or add Bacula-11.0.
>> Thank you.
> 
> Thanks for your answer.
> 
> See https://regress.bacula.org/index.php?project=Bacula-11.0
> 
> (Notice I moved from FreeBSD 11 to 12).

There’s a good point. My regression testing is done in FreeBSD jails. I should 
install FreeBSD 11.4 jails as well. I hope to update the host to FreeBSD 13 
soon. Then I’ll copy the existing regression jails to new jails & update them 
to FreeBSD 13. Then we’ll have good coverage on all current versions of 
FreeBSD. 

> Shouldn't the developer see all from here?

Perhaps. Posting a regression failure over on the devs list is a good idea 
though. It is the dev mailing list & a regression test failure is a dev issue. 

Between us both, FreeBSD should be well covered. 


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Andrea Venturoli]

On 4/17/21 2:14 PM, Dan Langille wrote:


Looking at 
https://regress.bacula.org/index.php?project=Bacula-9.6=2021-04-07

I consistently get errors on langille_mysql57_bacula but not the others.

By all means, post to the developers channel if you get consistent failures. It 
is vital that they at least know the tests are failing.

I have noticed for a while that I'm regression testing Bacula-9.6 - eventually 
I should move to or add Bacula-11.0.

Thank you.



Thanks for your answer.

See https://regress.bacula.org/index.php?project=Bacula-11.0

(Notice I moved from FreeBSD 11 to 12).

Shouldn't the developer see all from here?

 bye
av.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Dan Langille]

On Thu, Apr 8, 2021, at 6:29 AM, Andrea Venturoli wrote:
> On 3/21/21 2:48 PM, Dan Langille wrote:
> 
> Hello.
> 
> > More diversity in OS versions is a goal. At present, only FreeBSD is 
> > consistently represented.
> 
> While we are at it, I'm one of those representing FreeBSD :)
> Since I moved my tests to version 11, I'm getting a few persistent failures:
> > The following tests FAILED:
> >  69 - disk:file-span-vol-test (Failed)
> >  85 - disk:backup-bacula-test (BAD_COMMAND)
> >  88 - disk:bconsole-test (Failed)
> > 172 - disk:truncate-test (Failed)
> 
> Should I investigate better? Report something in some way? Or is the 
> automatic posting of results enough?

Looking at 
https://regress.bacula.org/index.php?project=Bacula-9.6=2021-04-07

I consistently get errors on langille_mysql57_bacula but not the others.

By all means, post to the developers channel if you get consistent failures. It 
is vital that they at least know the tests are failing.

I have noticed for a while that I'm regression testing Bacula-9.6 - eventually 
I should move to or add Bacula-11.0.

Thank you.

-- 
  Dan Langille
  d...@langille.org


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Andrea Venturoli]

On 3/21/21 2:48 PM, Dan Langille wrote:

Hello.


More diversity in OS versions is a goal. At present, only FreeBSD is 
consistently represented.


While we are at it, I'm one of those representing FreeBSD :)
Since I moved my tests to version 11, I'm getting a few persistent failures:

The following tests FAILED:
 69 - disk:file-span-vol-test (Failed)
 85 - disk:backup-bacula-test (BAD_COMMAND)
 88 - disk:bconsole-test (Failed)
172 - disk:truncate-test (Failed)


Should I investigate better? Report something in some way? Or is the 
automatic posting of results enough?


 bye & Thanks
av.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Martin Simmons]

> On Thu, 25 Mar 2021 09:42:07 +0100, Radosław Korzeniewski said:
> 
> śr., 24 mar 2021 o 17:46 Adolf Belka (gmail) 
> napisał(a):
> 
> >File "/home/ahb/sandbox/bacula/regress/./endtime", line 16
> >  print 'Total time = %d:%02d:%02d or %d secs' % (h, m, sec, t -
> > float(s))
> >^
> > SyntaxError: invalid syntax
> >
> >
> The "endtime" file is a Python 2 script which does not work with Python 3.

That is easy to fix with parens around the arguments:

print('Total time = %d:%02d:%02d or %d secs' % (h, m, sec, t - float(s)))

__Martin


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Adolf Belka (gmail)]

Hi Radoslaw,

Sent from my Desktop Computer

On 25/03/2021 09:42, Radosław Korzeniewski wrote:

Hello,

śr., 24 mar 2021 o 17:46 Adolf Belka (gmail) mailto:adolf.be...@gmail.com>> napisał(a):

   File "/home/ahb/sandbox/bacula/regress/./endtime", line 16
 print 'Total time = %d:%02d:%02d or %d secs' % (h, m, sec, t - 
float(s))
   ^
SyntaxError: invalid syntax


The "endtime" file is a Python 2 script which does not work with Python 3.


I have both python2 and python3 installed but the command python is linked to 
python3 so that explains the message.

I can live with it as it is. It doesn't happen with the nightly_disk script and 
that is the one I am now using for my regression testing input.

Thanks for the feedback.

Adolf.


best regards
--
Radosław Korzeniewski
rados...@korzeniewski.net 



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Radosław Korzeniewski]

Hello,

śr., 24 mar 2021 o 17:46 Adolf Belka (gmail) 
napisał(a):

>File "/home/ahb/sandbox/bacula/regress/./endtime", line 16
>  print 'Total time = %d:%02d:%02d or %d secs' % (h, m, sec, t -
> float(s))
>^
> SyntaxError: invalid syntax
>
>
The "endtime" file is a Python 2 script which does not work with Python 3.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Adolf Belka (gmail)]

Hi Dan,

Sent from my Desktop Computer

On 24/03/2021 15:29, Dan Langille wrote:

On Tue, Mar 23, 2021, at 8:26 AM, Adolf Belka (gmail) wrote:

Hi All,

Found the README.ctest file and the CDashboard url. Have successfully
run the experimental-disk script and the results have got onto the
CDashboard.

So everything seems to be working well except that the bacula configure
script does not recognise Arch Linux.

Looking at 
http://regress.bacula.org/index.php?project=Bacula-9.6=2021-03-24 I see

9.6.7-10Dec20-mysql-unknown-unknown

Are you referring to 'unknown-unknown' where as other results have 
'freebsd-12.2-RELEASE-p4'?


Yes, that is what I am referring to together with the line in the checking part 
of configure output

 === Something went wrong. Unknown DISTNAME archlinux ===

The distribution version will always be unknown because Arch Linux is a rolling 
release and does not have a version number.

Regards,

Adolf.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Adolf Belka (gmail)]

Hi Dan,

Sent from my Desktop Computer

On 24/03/2021 15:27, Dan Langille wrote:

On Mon, Mar 22, 2021, at 8:23 AM, Adolf Belka (gmail) wrote:

Hi All,

I have run the regression tests and had a couple of failures. One of
those disappeared after re-running the test. The other I have re-run
with debug set and saved the output to a file. I also had a syntax error
from the regression script itself right at the end for the total time
printing.

What was the error?


  = End three-pool-disk OK 20:16:18 00:00:59 59s =
  = End 2drive-3pool-test OK 20:17:41 00:00:59 59s =
  = End 2drive-swap-test OK 20:19:14 00:01:09 69s =
End non-root virtual disk autochanger tests
End do_file tests
  File "/home/ahb/sandbox/bacula/regress/./endtime", line 16
    print 'Total time = %d:%02d:%02d or %d secs' % (h, m, sec, t - float(s))
  ^
SyntaxError: invalid syntax


I think this was at the end of running make test but it might have been from 
running ./do_disk, I can't remember any more.

However this error does not occur when I am running the ./experimental_disk or 
./nightly_disk.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Dan Langille]

On Mon, Mar 22, 2021, at 8:23 AM, Adolf Belka (gmail) wrote:
> Hi All,
> 
> I have run the regression tests and had a couple of failures. One of 
> those disappeared after re-running the test. The other I have re-run 
> with debug set and saved the output to a file. I also had a syntax error 
> from the regression script itself right at the end for the total time 
> printing.

What was the error?


-- 
  Dan Langille
  d...@langille.org


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Dan Langille]

On Tue, Mar 23, 2021, at 8:26 AM, Adolf Belka (gmail) wrote:
> Hi All,
> 
> Found the README.ctest file and the CDashboard url. Have successfully 
> run the experimental-disk script and the results have got onto the 
> CDashboard.
> 
> So everything seems to be working well except that the bacula configure 
> script does not recognise Arch Linux.

Looking at 
http://regress.bacula.org/index.php?project=Bacula-9.6=2021-03-24 I see

9.6.7-10Dec20-mysql-unknown-unknown

Are you referring to 'unknown-unknown' where as other results have 
'freebsd-12.2-RELEASE-p4'?

-- 
  Dan Langille
  d...@langille.org


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Adolf Belka (gmail)]

Hi All,

Found the README.ctest file and the CDashboard url. Have successfully 
run the experimental-disk script and the results have got onto the 
CDashboard.


So everything seems to be working well except that the bacula configure 
script does not recognise Arch Linux.


Regards,

Adolf.

On 22/03/2021 13:23, Adolf Belka (gmail) wrote:

Hi All,

I have run the regression tests and had a couple of failures. One of 
those disappeared after re-running the test. The other I have re-run 
with debug set and saved the output to a file. I also had a syntax 
error from the regression script itself right at the end for the total 
time printing.


Do I provide the debug output to this users list or to the devel list 
or where? I couldn't find any clue in the regression testing link.



Thanks

Adolf


On 21/03/2021 16:21, Adolf Belka (gmail) wrote:

Hi Dan,

Thanks for the note. I had been thinking for a while about trying 
regression testing and your email got me over the edge to do something.


So followed the link and followed the instructions, which were very 
clear and helpful, and I have a disk only regression test ongoing on 
my Arch Linux x86_64 system.


Thanks very much.

Adolf Belka.

Sent from my Desktop Computer

On 21/03/2021 14:48, Dan Langille wrote:

Hello

Members of project communities often wonder how they can contribute 
without coding.


I have one suggestion: regression testing.

More diversity in OS versions is a goal. At present, only FreeBSD is 
consistently represented. That's not enough. Your OS should be there 
too.With daily regression testing on a wide variety of operating 
systems and versions, changes to code which introduce regressions in 
behavior can be quickly caught. Catching them early is key to 
getting them fixed.


It is not difficult to set up and it run automatically. No special 
skills required. If you are running Bacula

now, this is an easy way for you to contribute to the community.

The testing is run as non-root and requires no special privileges. I 
run my testing under my own login.


In my setup, I create a dedicated host (in a FreeBSD jail for this) 
but that is not required. The resources

required are not great.

Details at 
https://www.bacula.org/11.0.x-manuals/en/developers/Bacula_Regression_Testing.html



--
Sent from my laptop.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Adolf Belka (gmail)]

Hi All,

I have run the regression tests and had a couple of failures. One of 
those disappeared after re-running the test. The other I have re-run 
with debug set and saved the output to a file. I also had a syntax error 
from the regression script itself right at the end for the total time 
printing.


Do I provide the debug output to this users list or to the devel list or 
where? I couldn't find any clue in the regression testing link.



Thanks

Adolf


On 21/03/2021 16:21, Adolf Belka (gmail) wrote:

Hi Dan,

Thanks for the note. I had been thinking for a while about trying 
regression testing and your email got me over the edge to do something.


So followed the link and followed the instructions, which were very 
clear and helpful, and I have a disk only regression test ongoing on 
my Arch Linux x86_64 system.


Thanks very much.

Adolf Belka.

Sent from my Desktop Computer

On 21/03/2021 14:48, Dan Langille wrote:

Hello

Members of project communities often wonder how they can contribute 
without coding.


I have one suggestion: regression testing.

More diversity in OS versions is a goal. At present, only FreeBSD is 
consistently represented. That's not enough. Your OS should be there 
too.With daily regression testing on a wide variety of operating 
systems and versions, changes to code which introduce regressions in 
behavior can be quickly caught. Catching them early is key to getting 
them fixed.


It is not difficult to set up and it run automatically. No special 
skills required. If you are running Bacula

now, this is an easy way for you to contribute to the community.

The testing is run as non-root and requires no special privileges. I 
run my testing under my own login.


In my setup, I create a dedicated host (in a FreeBSD jail for this) 
but that is not required. The resources

required are not great.

Details at 
https://www.bacula.org/11.0.x-manuals/en/developers/Bacula_Regression_Testing.html



--
Sent from my laptop.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] regression testing - more volunteers wanted

[Adolf Belka (gmail)]

Hi Dan,

Thanks for the note. I had been thinking for a while about trying regression 
testing and your email got me over the edge to do something.

So followed the link and followed the instructions, which were very clear and 
helpful, and I have a disk only regression test ongoing on my Arch Linux x86_64 
system.

Thanks very much.

Adolf Belka.

Sent from my Desktop Computer

On 21/03/2021 14:48, Dan Langille wrote:

Hello

Members of project communities often wonder how they can contribute without 
coding.

I have one suggestion: regression testing.

More diversity in OS versions is a goal. At present, only FreeBSD is 
consistently represented. That's not enough. Your OS should be there too.With 
daily regression testing on a wide variety of operating systems and versions, 
changes to code which introduce regressions in behavior can be quickly caught. 
Catching them early is key to getting them fixed.

It is not difficult to set up and it run automatically. No special skills 
required. If you are running Bacula
now, this is an easy way for you to contribute to the community.

The testing is run as non-root and requires no special privileges. I run my 
testing under my own login.

In my setup, I create a dedicated host (in a FreeBSD jail for this) but that is 
not required. The resources
required are not great.

Details at 
https://www.bacula.org/11.0.x-manuals/en/developers/Bacula_Regression_Testing.html




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] regression testing - more volunteers wanted

[Dan Langille]

Hello,

Members of project communities often wonder how they can contribute without 
coding.

I have one suggestion: regression testing.

More diversity in OS versions is a goal. At present, only FreeBSD is 
consistently represented. That's not enough. Your OS should be there too.With 
daily regression testing on a wide variety of operating systems and versions, 
changes to code which introduce regressions in behavior can be quickly caught. 
Catching them early is key to getting them fixed.

It is not difficult to set up and it run automatically. No special skills 
required. If you are running Bacula
now, this is an easy way for you to contribute to the community.

The testing is run as non-root and requires no special privileges. I run my 
testing under my own login.

In my setup, I create a dedicated host (in a FreeBSD jail for this) but that is 
not required. The resources
required are not great.

Details at 
https://www.bacula.org/11.0.x-manuals/en/developers/Bacula_Regression_Testing.html

-- 
Dan Langille
d...@langille.org




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users