Sorry for the delayed reply I've been busy with other projects lately.


On 06/06/2018 04:38 AM, Alexander Traud wrote:
I love to help. However, before I apply your patch, I need a running
Test Suite first. In Ubuntu 18.04 LTS with branch Master, 11 test cases
fail for me, for example ASTERISK-27897. In that report you see my
concrete steps. Perhaps you spot the mistake. In Ubuntu 16.04 LTS with
branch 15.4, 30 test cases fail. 5 cases, which fail in Ubuntu 18.04 LTS
do not fail in Ubuntu 16.04 LTS. Consequently, I have still 6 cases
which fail. Is it OK, that 6 tests cannot be verified?
6 is less than I would face on my machine.  It would be very helpful to me if you could run the test again with my patch and just post your before / after asterisk-test-suite-report.xml to ASTERISK-26826 (please be sure to rename them before uploading so JIRA shows different filenames).

</wiki/display/AST/Installing+the+Asterisk+Test+Suite>
is a bit out of date.
Uhh, I hoped I had overlooked something. I knew that wiki page. The
Test Suite requires much more Python modules (see below). That Wiki
would help much more if it described the platform/version used. That
Wiki entry is Red Hat Fedora. However,
1) Which Fedora version is it exactly?
2) How are the Python modules installed (pip or package manager)?
Those two puzzle pieces would help much.
Sorry I don't know which version of Fedora the wiki is based on, I suspect it's been updated a few times.

asttest [is] not compatible with current versions of Lua.
Yes, it does not work with Lua 5.3 or 5.2 and still requires 5.1.
If you have to install [SIPp] from source please download the latest
version, not 3.4.1.
Because I want support for SIP-over-TLS in Ubuntu, I had to go for the
source. However, even the latest SIPp release, I had to patch for
OpenSSL 1.1.x. By the way, do you know why this 'greater 3.4.1'
requirement is not reflected by any dependency check:
$ ./runtests.py --list-tests
I'm not sure.  Really event the current 'master' unreleased version of sipp has at least one bug-fix that has impacted the asterisk.org jenkins server.  I'm not aware of any situation where running a newer version of sipp causes a problem.
Some additional python modules needed:
autobahn, lxml, construct, netifaces, pyxb.
... plus numpy, requests, twisted, and yaml. For construct, I had to go
for construct.legacy and patch four files: ASTERISK-27893.
Thanks for looking into these and for the patches you've posted recently.

skipped due to each dependency.
Puh. I was able to reduce everything to 3 missing dependencies: remote,
statsd, and rtpdump. Although I was able to install rtpdump, my variant
did not take a parameter 'd': ASTERISK-27080. Another 3 tests fail
and I have no idea why:
- tests/masquerade,
- tests/hep/rtcp-sender, and
- tests/hep/rtcp-receiver.
Consequently, 6 cases cannot be tested for regressions.

a full testsuite run is required to verify no errors. I do not have
adequate hardware
By the way, what exactly do you mean by this? Perhaps, I face the same
issue.

I'm working off a laptop which gets hotter than I'd like by running the testsuite.  I routinely face lock-up of the testsuite run where I'll have to kill a process before things will progress.  If you've got it down to only 6 tests that cannot pass it would be very helpful to see the list of regressions plus the list of 6 tests where regressions could not be checked.

--
_____________________________________________________________________
-- Bandwidth and Colocation Provided by http://www.api-digital.com --

asterisk-dev mailing list
To UNSUBSCRIBE or update options visit:
  http://lists.digium.com/mailman/listinfo/asterisk-dev

Reply via email to