Re: [Wireshark-dev] Intermittent Builder Windows Petri Dish x64 failed (failed ctest) failures seriously annoying.

2020-07-02 Thread Gerald Combs
The failures don't appear to be limited to the test steps. Earlier we had the 
following cluster of failures:

x86 builder:

BranchBuild Step   StartStop
master 1680 ctest   08:38:1809:02:45
master-3.2  365 ctest   08:27:0208:55:58
master-3.0  133 WiX pkg 07:56:0408:16:38
master-2.6  221 NSIS pkg07:43:5908:05:01

x64 builder:

BranchBuild Step   StartStop
master 1604 ctest   08:22:5808:47:45
master-3.2  369 ctest   08:24:0908:48:15
master-3.0  322 NSIS pkg07:36:1407:57:08
master-2.6  212 WiX pkg 07:35:2307:59:54

Each builder is an EC2 instance at AWS, and the AWS console shows that the CPU 
on each instance was 100% during that time. The obvious fix is more and/or 
faster Windows builders), but I also noticed that tshark does more work than it 
should in many cases. If I open Process Monitor and set the filters

- Operation contains "Process Create"
- Path contains ""

and run test/test.py, procmon shows that we create 5573 process for 576 tests. 
For the decryption suite,  procmon shows 970 processes for 89 tests. Most of 
the created decryption processes are extcaps, which seems odd for those 
particular tests. If I rename the extcap directory, procmon shows that 97 
process are created and the suite runs much more quickly (50s vs 93s).

On 7/2/20 8:02 AM, Graham Bloice wrote:
> The tests are run all in parallel, and I'm not sure if the PD is a spot or 
> reserved instance which might affect available CPU cycles.
> 
> On Thu, 2 Jul 2020 at 15:58, Dario Lombardo  > wrote:
> 
> You're right, it's not the test I pointed out. However it worked fine 
> before, then I would check the host to see if it's suffering.
> 
> On Thu, Jul 2, 2020 at 4:51 PM Graham Bloice  > wrote:
> 
> The decryption test might need a bigger timeout, currently at 600 
> seconds:
> 
> 9/34 Test #3: suite_decryption ...***Timeout 
> 630.47 sec
> 
> 
> On Thu, 2 Jul 2020 at 15:39, Anders Broman via Wireshark-dev 
> mailto:wireshark-dev@wireshark.org>> wrote:
> 
> Hi,
> 
> We have intermittent false petri dish failures. Can someone with 
> insight into the tests have a look?
> 
> Best regards
> 
> Anders
> 
> Example Builder Windows Petri Dish x64 failed (failed ctest) - 
> http://buildbot.wireshark.org/petri-dish/builders/Windows%20Petri%20Dish%20x64/builds/11913
> 
> 
> 
> -- 
> 
> Naima is online.
> 
> 
> 
> 
> -- 
> Graham Bloice
> 
> ___
> Sent via:Wireshark-dev mailing list 
> Archives:https://www.wireshark.org/lists/wireshark-dev
> Unsubscribe: https://www.wireshark.org/mailman/options/wireshark-dev
>  mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
> 

___
Sent via:Wireshark-dev mailing list 
Archives:https://www.wireshark.org/lists/wireshark-dev
Unsubscribe: https://www.wireshark.org/mailman/options/wireshark-dev
 mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe

Re: [Wireshark-dev] Intermittent Builder Windows Petri Dish x64 failed (failed ctest) failures seriously annoying.

2020-07-02 Thread Graham Bloice
The tests are run all in parallel, and I'm not sure if the PD is a spot or
reserved instance which might affect available CPU cycles.

On Thu, 2 Jul 2020 at 15:58, Dario Lombardo  wrote:

> You're right, it's not the test I pointed out. However it worked fine
> before, then I would check the host to see if it's suffering.
>
> On Thu, Jul 2, 2020 at 4:51 PM Graham Bloice 
> wrote:
>
>> The decryption test might need a bigger timeout, currently at 600 seconds:
>>
>> 9/34 Test  #3: suite_decryption ...***Timeout 630.47 sec
>>
>>
>> On Thu, 2 Jul 2020 at 15:39, Anders Broman via Wireshark-dev <
>> wireshark-dev@wireshark.org> wrote:
>>
>>> Hi,
>>>
>>> We have intermittent false petri dish failures. Can someone with insight
>>> into the tests have a look?
>>>
>>> Best regards
>>>
>>> Anders
>>>
>>> Example Builder Windows Petri Dish x64 failed (failed ctest) -
>>> http://buildbot.wireshark.org/petri-dish/builders/Windows%20Petri%20Dish%20x64/builds/11913
>>>
>>
>>
> --
>
> Naima is online.
>
>
>

-- 
Graham Bloice
___
Sent via:Wireshark-dev mailing list 
Archives:https://www.wireshark.org/lists/wireshark-dev
Unsubscribe: https://www.wireshark.org/mailman/options/wireshark-dev
 mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe

Re: [Wireshark-dev] Intermittent Builder Windows Petri Dish x64 failed (failed ctest) failures seriously annoying.

2020-07-02 Thread Dario Lombardo
You're right, it's not the test I pointed out. However it worked fine
before, then I would check the host to see if it's suffering.

On Thu, Jul 2, 2020 at 4:51 PM Graham Bloice 
wrote:

> The decryption test might need a bigger timeout, currently at 600 seconds:
>
> 9/34 Test  #3: suite_decryption ...***Timeout 630.47 sec
>
>
> On Thu, 2 Jul 2020 at 15:39, Anders Broman via Wireshark-dev <
> wireshark-dev@wireshark.org> wrote:
>
>> Hi,
>>
>> We have intermittent false petri dish failures. Can someone with insight
>> into the tests have a look?
>>
>> Best regards
>>
>> Anders
>>
>> Example Builder Windows Petri Dish x64 failed (failed ctest) -
>> http://buildbot.wireshark.org/petri-dish/builders/Windows%20Petri%20Dish%20x64/builds/11913
>>
>
> --
> Graham Bloice
> ___
> Sent via:Wireshark-dev mailing list 
> Archives:https://www.wireshark.org/lists/wireshark-dev
> Unsubscribe: https://www.wireshark.org/mailman/options/wireshark-dev
>  mailto:wireshark-dev-requ...@wireshark.org
> ?subject=unsubscribe



-- 

Naima is online.
___
Sent via:Wireshark-dev mailing list 
Archives:https://www.wireshark.org/lists/wireshark-dev
Unsubscribe: https://www.wireshark.org/mailman/options/wireshark-dev
 mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe

Re: [Wireshark-dev] Intermittent Builder Windows Petri Dish x64 failed (failed ctest) failures seriously annoying.

2020-07-02 Thread Dario Lombardo
This looks to be the failing test

9: test_s_lt_2 (suite_dfilter.group_integer.case_integer) ... ok
 9/34 Test  #3: suite_decryption ...***Timeout 630.47 sec
test 12
  Start 12: suite_dfilter.group_membership

It fails for timeout. Looking at the code of the test itself it looks
very straight forward:

def test_s_lt_2(self, checkDFilterCount):
dfilter = "ntp.precision < 245"
checkDFilterCount(dfilter, 0)

Basically this test opens a file and checks that the number of
filtered packets is 0. Not a really hard test. Since the test fails
for timeout, and moreover intermittently, I would say that the builder
host is suffering. Can someone with shell access check if the host is
running fine?


On Thu, Jul 2, 2020 at 4:39 PM Anders Broman via Wireshark-dev <
wireshark-dev@wireshark.org> wrote:

> Hi,
>
> We have intermittent false petri dish failures. Can someone with insight
> into the tests have a look?
>
> Best regards
>
> Anders
>
> Example Builder Windows Petri Dish x64 failed (failed ctest) -
> http://buildbot.wireshark.org/petri-dish/builders/Windows%20Petri%20Dish%20x64/builds/11913
> ___
> Sent via:Wireshark-dev mailing list 
> Archives:https://www.wireshark.org/lists/wireshark-dev
> Unsubscribe: https://www.wireshark.org/mailman/options/wireshark-dev
>  mailto:wireshark-dev-requ...@wireshark.org
> ?subject=unsubscribe



-- 

Naima is online.
___
Sent via:Wireshark-dev mailing list 
Archives:https://www.wireshark.org/lists/wireshark-dev
Unsubscribe: https://www.wireshark.org/mailman/options/wireshark-dev
 mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe

Re: [Wireshark-dev] Intermittent Builder Windows Petri Dish x64 failed (failed ctest) failures seriously annoying.

2020-07-02 Thread Graham Bloice
The decryption test might need a bigger timeout, currently at 600 seconds:

9/34 Test  #3: suite_decryption ...***Timeout 630.47 sec


On Thu, 2 Jul 2020 at 15:39, Anders Broman via Wireshark-dev <
wireshark-dev@wireshark.org> wrote:

> Hi,
>
> We have intermittent false petri dish failures. Can someone with insight
> into the tests have a look?
>
> Best regards
>
> Anders
>
> Example Builder Windows Petri Dish x64 failed (failed ctest) -
> http://buildbot.wireshark.org/petri-dish/builders/Windows%20Petri%20Dish%20x64/builds/11913
>

-- 
Graham Bloice
___
Sent via:Wireshark-dev mailing list 
Archives:https://www.wireshark.org/lists/wireshark-dev
Unsubscribe: https://www.wireshark.org/mailman/options/wireshark-dev
 mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe

[Wireshark-dev] Intermittent Builder Windows Petri Dish x64 failed (failed ctest) failures seriously annoying.

2020-07-02 Thread Anders Broman via Wireshark-dev
Hi,

We have intermittent false petri dish failures. Can someone with insight
into the tests have a look?

Best regards

Anders

Example Builder Windows Petri Dish x64 failed (failed ctest) -

http://buildbot.wireshark.org/petri-dish/builders/Windows%20Petri%20Dish%20x
64/builds/11913



smime.p7s
Description: S/MIME cryptographic signature
___
Sent via:Wireshark-dev mailing list 
Archives:https://www.wireshark.org/lists/wireshark-dev
Unsubscribe: https://www.wireshark.org/mailman/options/wireshark-dev
 mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe