Re: [RDD] Riv 3.0 scrolls through logs after 3 days

[Fred Gleason]

On Fri, 2019-05-17 at 09:06 -0500, Tom Van Gorkom wrote:
> Running a series of about 20 logs in a loop, RDairplay runs fine for
> about 3 days at a time and then starts scrolling rapidly through each
> log. I have to force quit RDairplay and restart it again. I re-
> generated all of the logs to make sure there were no issues with them
> and started in different places with the same result. The same setup
> with Riv 2.19 and CentOS 6 on identical hardware works flawlessly.
> What might be causing this?

I suspect that I've found the cause. It's a race condition that can
cause caed(8) to crowbar incoming TCP connections. It seems to manifest
fairly rarely on x86_64 architecture, but manifests much more often in
some others --e.g. armv5tel.

Working on a fix right now...

Cheers!


|-|
| Frederick F. Gleason, Jr. | Chief Developer |
|   | Paravel Systems |
|-|
| A room without books is like a body without a soul. |
| |
| -- Cicero   |
|-|

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] Riv 3.0 scrolls through logs after 3 days

[Patrick Linstruth]

Would you be able to post some of the log from when it’s scrolling? Maybe we 
can see something.

Sent from my iPhone

> On May 18, 2019, at 9:24 AM, Brian McGlynn  
> wrote:
> 
> I see the same thing on Jack and Alsa.  This just appeared in RC1 and RC2.  
> 
> I looked in the CAED logs, and I did not see more than 2 streams being used.  
> The mount is also fine. 
> 
> To make it work again, I need to reset all of the Rivendell daemons.  When I 
> try to play otherwise, it does not show VU meters. 
> 
> I’ll dig more next time it stops. 
> 
> 
>> On Sat, May 18, 2019 at 11:41 Tom Van Gorkom  wrote:
>> Mine is a standalone using livewire driver. 
>> 
>>> On Sat, May 18, 2019, 10:15 AM Rick  wrote:
>>> Also starts scrolling at high speed when connection to storage or nas is 
>>> unexpectedly lost,  using network-manager solves it
>>> 
>>> 
>>> 
>>> Verzonden vanaf mijn Samsung-apparaat
>>> 
>>> 
>>>  Oorspronkelijk bericht 
>>> Van: Patrick Linstruth  
>>> Datum: 18-05-2019 15:18 (GMT+01:00) 
>>> Aan: "Brian P. McGlynn"  
>>> Cc: rivendell-dev@lists.rivendellaudio.org 
>>> Onderwerp: Re: [RDD] Riv 3.0 scrolls through logs after 3 days 
>>> 
>>> The only time I’ve ever seen RDAirplay race through the logs is when it 
>>> runs out of audio channels, but it indicates that fact in the logs. This 
>>> happened when our ASI card was set to 4 channels instead of 12.
>>> 
>>> Patrick
>>> 
>>>> On May 17, 2019, at 5:37 PM, Brian P. McGlynn 
>>>>  wrote:
>>>> 
>>>> I see the same behaviour on RC2.  I have to restart the daemons to get it 
>>>> to work. 
>>>> 
>>>> I looked through the logs, and nothing was obvious. 
>>>> 
>>>> Sent from my iPad
>>>> 
>>>>> On May 17, 2019, at 10:06, Tom Van Gorkom  wrote:
>>>>> 
>>>>> Using Riv 3.0 with CentOS 7 with the Livewire driver on a standalone for 
>>>>> both testing and a backup audio source if the automation goes quiet...
>>>>> 
>>>>> Running a series of about 20 logs in a loop, RDairplay runs fine for 
>>>>> about 3 days at a time and then starts scrolling rapidly through each 
>>>>> log. I have to force quit RDairplay and restart it again. I re-generated 
>>>>> all of the logs to make sure there were no issues with them and started 
>>>>> in different places with the same result. The same setup with Riv 2.19 
>>>>> and CentOS 6 on identical hardware works flawlessly. What might be 
>>>>> causing this?
>>>>> 
>>>>> Tom Van Gorkom
>>>>> Radio Esperanza Engineering, KRIO AM/FM, KOIR FM
>>>>> Office: 956-380-8150   
>>>>> Cell: 865-803-7427
>>>>> 
>>>>> Rio Grande Bible Institute
>>>>> 4300 S US Hwy 281
>>>>> Edinburg, TX 78539
>>>>> ___
>>>>> Rivendell-dev mailing list
>>>>> Rivendell-dev@lists.rivendellaudio.org
>>>>> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>>>> ___
>>>> Rivendell-dev mailing list
>>>> Rivendell-dev@lists.rivendellaudio.org
>>>> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>>> 
>>> ___
>>> Rivendell-dev mailing list
>>> Rivendell-dev@lists.rivendellaudio.org
>>> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
> -- 
> --
> Brian P. McGlynn
> Genesee Media Corporation
> WOKR - 1310 & 95.5 FM
> 
> 585-785-4495 x202
> bmcgl...@geneseemedia.net
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] Riv 3.0 scrolls through logs after 3 days

[Brian McGlynn]

I see the same thing on Jack and Alsa.  This just appeared in RC1 and RC2.

I looked in the CAED logs, and I did not see more than 2 streams being
used.  The mount is also fine.

To make it work again, I need to reset all of the Rivendell daemons.  When
I try to play otherwise, it does not show VU meters.

I’ll dig more next time it stops.


On Sat, May 18, 2019 at 11:41 Tom Van Gorkom  wrote:

> Mine is a standalone using livewire driver.
>
> On Sat, May 18, 2019, 10:15 AM Rick  wrote:
>
>> Also starts scrolling at high speed when connection to storage or nas is
>> unexpectedly lost,  using network-manager solves it
>>
>>
>>
>> Verzonden vanaf mijn Samsung-apparaat
>>
>>
>>  Oorspronkelijk bericht 
>> Van: Patrick Linstruth 
>> Datum: 18-05-2019 15:18 (GMT+01:00)
>> Aan: "Brian P. McGlynn" 
>> Cc: rivendell-dev@lists.rivendellaudio.org
>> Onderwerp: Re: [RDD] Riv 3.0 scrolls through logs after 3 days
>>
>> The only time I’ve ever seen RDAirplay race through the logs is when it
>> runs out of audio channels, but it indicates that fact in the logs. This
>> happened when our ASI card was set to 4 channels instead of 12.
>>
>> Patrick
>>
>> On May 17, 2019, at 5:37 PM, Brian P. McGlynn <
>> brian.mcgl...@geneseemedia.net> wrote:
>>
>> I see the same behaviour on RC2.  I have to restart the daemons to get it
>> to work.
>>
>> I looked through the logs, and nothing was obvious.
>>
>> Sent from my iPad
>>
>> On May 17, 2019, at 10:06, Tom Van Gorkom  wrote:
>>
>> Using Riv 3.0 with CentOS 7 with the Livewire driver on a standalone for
>> both testing and a backup audio source if the automation goes quiet...
>>
>> Running a series of about 20 logs in a loop, RDairplay runs fine for
>> about 3 days at a time and then starts scrolling rapidly through each log.
>> I have to force quit RDairplay and restart it again. I re-generated all of
>> the logs to make sure there were no issues with them and started in
>> different places with the same result. The same setup with Riv 2.19 and
>> CentOS 6 on identical hardware works flawlessly. What might be causing this?
>>
>> Tom Van Gorkom
>> Radio Esperanza Engineering, KRIO AM/FM, KOIR FM
>> Office: 956-380-8150
>> Cell: 865-803-7427
>>
>> Rio Grande Bible Institute
>> 4300 S US Hwy 281
>> Edinburg, TX 78539
>>
>> ___
>> Rivendell-dev mailing list
>> Rivendell-dev@lists.rivendellaudio.org
>> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>>
>> ___
>> Rivendell-dev mailing list
>> Rivendell-dev@lists.rivendellaudio.org
>> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>>
>>
>> ___
>> Rivendell-dev mailing list
>> Rivendell-dev@lists.rivendellaudio.org
>> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>>
> --
*--*
*Brian P. McGlynn*
Genesee Media Corporation
WOKR - 1310 & 95.5 FM

585-785-4495 x202
bmcgl...@geneseemedia.net
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] Riv 3.0 scrolls through logs after 3 days

[Tom Van Gorkom]

Mine is a standalone using livewire driver.

On Sat, May 18, 2019, 10:15 AM Rick  wrote:

> Also starts scrolling at high speed when connection to storage or nas is
> unexpectedly lost,  using network-manager solves it
>
>
>
> Verzonden vanaf mijn Samsung-apparaat
>
>
>  Oorspronkelijk bericht 
> Van: Patrick Linstruth 
> Datum: 18-05-2019 15:18 (GMT+01:00)
> Aan: "Brian P. McGlynn" 
> Cc: rivendell-dev@lists.rivendellaudio.org
> Onderwerp: Re: [RDD] Riv 3.0 scrolls through logs after 3 days
>
> The only time I’ve ever seen RDAirplay race through the logs is when it
> runs out of audio channels, but it indicates that fact in the logs. This
> happened when our ASI card was set to 4 channels instead of 12.
>
> Patrick
>
> On May 17, 2019, at 5:37 PM, Brian P. McGlynn <
> brian.mcgl...@geneseemedia.net> wrote:
>
> I see the same behaviour on RC2.  I have to restart the daemons to get it
> to work.
>
> I looked through the logs, and nothing was obvious.
>
> Sent from my iPad
>
> On May 17, 2019, at 10:06, Tom Van Gorkom  wrote:
>
> Using Riv 3.0 with CentOS 7 with the Livewire driver on a standalone for
> both testing and a backup audio source if the automation goes quiet...
>
> Running a series of about 20 logs in a loop, RDairplay runs fine for about
> 3 days at a time and then starts scrolling rapidly through each log. I have
> to force quit RDairplay and restart it again. I re-generated all of the
> logs to make sure there were no issues with them and started in different
> places with the same result. The same setup with Riv 2.19 and CentOS 6 on
> identical hardware works flawlessly. What might be causing this?
>
> Tom Van Gorkom
> Radio Esperanza Engineering, KRIO AM/FM, KOIR FM
> Office: 956-380-8150
> Cell: 865-803-7427
>
> Rio Grande Bible Institute
> 4300 S US Hwy 281
> Edinburg, TX 78539
>
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>
>
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
>
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] Riv 3.0 scrolls through logs after 3 days

[Rick]

Also starts scrolling at high speed when connection to storage or nas is 
unexpectedly lost,  using network-manager solves itVerzonden vanaf mijn 
Samsung-apparaat

 Oorspronkelijk bericht 
Van: Patrick Linstruth  
Datum: 18-05-2019  15:18  (GMT+01:00) 
Aan: "Brian P. McGlynn"  
Cc: rivendell-dev@lists.rivendellaudio.org 
Onderwerp: Re: [RDD] Riv 3.0 scrolls through logs after 3 days 

The only time I’ve ever seen RDAirplay race through the logs is when it runs 
out of audio channels, but it indicates that fact in the logs. This happened 
when our ASI card was set to 4 channels instead of 12.PatrickOn May 17, 2019, 
at 5:37 PM, Brian P. McGlynn  wrote:I see the 
same behaviour on RC2.  I have to restart the daemons to get it to work. I 
looked through the logs, and nothing was obvious. Sent from my iPadOn May 17, 
2019, at 10:06, Tom Van Gorkom  wrote:Using Riv 3.0 
with CentOS 7 with the Livewire driver on a standalone for both testing and a 
backup audio source if the automation goes quiet...Running a series of about 20 
logs in a loop, RDairplay runs fine for about 3 days at a time and then starts 
scrolling rapidly through each log. I have to force quit RDairplay and restart 
it again. I re-generated all of the logs to make sure there were no issues with 
them and started in different places with the same result. The same setup with 
Riv 2.19 and CentOS 6 on identical hardware works flawlessly. What might be 
causing this?Tom Van GorkomRadio Esperanza Engineering, KRIO AM/FM, KOIR 
FMOffice: 956-380-8150   Cell: 865-803-7427Rio Grande Bible Institute4300 S US 
Hwy 281Edinburg, TX 78539
___Rivendell-dev mailing 
listRivendell-dev@lists.rivendellaudio.orghttp://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev___Rivendell-dev
 mailing 
listRivendell-dev@lists.rivendellaudio.orghttp://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] Riv 3.0 scrolls through logs after 3 days

[Patrick Linstruth]

The only time I’ve ever seen RDAirplay race through the logs is when it runs 
out of audio channels, but it indicates that fact in the logs. This happened 
when our ASI card was set to 4 channels instead of 12.

Patrick

> On May 17, 2019, at 5:37 PM, Brian P. McGlynn 
>  wrote:
> 
> I see the same behaviour on RC2.  I have to restart the daemons to get it to 
> work. 
> 
> I looked through the logs, and nothing was obvious. 
> 
> Sent from my iPad
> 
> On May 17, 2019, at 10:06, Tom Van Gorkom  > wrote:
> 
>> Using Riv 3.0 with CentOS 7 with the Livewire driver on a standalone for 
>> both testing and a backup audio source if the automation goes quiet...
>> 
>> Running a series of about 20 logs in a loop, RDairplay runs fine for about 3 
>> days at a time and then starts scrolling rapidly through each log. I have to 
>> force quit RDairplay and restart it again. I re-generated all of the logs to 
>> make sure there were no issues with them and started in different places 
>> with the same result. The same setup with Riv 2.19 and CentOS 6 on identical 
>> hardware works flawlessly. What might be causing this?
>> 
>> Tom Van Gorkom
>> Radio Esperanza Engineering, KRIO AM/FM, KOIR FM
>> Office: 956-380-8150   
>> Cell: 865-803-7427
>> 
>> Rio Grande Bible Institute
>> 4300 S US Hwy 281
>> Edinburg, TX 78539
>> ___
>> Rivendell-dev mailing list
>> Rivendell-dev@lists.rivendellaudio.org 
>> 
>> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev 
>> 
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] Riv 3.0 scrolls through logs after 3 days

[Brian P. McGlynn]

I see the same behaviour on RC2.  I have to restart the daemons to get it to 
work. 

I looked through the logs, and nothing was obvious. 

Sent from my iPad

> On May 17, 2019, at 10:06, Tom Van Gorkom  wrote:
> 
> Using Riv 3.0 with CentOS 7 with the Livewire driver on a standalone for both 
> testing and a backup audio source if the automation goes quiet...
> 
> Running a series of about 20 logs in a loop, RDairplay runs fine for about 3 
> days at a time and then starts scrolling rapidly through each log. I have to 
> force quit RDairplay and restart it again. I re-generated all of the logs to 
> make sure there were no issues with them and started in different places with 
> the same result. The same setup with Riv 2.19 and CentOS 6 on identical 
> hardware works flawlessly. What might be causing this?
> 
> Tom Van Gorkom
> Radio Esperanza Engineering, KRIO AM/FM, KOIR FM
> Office: 956-380-8150   
> Cell: 865-803-7427
> 
> Rio Grande Bible Institute
> 4300 S US Hwy 281
> Edinburg, TX 78539
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] Riv 3.0 scrolls through logs after 3 days

[Patrick Linstruth]

I’d check /var/log and see what it has to say.

Sent from my iPhone

> On May 17, 2019, at 9:05 AM, Fred Gleason  wrote:
> 
>> On Fri, 2019-05-17 at 09:06 -0500, Tom Van Gorkom wrote:
>> Running a series of about 20 logs in a loop, RDairplay runs fine for
>> about 3 days at a time and then starts scrolling rapidly through each
>> log. I have to force quit RDairplay and restart it again. I re-
>> generated all of the logs to make sure there were no issues with them
>> and started in different places with the same result. The same setup
>> with Riv 2.19 and CentOS 6 on identical hardware works flawlessly.
>> What might be causing this?
> 
> That's smelling like a resource leak of some kind. You mention that you
> have to 'force quit' RDAirplay. What happens if you attempt to quit it
> by the usual means? Is there anything else that you have to do to
> recover from this?
> 
> Cheers!
> 
> 
> |-|
> | Frederick F. Gleason, Jr. | Chief Developer |
> |   | Paravel Systems |
> |-|
> | A room without books is like a body without a soul. |
> | |
> | -- Cicero   |
> |-|
> 
> ___
> Rivendell-dev mailing list
> Rivendell-dev@lists.rivendellaudio.org
> http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

Re: [RDD] Riv 3.0 scrolls through logs after 3 days

[Fred Gleason]

On Fri, 2019-05-17 at 09:06 -0500, Tom Van Gorkom wrote:
> Running a series of about 20 logs in a loop, RDairplay runs fine for
> about 3 days at a time and then starts scrolling rapidly through each
> log. I have to force quit RDairplay and restart it again. I re-
> generated all of the logs to make sure there were no issues with them
> and started in different places with the same result. The same setup
> with Riv 2.19 and CentOS 6 on identical hardware works flawlessly.
> What might be causing this?

That's smelling like a resource leak of some kind. You mention that you
have to 'force quit' RDAirplay. What happens if you attempt to quit it
by the usual means? Is there anything else that you have to do to
recover from this?

Cheers!


|-|
| Frederick F. Gleason, Jr. | Chief Developer |
|   | Paravel Systems |
|-|
| A room without books is like a body without a soul. |
| |
| -- Cicero   |
|-|

___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev

[RDD] Riv 3.0 scrolls through logs after 3 days

[Tom Van Gorkom]

Using Riv 3.0 with CentOS 7 with the Livewire driver on a standalone for
both testing and a backup audio source if the automation goes quiet...

Running a series of about 20 logs in a loop, RDairplay runs fine for about
3 days at a time and then starts scrolling rapidly through each log. I have
to force quit RDairplay and restart it again. I re-generated all of the
logs to make sure there were no issues with them and started in different
places with the same result. The same setup with Riv 2.19 and CentOS 6 on
identical hardware works flawlessly. What might be causing this?

Tom Van Gorkom
Radio Esperanza Engineering, KRIO AM/FM, KOIR FM
Office: 956-380-8150
Cell: 865-803-7427

Rio Grande Bible Institute
4300 S US Hwy 281
Edinburg, TX 78539
___
Rivendell-dev mailing list
Rivendell-dev@lists.rivendellaudio.org
http://caspian.paravelsystems.com/mailman/listinfo/rivendell-dev