@pshepherd, @bpa

I believe that it is the inclusion of the fragment suffix -#extra- in
the GET request to the BBC Server that is causing the trouble. I'll
guess that the BBC servers perhaps no longer tolerate it.

Modern versions of -wget-, -curl-, and browsers seem to routinely strip
this off before sending the GET request.

I do not remember how LMS, or the relevant CPAN module(s) that it uses,
operates in this regard. However I have just scanned a wireshark dump of
a BBCiPlayer Extras fetch of the Radio 5 live availability schedule, and
there is no -#extra- fragment suffix in the URL sent by the GET request.
This is in contrast to @pshepherd's wireshark dump, which clearly does.
I have no explanation for the difference between us at present. I am
running LMS 7.9.3 on a Debian system.

It would need some more investigation to see precisely how LMS is
working. One point to note is that the URL that LMS caches content
against does include the fragment suffix, and this would be needed. But
I'm not sure what happens in detail lower down.

DNS does not seem to be the issue. I get identical/similar -dig- results
as does @pshepherd. I am in the UK.

You can test the point using netcat. (Troublesome, needs a couple of
presses of the enter key to make it work).

Works without the fragment suffix:


Code:
--------------------
    
  netcat -C www.bbc.co.uk 80
  HEAD /radio/aod/availability/bbc_radio_three.xml HTTP/1.0
  Connection: close
  Cache-Control: no-cache
  Accept: */*
  Accept-Encoding: deflate, gzip
  Accept-Language: en
  Host: www.bbc.co.uk
  User-Agent: Mozilla/5.0 (Linux; N; Debian; x86_64-linux; EN; utf8) 
SqueezeCenter, Squeezebox Server, Logitech Media Server/7.9.2/1578996832
  Icy-MetaData:
  
  HTTP/1.1 200 OK
  Date: Tue, 28 Jul 2020 15:33:13 GMT
  Content-Type: application/xml
  Content-Length: 200363
  Connection: close
  nel: 
{"report_to":"default","max_age":2592000,"include_subdomains":true,"failure_fraction":0.01}
  X-Cache-Action: HIT
  X-Cache-Hits: 5
  Cache-Control: public, max-age=7200
  X-Cache-Age: 6260
  report-to: 
{"group":"default","max_age":2592000,"endpoints":[{"url":"https://europe-west1-bbc-otg-traf-mgr-bq-prod-4591.cloudfunctions.net/report-endpoint","priority":1}],"include_subdomains":true}
  ETag: "368cae0a967baf6f71a489b98440535a"
  req-svc-chain: GTM,VTM,VARNISH
  x-amz-id-2: 
r8a8h97ofaRE/cwNZGVeVaFUxyFomzoO6INur35X/z/eVk+isLnrVQq9jyll7plOoGz09RrhQvU=
  x-origin-route: xrt-ostore
  Last-Modified: Tue, 28 Jul 2020 13:08:47 GMT
  x-amz-request-id: AD9FF9A48D9A04EE
  via: 1.0 BBC-GTM
  X-BBC-Edge-Cache-Status: HIT
  Server: BBC-GTM
  
--------------------


But fails with the fragment suffix:

Code:
--------------------
    
  netcat -C www.bbc.co.uk 80
  HEAD /radio/aod/availability/bbc_radio_three.xml#extra HTTP/1.0
  Connection: close
  Cache-Control: no-cache
  Accept: */*
  Accept-Encoding: deflate, gzip
  Accept-Language: en
  Host: www.bbc.co.uk
  User-Agent: Mozilla/5.0 (Linux; N; Debian; x86_64-linux; EN; utf8) 
SqueezeCenter, Squeezebox Server, Logitech Media Server/7.9.2/1578996832
  Icy-MetaData:
  
  HTTP/1.1 404 Not Found
  Date: Tue, 28 Jul 2020 15:34:27 GMT
  Content-Type: text/html; charset=utf-8
  Content-Length: 36238
  Connection: close
  nel: 
{"report_to":"default","max_age":2592000,"include_subdomains":true,"failure_fraction":0.01}
  X-Cache-Action: PASS (no-cache-control)
  X-Cache-Age: 0
  report-to: 
{"group":"default","max_age":2592000,"endpoints":[{"url":"https://europe-west1-bbc-otg-traf-mgr-bq-prod-4591.cloudfunctions.net/report-endpoint","priority":1}],"include_subdomains":true}
  ETag: "5d6e3712-8d8e"
  req-svc-chain: GTM,VTM,VARNISH
  x-origin-route: xrt-errdoc
  x-backend-status: 404
  via: 1.0 BBC-GTM
  X-BBC-Edge-Cache-Status: MISS
  X-BBC-Origin-Response-Status: 404
  Server: BBC-GTM
  
--------------------


------------------------------------------------------------------------
mrw's Profile: http://forums.slimdevices.com/member.php?userid=38299
View this thread: http://forums.slimdevices.com/showthread.php?t=109826

_______________________________________________
plugins mailing list
plugins@lists.slimdevices.com
http://lists.slimdevices.com/mailman/listinfo/plugins

Reply via email to