Re: [mythtv-users] tv_grab_au which script?

2005-08-07 Thread Sammo
Michael, could you please clarify the example duplicate config entry for me?

#''ABC ACT' = 'act.abc.gov.au'
#$duplicate = {
#   'act.abc.gov.au' = { 'ABC HD'   = 'hd.abc.gov.au',
# 'ABC CHAN 22'  = '22.abc.gov.au' },
#   'eastern.sbs.com.au' = { 'SBS HD' = 'hd.eastern.sbs.com.au' }
#};

'ABC ACT' is the corresponding channel title of the tv guide.

Why is 'ABC HD' and 'ABC CHAN 22' needed? They don't correspond with
the channel titles of the tv guide. Can those values be set to an
arbitary string?

Thanks heaps,

Sammo
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-07 Thread Michael Smith

Sammo wrote:


Michael, could you please clarify the example duplicate config entry for me?

#'ABC ACT' = 'act.abc.gov.au'
#$duplicate = {
#   'act.abc.gov.au' = { 'ABC HD'   = 'hd.abc.gov.au',
# 'ABC CHAN 22'  = '22.abc.gov.au' },
#   'eastern.sbs.com.au' = { 'SBS HD' = 'hd.eastern.sbs.com.au' }
#};

'ABC ACT' is the corresponding channel title of the tv guide.

Why is 'ABC HD' and 'ABC CHAN 22' needed? They don't correspond with
the channel titles of the tv guide. Can those values be set to an
arbitary string?


Yes. When used with mythtv I don't imagine these values will be used at 
all --- you can set them to anything you want as long as they are unique 
within a given pair of braces.


I put them in there just in case(TM). The XML file produced by 
tv_grab_au has channel definitions of the form


channel id=act.abc.gov.au
  display-name lang=enABC ACT/display-name
/channel

and it seemed reasonable to allow users to change the name used in the 
duplicated versions of these. That may actually be useful to someone 
using the script with programs other than mythtv (not that I know of 
anyone doing that).


Certainly,

 'act.abc.gov.au' = { '1' = 'hd.abc.gov.au', '2' = '22.abc.gov.au' }

would be a reasonable form. If there are enough complaints I'll happily 
reconsider this decision(*).


Cheers,
Michael.


(*) originally I just had something like this:

  $duplicate = {
'act.abc.gov.au' = [ 'hd.abc.gov.au', '22.abc.gov.au' ]
  }

___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-06 Thread Sammo
On 8/6/05, Brian May [EMAIL PROTECTED] wrote:
  Sammo == Sammo  [EMAIL PROTECTED] writes:
 
 Sammo Not sure if this has been dealt with before. Is it possible
 Sammo to repeat program info for multiple channels. For example,
 Sammo I want the same guide info for channel 7 and 70.
 
 Sammo   'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.7.d1.com.au',
 Sammo 'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.70.d1.com.au',
 
 Sammo Is this possible? Would it work?
 
 Why not give both entries the same xmltv ID, e.g.
 freesd.Sydney.7.d1.com.au?
 
 The xmltv ID doesn't have to be unique for every channel.

Does this work for you?

When I give both channels the same xmltv ID, only one of the channels
gets the listing added 
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-06 Thread Michael Smith

Sammo wrote:

On 8/6/05, Brian May [EMAIL PROTECTED] wrote:


Sammo == Sammo  [EMAIL PROTECTED] writes:


   Sammo Not sure if this has been dealt with before. Is it possible
   Sammo to repeat program info for multiple channels. For example,
   Sammo I want the same guide info for channel 7 and 70.

   Sammo   'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.7.d1.com.au',
   Sammo 'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.70.d1.com.au',

   Sammo Is this possible? Would it work?

Why not give both entries the same xmltv ID, e.g.
freesd.Sydney.7.d1.com.au?

The xmltv ID doesn't have to be unique for every channel.



Does this work for you?


I tried it. It didn't work (although, arguably, it should have).

Current tv_grab_au http://www.immir.com/tv_grab_au can duplicate 
listing info.


Cheers,
Michael.
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-06 Thread Sammo
On 8/7/05, Michael Smith [EMAIL PROTECTED] wrote:
 Sammo wrote:
  On 8/6/05, Brian May [EMAIL PROTECTED] wrote:
 
 Sammo == Sammo  [EMAIL PROTECTED] writes:
 
 Sammo Not sure if this has been dealt with before. Is it possible
 Sammo to repeat program info for multiple channels. For example,
 Sammo I want the same guide info for channel 7 and 70.
 
 Sammo   'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.7.d1.com.au',
 Sammo 'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.70.d1.com.au',
 
 Sammo Is this possible? Would it work?
 
 Why not give both entries the same xmltv ID, e.g.
 freesd.Sydney.7.d1.com.au?
 
 The xmltv ID doesn't have to be unique for every channel.
 
 
  Does this work for you?
 
 I tried it. It didn't work (although, arguably, it should have).
 
 Current tv_grab_au http://www.immir.com/tv_grab_au can duplicate
 listing info.

Great, I'll give it a try.

I'm currently using the other tv_grab_au script. The xmltv ids are
in the format freesd.Sydney.7.d1.com.au instead of
sydney.seven.com.au  which format is better? is there a
standard way of constructing xmltv ids?? please discuss  ..
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-06 Thread Michael Smith



I'm currently using the other tv_grab_au script. The xmltv ids are
in the format freesd.Sydney.7.d1.com.au instead of
sydney.seven.com.au  which format is better? is there a
standard way of constructing xmltv ids?? please discuss  ..


There's a RFC somewhere that suggests using the internet domain-style 
naming system to uniquely identify tv channels irrespective of which 
program listing site you use to download the information from. People 
seem to doing this in the other tv_grab scripts, so I thought it would 
be a good idea. You can, of course, edit the config file and change them 
back to whatever you are currently using...


Michael.
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-05 Thread Michael Smith

Phill Edwards wrote:


I agree with Matt.  It would be better to have a single consolidated
script which services all states etc.  If the state is not serviced in
the script, someone add it to the script then recommit.

If the XMLTV project allows us to update the scripts then fine,
otherwise we need to centralise the script (without causing anyone to
be libel) and allow the script to be modified by the user base.



Do we also need to think about _which_ nineMSN script may be the best
in the long run? There are 2 nineMSN scripts going around - the Damon
Searle one, and the Michael Smith one. Personally, I prefer the
Michael Smith one as it has an external config file which means that
you don't have to update the script itself whenever a new version
comes out. It lives at http://immir.com/tv_grab_au but the version
that is there at the moment hasn't had the 1 line update to cope with
the changed URL.


It has been updated now.

I rewrote the script more-or-less from scratch in order to re-introduce 
the external configuration and to ensure the HTML parsing was more 
easily adaptable and HTML-structure-based rather than newline-based.


Cheers,
Immir. Err, Michael.

___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-05 Thread Michael Smith

David Collett wrote:


On Thu, 4 Aug 2005 09:45 pm, Matthew Phillips wrote:

On 04/08/2005, at 1:23 PM, David Whyte wrote:

I agree with Matt.  It would be better to have a single consolidated
script which services all states etc.  If the state is not serviced in
the script, someone add it to the script then recommit.


I'd vote to submit the Michael Smith grabber to the XMLTV project.


I second this. 


Me too, if this did make it upstream and subsequently into xmltv debs
and rpms, that would be ideal for new users. It would be worth trying
to submit it I guess.



Having said that, an upstream version, if accepted, could go stale
very quickly if ninemsn makes changes like this regularly. Does anyone
know if all the other tv_grab_* scripts are html-scraping hacks of
dubious legallity like this one???


I tried to design the script to conform to the way the other XMLTV 
scripts were constructed (modulo my own particular idiosyncratic coding 
practices) and with the intention of submitting it to the project.


The only thing that prevented me from submitting the script was the 
legality issues.




I'd still prefer a nice python version, but having *something*
upstream would be better than the current situation.


Nice python version... oxymoron?

Funny, the perl code I wrote seems perfectly clear to me :-).

Cheers,
Michael.

___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-05 Thread Sammo
Not sure if this has been dealt with before. Is it possible to repeat
program info for multiple channels. For example, I want the same guide
info for channel 7 and 70.

  'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.7.d1.com.au',
  'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.70.d1.com.au',

Is this possible? Would it work?
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-05 Thread Michael Smith



Not sure if this has been dealt with before. Is it possible to repeat
program info for multiple channels. For example, I want the same guide
info for channel 7 and 70.

  'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.7.d1.com.au',
  'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.70.d1.com.au',

Is this possible? Would it work?


No.

Is this a common need? If so, I'm sure I could work something into the 
script (although I'm wary of modifying the configuration format too 
often...).


Michael.
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-05 Thread David Maher
I think it would be good, for example we have ADCHDTV and ABCTV on
digital, they have the same programming, so it would be good to be able
to pull the same listings for them
Thanks
David M
On Sat, 2005-08-06 at 09:25 +1000, Michael Smith wrote:
  Not sure if this has been dealt with before. Is it possible to repeat
  program info for multiple channels. For example, I want the same guide
  info for channel 7 and 70.
  
'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.7.d1.com.au',
'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.70.d1.com.au',
  
  Is this possible? Would it work?
 
 No.
 
 Is this a common need? If so, I'm sure I could work something into the 
 script (although I'm wary of modifying the configuration format too 
 often...).
 
 Michael.
 ___
 mythtv-users mailing list
 mythtv-users@mythtv.org
 http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-05 Thread Brian May
 Sammo == Sammo  [EMAIL PROTECTED] writes:

Sammo Not sure if this has been dealt with before. Is it possible
Sammo to repeat program info for multiple channels. For example,
Sammo I want the same guide info for channel 7 and 70.

Sammo   'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.7.d1.com.au',
Sammo 'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.70.d1.com.au',

Sammo Is this possible? Would it work?

Why not give both entries the same xmltv ID, e.g.
freesd.Sydney.7.d1.com.au?

The xmltv ID doesn't have to be unique for every channel.
-- 
Brian May [EMAIL PROTECTED]
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-05 Thread David Maher
If I give different channels the same xmltv id mythfill database only
adds listings to the first channel with that xmltv id. I have worked
around it by only giving the main channels an xmltv ID, but that means
that I can't have   ABC tv (channel 2),ABC tv (channel 22) and ABC hdtv
(Channel 20) , which I'd like.
Any suggestions would be appreciated. By the way, thanks Michael for
fixing the 9MSN grabber

Cheers
David Maher
On Sat, 2005-08-06 at 11:47 +1000, Brian May wrote:
  Sammo == Sammo  [EMAIL PROTECTED] writes:
 
 Sammo Not sure if this has been dealt with before. Is it possible
 Sammo to repeat program info for multiple channels. For example,
 Sammo I want the same guide info for channel 7 and 70.
 
 Sammo   'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.7.d1.com.au',
 Sammo 'CHANNEL SEVEN SYDNEY' = 'freesd.Sydney.70.d1.com.au',
 
 Sammo Is this possible? Would it work?
 
 Why not give both entries the same xmltv ID, e.g.
 freesd.Sydney.7.d1.com.au?
 
 The xmltv ID doesn't have to be unique for every channel.
 ___
 mythtv-users mailing list
 mythtv-users@mythtv.org
 http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread Phill Edwards
 I agree with Matt.  It would be better to have a single consolidated
 script which services all states etc.  If the state is not serviced in
 the script, someone add it to the script then recommit.
 
 If the XMLTV project allows us to update the scripts then fine,
 otherwise we need to centralise the script (without causing anyone to
 be libel) and allow the script to be modified by the user base.

Do we also need to think about _which_ nineMSN script may be the best
in the long run? There are 2 nineMSN scripts going around - the Damon
Searle one, and the Michael Smith one. Personally, I prefer the
Michael Smith one as it has an external config file which means that
you don't have to update the script itself whenever a new version
comes out. It lives at http://immir.com/tv_grab_au but the version
that is there at the moment hasn't had the 1 line update to cope with
the changed URL.

Regards,
Phill
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread David Collett
Hi all,
While I havent actually used it, the Michael Smith one does indeed
look better. It is not suprising that only a 1 line fix was required
for this recent change as this script appears to use a proper HTML
parser modue rather than plain regexes which are more suceptable to
minor changes (addition of a new attribute, not actually a change of
the attribute of interest is what broke the other script).

Neither of them are particularly maintainable IMHO. Perl doesnt lend
itself to that for starters, and there doesnt appear to be much
documentation, at least at a high-level, of how the parsing actually
works.

An ideal design would abstract the parsing and support code, and be
easily extensible to add more sources. The other HWW sites (seven,
yahoo etc) are ideal candidates as they have much in common (region
id's, pids etc). A d1 source could be trivially added to such a source
also (isnt d1 data already in XMLTV format?), and perhaps oztivo too.

Time permitting I may write such a grabber in python. Hosting and
starting an sf project etc, are probably not really appropriate for
such a script. Legal issues could arrise if unwanted attention is
drawn to the script, and rapid changes are required to adapt to
problems like this recent one (we cant all have commit access to
sf??). I think the mailing list is doing an ok job, when someone asks,
they get pointed in the right direction fairly quickly. Though I agree
it is difficult for a newbie who doesnt look on this list and just
follows the instructions at mythtv.org...

Dave

On 8/4/05, Phill Edwards [EMAIL PROTECTED] wrote:
  I agree with Matt.  It would be better to have a single consolidated
  script which services all states etc.  If the state is not serviced in
  the script, someone add it to the script then recommit.
 
  If the XMLTV project allows us to update the scripts then fine,
  otherwise we need to centralise the script (without causing anyone to
  be libel) and allow the script to be modified by the user base.
 
 Do we also need to think about _which_ nineMSN script may be the best
 in the long run? There are 2 nineMSN scripts going around - the Damon
 Searle one, and the Michael Smith one. Personally, I prefer the
 Michael Smith one as it has an external config file which means that
 you don't have to update the script itself whenever a new version
 comes out. It lives at http://immir.com/tv_grab_au but the version
 that is there at the moment hasn't had the 1 line update to cope with
 the changed URL.
 
 Regards,
 Phill
 ___
 mythtv-users mailing list
 mythtv-users@mythtv.org
 http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users

___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread Phill Edwards
 An ideal design would abstract the parsing and support code, and be
 easily extensible to add more sources. The other HWW sites (seven,
 yahoo etc) are ideal candidates as they have much in common (region
 id's, pids etc). A d1 source could be trivially added to such a source
 also (isnt d1 data already in XMLTV format?), and perhaps oztivo too.

OzTiVo already provide a grabber script which pulls the listings for
mtheir database. I think you would be re-inventing the wheel if you
included support for that. Also if they change their database we can
ve confident that they will change their grabber script to support it.
 
 Time permitting I may write such a grabber in python. 

That would be great! FYI, the OzTiVo script is in python. If you'd
like a copy of it to use as a starting point, let me know and I can
send it to you.

Regards,
Phill
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread Paul Andreassen
Hi tv_grab_au users,

I've consolidated all changes posted on this list in this version.  It was a 
big pain and is hopefully correct.

I've also included a fixes.diff of the simple change to get older versions to 
work.  To use type 'patch tv_grab_au  fixes.diff'

Maybe its time to changing to Michael Smith's version.  But I and most people 
are reluctant (maybe too lazy) to change our settings in mythtv.

There is a python xmltv site at http://pytvgrab.sf.net and I'm a developer if 
your interested David Collett.

Paul
-- 


tv_grab_au
Description: Perl program
--- tv_grab_au.25.pl	2005-08-04 21:41:19.940211496 +1000
+++ tv_grab_au.26.pl	2005-08-04 21:41:39.681210408 +1000
@@ -214,7 +214,7 @@
 $ua-conn_cache($conn_cache);
 
 my $guide_url = http://tvguide.ninemsn.com.au/guide/;;
-my $details_url = http://tvguide.ninemsn.com.au/closeup/default.asp?pid=;;
+my $details_url = http://tvguide.ninemsn.com.au/cu/default.asp?pid=;;
 my $XMLTV_prefix = $source . . . $location . .;
 my $XMLTV_suffix = . . $XMLTVID_URL;
 
@@ -401,17 +401,17 @@
 	my @names;
 	foreach my $line (@day_lines) {
 		foreach my $link (split /\n|tr|TR|TD|tr/, $line ) {
-			if ($link =~ /closeup\/default.asp/) {
+			if ($link =~ /cu\/default.asp/) {
 my $rowspan = $link;
 $rowspan =~ s/.+rowspan=//g;
 $rowspan =~ s/ .+//g;
 
 my $name = $link;
-$name =~ s/.+target=new(P|)//g;
+$name =~ s/.+target=_new class=tv//g;
 $name =~ s/\/a.+//g;
 			
 $link =~ s/.+pid=//g;
-$link =~ s/.+//g; #
+$link =~ s/ .+//g;
 if (($rowspan =~ /\d+/) and ($link =~ /\d\d+/)) {
 	push @pids, $link;
 	push @rowspans, $rowspan;
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread Matthew Phillips

On 04/08/2005, at 1:23 PM, David Whyte wrote:


I agree with Matt.  It would be better to have a single consolidated
script which services all states etc.  If the state is not serviced in
the script, someone add it to the script then recommit.

If the XMLTV project allows us to update the scripts then fine,
otherwise we need to centralise the script (without causing anyone to
be libel) and allow the script to be modified by the user base.


I'd vote to submit the Michael Smith grabber to the XMLTV project.  
Having all the config external to the script is pretty much required  
for it to be be broadly useable, plus it has just proven itself to be  
more robust to site changes.


Although I'd be happier with python, all the other tv_grab_xx scripts  
seem to be perl. I'm a big fan of not using multiple languages within  
a single project, and well-written perl isn't *that* hard to  
maintain. Although it can be a bit much late in the evening with no  
caffeine boost left :/


The XMLTV project at the link that Anssi posted is maintained by a  
guy called Ed Avis, so perhaps we should just submit the current  
Michael Smith grabber to him.


Cheers,

Matt.


Whytey

On 8/4/05, Anssi Hannula [EMAIL PROTECTED] wrote:


Matthew Phillips wrote:

All this mailing-of-scripts does seem a bit chaotic. According to  
RPM

on my FC3 system the grabber scripts come from the xmltv-grabbers
package. Does anyone know how to go about getting the current
tv_grab_au script(s) incorporated back into that?




http://xmltv.sf.net

--
Anssi Hannula

___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users





--
--
GMAIL is 'da bomb babyYEAH

I have GMail invites, if you want one, email me direct.
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users



___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread Matthew Phillips

On 04/08/2005, at 9:15 PM, Paul Andreassen wrote:


Hi tv_grab_au users,

I've consolidated all changes posted on this list in this version.   
It was a

big pain and is hopefully correct.


Thanks for doing that Paul, much appreciated. I'll be installing this  
over the weekend.


Maybe its time to changing to Michael Smith's version.  But I and  
most people

are reluctant (maybe too lazy) to change our settings in mythtv.


Yeah, I like to think of it as a kind of lazy evaluation ;) But I  
think most of us would be happy to put the effort into changing to an  
official, maintained version (see previous post). It would also be  
one more step towards a fire-and-forget mythtv setup for Oz users.


Cheers,

Matt.

___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread Paul Andreassen
On Thu, 4 Aug 2005 09:45 pm, Matthew Phillips wrote:
 On 04/08/2005, at 1:23 PM, David Whyte wrote:
  I agree with Matt.  It would be better to have a single consolidated
  script which services all states etc.  If the state is not serviced in
  the script, someone add it to the script then recommit.

 I'd vote to submit the Michael Smith grabber to the XMLTV project.

I second this.  I've done a lot of patches for the Damon Searle tv_grab_au and 
I'm unwilling to go further with it.  Next on my to do list is to improve / 
change the parser but that would require major changes.  Its been on my to do 
list for six months because the current version 'just works'.

My dream was a python version with more redundancy and maybe a offsite cache 
of xmltv files to reduce load on the grab web site.

Dream big,
Paul
-- 
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread David Collett
 On Thu, 4 Aug 2005 09:45 pm, Matthew Phillips wrote:
  On 04/08/2005, at 1:23 PM, David Whyte wrote:
   I agree with Matt.  It would be better to have a single consolidated
   script which services all states etc.  If the state is not serviced in
   the script, someone add it to the script then recommit.
 
  I'd vote to submit the Michael Smith grabber to the XMLTV project.
 
 I second this. 

Me too, if this did make it upstream and subsequently into xmltv debs
and rpms, that would be ideal for new users. It would be worth trying
to submit it I guess.

Having said that, an upstream version, if accepted, could go stale
very quickly if ninemsn makes changes like this regularly. Does anyone
know if all the other tv_grab_* scripts are html-scraping hacks of
dubious legallity like this one???

I'd still prefer a nice python version, but having *something*
upstream would be better than the current situation.

Dave
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread Matthew Phillips

On 04/08/2005, at 10:31 PM, David Collett wrote:


Does anyone
know if all the other tv_grab_* scripts are html-scraping hacks of
dubious legallity like this one???


A random sample of the scripts for France and Finland indicates that,  
yes, HTML-scraping is not unusual :/


tv_grab_fi: Output TV listings for several channels available in  
Finland.

The data comes from www.katso.fi which is owned by one of the largest
companies providing TV listings in Finland.  The grabber relies on
parsing HTML so it might stop working at any time.

So it may be hackish or dubious, but at least we're not breaking any  
new ground here ;)


Matt.

___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread David Whyte
Aaagghh, this is where it gets confusing.

I just added ABC2 to brisbane :P which I have a channel 3 on my box.

Whytey

On 8/4/05, Paul Andreassen [EMAIL PROTECTED] wrote:
 Hi tv_grab_au users,
 
 I've consolidated all changes posted on this list in this version.  It was a
 big pain and is hopefully correct.
 
 I've also included a fixes.diff of the simple change to get older versions to
 work.  To use type 'patch tv_grab_au  fixes.diff'
 
 Maybe its time to changing to Michael Smith's version.  But I and most people
 are reluctant (maybe too lazy) to change our settings in mythtv.
 
 There is a python xmltv site at http://pytvgrab.sf.net and I'm a developer if
 your interested David Collett.
 
 Paul
 --
 
 
 ___
 mythtv-users mailing list
 mythtv-users@mythtv.org
 http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
 
 
 
 


-- 
-- 
GMAIL is 'da bomb babyYEAH

I have GMail invites, if you want one, email me direct.


tv_grab_au
Description: Binary data
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread Paul Andreassen
On Thu, 4 Aug 2005 11:52 pm, David Whyte wrote:
 Aaagghh, this is where it gets confusing.

 I just added ABC2 to brisbane :P which I have a channel 3 on my box.

 Whytey

Thanks for the changes Whytey.

Could you please change your $days_to_grab to 8 instead of the 14.  From my 
understand of web servers, I believe requests to unexisting pages will 
generate errors and this will draw the attention of the administrator.  And 
we don't want that. ;-)

Paul
-- 
--- tv_grab_au.28.pl	2005-08-05 13:15:04.298139064 +1000
+++ tv_grab_au.29.pl	2005-08-05 13:14:08.968550440 +1000
@@ -166,7 +166,7 @@
 #my $XMLTVID_URL = tv_grab_au.com.au;
 
 # change to how you think it should work
-my $days_to_grab = 14;
+my $days_to_grab = 8;
 my $threads = 2;
 my $retrys = 3;
 my $seconds_before_retry = 2;
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread Paul Andreassen
On Fri, 5 Aug 2005 01:17 pm, Paul Andreassen wrote:
 Could you please change your $days_to_grab to 8 instead of the 14.  From my
 understand of web servers, I believe requests to unexisting pages will
 generate errors and this will draw the attention of the administrator.  And
 we don't want that. ;-)

Sorry about the self reply.

An improvement over my previous post is to change $days_to_grab to 7 and use 
the included patch.  This gets a full 7 days of data, which is all ninemsn 
has.

Paul
-- 
--- tv_grab_au.28.pl	2005-08-05 13:44:51.976370664 +1000
+++ tv_grab_au.29.pl	2005-08-05 13:35:43.115810152 +1000
@@ -112,6 +112,9 @@
 #  - changes for Sydney
 #  David Whyte
 #  - Added ABC 2 to Brisbane, which is channel 3 for me :P
+# 5 Aug 2005
+#  Paul
+#  - get part day
 
 
 use strict;
@@ -166,7 +169,7 @@
 #my $XMLTVID_URL = tv_grab_au.com.au;
 
 # change to how you think it should work
-my $days_to_grab = 14;
+my $days_to_grab = 7;
 my $threads = 2;
 my $retrys = 3;
 my $seconds_before_retry = 2;
@@ -410,7 +413,7 @@
 
 print loading queue\n;
 my $currentday = $yesterday;
-my $day_counter = 0;
+my $day_counter = -1;
 while ($day_counter = $days_to_grab) {
 	my $date = UnixDate($currentday, %d%m%Y);
 	my @day_lines = get_day($date,1);
@@ -467,7 +470,7 @@
 
 print building xml structure\n;
 $currentday = $yesterday;
-$day_counter = 0;
+$day_counter = -1;
 while ($day_counter = $days_to_grab) {
 	my @pids;
 	my $date = UnixDate($currentday, %d%m%Y);
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-04 Thread David Whyte
I wondered why it made no difference :P

My bad guys, I will sort it ASAP once I get home.

Whytey

On 8/5/05, Paul Andreassen [EMAIL PROTECTED] wrote:
 On Fri, 5 Aug 2005 01:17 pm, Paul Andreassen wrote:
  Could you please change your $days_to_grab to 8 instead of the 14.  From my
  understand of web servers, I believe requests to unexisting pages will
  generate errors and this will draw the attention of the administrator.  And
  we don't want that. ;-)
 
 Sorry about the self reply.
 
 An improvement over my previous post is to change $days_to_grab to 7 and use
 the included patch.  This gets a full 7 days of data, which is all ninemsn
 has.
 
 Paul
 --
 
 
 ___
 mythtv-users mailing list
 mythtv-users@mythtv.org
 http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
 
 
 
 


-- 
-- 
GMAIL is 'da bomb babyYEAH

I have GMail invites, if you want one, email me direct.
___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users


Re: [mythtv-users] tv_grab_au which script?

2005-08-03 Thread Anssi Hannula

Matthew Phillips wrote:
All this mailing-of-scripts does seem a bit chaotic. According to RPM  
on my FC3 system the grabber scripts come from the xmltv-grabbers  
package. Does anyone know how to go about getting the current  
tv_grab_au script(s) incorporated back into that?




http://xmltv.sf.net

--
Anssi Hannula

___
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users