Re: Net::Whois::RIPE
jwhois? On Thu, 2003-05-29 at 07:45, Ian Watkinson wrote: > I have a list of hosts, that I need to get whois information on, so I turned to my > trust perl, and tried to get Net::Whois::RIPE working. > > However, I can get the whois header information, and I can get results, but it seems > to not work for all hosts. > > For example I can put a host of whois.joker.com and get info from joker, but not > info on stuff not from joker. > > What I am ideally looking for is something in perl that provides me with the sme > funcionality as the normal system command whois, as a bare minimum. > > If I can do something like > > Use:Clever::Module > > $hostiwant; > $fieldiwant; > > $ExpirtyDate = Clever::Module->$hostiwant($fieldiwant); > > > If anyones done anything like this, or even got Net::Whois::RIPE working for > .com .net .edu .co.uk etc, then please let me know. > > Thanks. -- Please Note: Some Quantum Physics Theories Suggest That When the Consumer Is Not Directly Observing This Product, It May Cease to Exist or Will Exist Only in a Vague and Undetermined State.
Re: Net::Whois::RIPE
On Thu, May 29, 2003 at 07:45:27AM +0100, Ian Watkinson wrote: > I have a list of hosts, that I need to get whois information on, so > I turned to my trust perl, and tried to get Net::Whois::RIPE > working. However, I can get the whois header information, and I can > get results, but it seems to not work for all hosts. Net::Whois::RIPE is specifically for the RIPE whois database, which contains IP address, AS number allocations and the like, rather than the usual domains. It actually works really well, which should be expected given that both it and the database were written by RIPE... > What I am ideally looking for is something in perl that provides me > with the sme funcionality as the normal system command whois, as a > bare minimum. You'll be lucky. There's a whole bunch of different 'standards' for the output of whois servers, but there doesn't seem to be a module that understands them all. When I've done this, I've kept a list of relevant whois servers and strings to match on (I've only been interested in available/ not-available), then use Net::Whois::Raw to actually get the data, and parse the output by hand. There's a couple of modules which know about gTLDs and a handful of ccTLDs, and Net::Domain::ExpireDate seems to know about quite a few for the expiry date only, but a comprehensive module will be a maintenance nightmare. Chris.
Re: Net::Whois::RIPE
On Thu, 29 May 2003, Chris Andrews wrote: > You'll be lucky. There's a whole bunch of different 'standards' for > the output of whois servers, but there doesn't seem to be a module > that understands them all. I've had a lot of success with Net::XWhois which seems to address this issue. Jason Clifford -- UKFSN.ORG Finance Free Software while you surf the 'net http://www.ukfsn.org/ Sign up now
Re: Net::Whois::RIPE
On Thu, 29 May 2003, Chris Andrews wrote: > There's a couple of modules which know about gTLDs and a handful of > ccTLDs, and Net::Domain::ExpireDate seems to know about quite a few > for the expiry date only, but a comprehensive module will be a > maintenance nightmare. > > > Chris. Very much so. I have to do minimal parsing of whois information as part of my work for OpenSRS, and even for that, I run into maintainance problems. The biggest cause is that many of the registrars alter their whois formats on a semi-regular basis, presumably to avoid easy parsing of em for transfer information. Mark.
Re: Net::Whois::RIPE
On Thu, 29 May 2003, Ian Watkinson wrote: > What I am ideally looking for is something in perl that provides me with > the sme funcionality as the normal system command whois, as a bare > minimum. Net::ParseWhois exists and I use it for commercial stuff. The maintainer doesn't really maintain it, and as the people who run whois databases change formats arbitrarily, it needs real users to keep it up-to-date. However, join the mailing list, and various people post updates and minor changes. Primarily it exists for com/net/org, though personally I'm just updating my version to extract more data for .uk domains. My effort to make it work on non-recursive whois systems could probably do with being redone by someone who really understands objects, but what's there works, and makes it fairly simple to add new TLDs and new whois formats. There was some plottings for me and someone else to officially take over maintainance, but I've been lacking the tuits to actually sort that. the hatter
Re: Net::Whois::RIPE
On Thu, May 29, 2003 at 10:16:19AM +0100, Mark Morgan wrote: > Very much so. I have to do minimal parsing of whois information as part > of my work for OpenSRS, and even for that, I run into maintainance > problems. The biggest cause is that many of the registrars alter their > whois formats on a semi-regular basis, presumably to avoid easy parsing of > em for transfer information. Can't you just ask OpenSRS for the information? that's what we do. -- Lusercop.net - LARTing Lusers everywhere since 2002
Re: Net::Whois::RIPE
On Thu, May 29, 2003 at 10:26:54AM +0100, Lusercop wrote: > On Thu, May 29, 2003 at 10:16:19AM +0100, Mark Morgan wrote: > > Very much so. I have to do minimal parsing of whois information as part > > of my work for OpenSRS, and even for that, I run into maintainance > > problems. The biggest cause is that many of the registrars alter their > > whois formats on a semi-regular basis, presumably to avoid easy parsing of > > em for transfer information. > > Can't you just ask OpenSRS for the information? that's what we do. If you're transferring from another registrar, you have to parse *their* information in order to feed it to OpenSRS. Chris.
Re: Net::Whois::RIPE
On Thu, May 29, 2003 at 07:45:27AM +0100, Ian Watkinson wrote: > $ExpirtyDate = Clever::Module->$hostiwant($fieldiwant); The Gandi guys have a reasonable one: http://open.gandi.net/download/WhoisExtract/ I wrote a more complete parser but as others have pointed out it's a real maintainence headache, so it's allways out of date. I don't think I'm allowed to release it anyway because it probably belongs to my employer. Have the CS people invented AI yet?
Re: Net::Whois::RIPE
On Thu, 29 May 2003, Lusercop wrote: > Date: Thu, 29 May 2003 10:26:54 +0100 > From: Lusercop <`the.lusercop'@lusercop.net> > Reply-To: [EMAIL PROTECTED] > To: [EMAIL PROTECTED] > Subject: Re: Net::Whois::RIPE > > On Thu, May 29, 2003 at 10:16:19AM +0100, Mark Morgan wrote: > > Very much so. I have to do minimal parsing of whois information as part > > of my work for OpenSRS, and even for that, I run into maintainance > > problems. The biggest cause is that many of the registrars alter their > > whois formats on a semi-regular basis, presumably to avoid easy parsing of > > em for transfer information. > > Can't you just ask OpenSRS for the information? that's what we do. Because OpenSRS is my employer. :) The minimal parsing that we need to do is just to get the admin email address for transfers, but even doing that changes on an all-to-regular basis for many registrars. Take care, Mark.
Re: Net::Whois::RIPE
Dirk Koopman wrote: jwhois? Oh, man... I think you mentioned a *Java* program... /me washes his mouth with soap Please don't suggest a perl programmer to use Java... =-] []'Z! -- Luis Campos de Carvalho Initiate Perl Monger, Oracle DBA and Unix Sys Admin On Thu, 2003-05-29 at 07:45, Ian Watkinson wrote: I have a list of hosts, that I need to get whois information on, so I turned to my trust perl, and tried to get Net::Whois::RIPE working. However, I can get the whois header information, and I can get results, but it seems to not work for all hosts. For example I can put a host of whois.joker.com and get info from joker, but not info on stuff not from joker. What I am ideally looking for is something in perl that provides me with the sme funcionality as the normal system command whois, as a bare minimum. If I can do something like Use:Clever::Module $hostiwant; $fieldiwant; $ExpirtyDate = Clever::Module->$hostiwant($fieldiwant); If anyones done anything like this, or even got Net::Whois::RIPE working for .com .net .edu .co.uk etc, then please let me know. Thanks.
Re: Net::Whois::RIPE
On Thu, May 29, 2003 at 10:44:11AM -0300, Luis Campos de Carvalho wrote: >Dirk Koopman wrote: >>jwhois? > Oh, man... > I think you mentioned a *Java* program... $ file $(which jwhois) /usr/bin/jwhois: setgid ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), dynamically linked (uses shared libs), stripped Debian Depends: libc6 (>= 2.2.4-4), libgdbmg1, adduser, dpkg (>= 1.9.0) I see no Java here.
Re: Net::Whois::RIPE
On Thu, May 29, 2003 at 01:42:37PM +0100, Mark Morgan wrote: > On Thu, 29 May 2003, Lusercop wrote: > > Can't you just ask OpenSRS for the information? that's what we do. > Because OpenSRS is my employer. :) The minimal parsing that we need to do > is just to get the admin email address for transfers, but even doing that > changes on an all-to-regular basis for many registrars. Whoops, self-LART. ISWYM, then. Can I rant at you about repeatable testing, then, or has Chris already made himself enough of a pain with this? -- Lusercop.net - LARTing Lusers everywhere since 2002
Re: Net::Whois::RIPE
Nope. jwhois is a standard 'gnu' program written in C Dirk On Thu, 2003-05-29 at 14:44, Luis Campos de Carvalho wrote: > Dirk Koopman wrote: > > jwhois? > >Oh, man... >I think you mentioned a *Java* program... > >/me washes his mouth with soap > >Please don't suggest a perl programmer to use Java... =-] >[]'Z! > -- Please Note: Some Quantum Physics Theories Suggest That When the Consumer Is Not Directly Observing This Product, It May Cease to Exist or Will Exist Only in a Vague and Undetermined State.
Re: Net::Whois::RIPE
On Thu, May 29, 2003 at 10:38:06AM +0100, Chris Andrews wrote: > On Thu, May 29, 2003 at 10:26:54AM +0100, Lusercop wrote: > > Can't you just ask OpenSRS for the information? that's what we do. > If you're transferring from another registrar, you have to parse > *their* information in order to feed it to OpenSRS. As you well know, I rely on the user to get that bit correct. :-) -- Lusercop.net - LARTing Lusers everywhere since 2002
Re: Net::Whois::RIPE
On Thu, 29 May 2003, Lusercop wrote: > Date: Thu, 29 May 2003 15:30:28 +0100 > From: Lusercop <`the.lusercop'@lusercop.net> > Reply-To: [EMAIL PROTECTED] > To: [EMAIL PROTECTED] > Subject: Re: Net::Whois::RIPE > > On Thu, May 29, 2003 at 01:42:37PM +0100, Mark Morgan wrote: > > On Thu, 29 May 2003, Lusercop wrote: > > > Can't you just ask OpenSRS for the information? that's what we do. > > Because OpenSRS is my employer. :) The minimal parsing that we need to do > > is just to get the admin email address for transfers, but even doing that > > changes on an all-to-regular basis for many registrars. > > Whoops, self-LART. ISWYM, then. Can I rant at you about repeatable testing, > then, or has Chris already made himself enough of a pain with this? > > -- > Lusercop.net - LARTing Lusers everywhere since 2002 No problem. Feel free to rant/throw questions off-list, rather than making here more off-topic than usual. :) Take care, Mark.
Re: Net::Whois::RIPE
Dirk Koopman wrote: Nope. jwhois is a standard 'gnu' program written in C Dirk That's why I said "I think" before... =-] BTW, there *(should|must)* be a module to solve this specific problem... I think somebody mentioned it in an email some time ago... Thanks for the information. []'z! On Thu, 2003-05-29 at 14:44, Luis Campos de Carvalho wrote: Dirk Koopman wrote: jwhois? Oh, man... I think you mentioned a *Java* program... /me washes his mouth with soap Please don't suggest a perl programmer to use Java... =-] -- =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Luis Campos de Carvalho Analista de sistemas Intergal Sistemas http://www.integral.com.br =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Re: Net::Whois::RIPE
>From /etc/jwhois.conf (which appears to be full of regexes)... "# Due to the ever-changing nature of the Internet, the configuration file # released with Jwhois quickly gets outdated. You can find the latest version # in the Jwhois CVS repository, which is accessible via the web from # http://savannah.gnu.org/cgi-bin/viewcvs/jwhois/jwhois/example/jwhois.conf"; Dirk On Thu, 2003-05-29 at 15:53, Luis Campos de Carvalho wrote: > Dirk Koopman wrote: > > Nope. > > jwhois is a standard 'gnu' program written in C > > Dirk > >That's why I said "I think" before... =-] > >BTW, there *(should|must)* be a module to solve this specific > problem... I think somebody mentioned it in an email some time ago... > >Thanks for the information. >[]'z! > > > On Thu, 2003-05-29 at 14:44, Luis Campos de Carvalho wrote: > >>Dirk Koopman wrote: > >>>jwhois? > >> Oh, man... > >> I think you mentioned a *Java* program... > >> /me washes his mouth with soap > >> Please don't suggest a perl programmer to use Java... =-] -- Please Note: Some Quantum Physics Theories Suggest That When the Consumer Is Not Directly Observing This Product, It May Cease to Exist or Will Exist Only in a Vague and Undetermined State.