The following module was proposed for inclusion in the Module List:
modid: IO::Tokenized
DSLIP: adphp
description: Add regex parsed input to filehandles
userid: HOBBIT (Leo Cacciari)
chapterid: 21 (File_Handle_Input_Output)
communities:
[EMAIL PROTECTED] (italian language) and the clpm newsgroup
similar:
Parse::Lex, Parse::Flex
rationale:
Lexical analysis, which is a fundamental step in all parsing,
mainly consists in decomposing an input stream into smal chunks
called tokens. The tokens are in turn defined by regular
expressions.
As Perl is good at handling regular expressions, one should expects
that writing lexical analyser in Perl should be easy. In truth it is
not, and tools like lex or flex are even been ported to Perl. There
are also a whole lot of ad-hoc lexers for different parsing
modules/programmes.
Now, approaches to lexical analysis like those underlying
Parse::Lex and Parse::Flex are general but fairly complexes to use,
while ad-hoc solutions are obviously, well... ad-hoc.
What I'd always sought was a way to tell to a file handle: "well,
that is how the chunks I'm interested are. Please, found them in
your input stream". It seems a simple thingh enough, but I could not
found a module doing it.
IO::Tokenized and its compagnon IO::Tokenized::File are the result
of my attempt to produce such a module.
enteredby: HOBBIT (Leo Cacciari)
enteredon: Mon Nov 10 13:00:06 2003 GMT
The resulting entry would be:
IO::
::Tokenized adphp Add regex parsed input to filehandles HOBBIT
Thanks for registering,
--
The PAUSE
PS: The following links are only valid for module list maintainers:
Registration form with editing capabilities:
https://pause.perl.org/pause/authenquery?ACTION=add_mod&USERID=95500000_4aaaccd5a4ab6885&SUBMIT_pause99_add_mod_preview=1
Immediate (one click) registration:
https://pause.perl.org/pause/authenquery?ACTION=add_mod&USERID=95500000_4aaaccd5a4ab6885&SUBMIT_pause99_add_mod_insertit=1
