"Matthew F. Barnes" <[EMAIL PROTECTED]> writes:
> I posted this question to python-help, but I think I have a better chance
> of getting the answer here.
>
> I'm looking for clarification on when NEWLINE tokens are generated during
> lexical analysis of Python source code. In particular, I'm confused about
> some of the top-level components in Python's grammar (file_input,
> interactive_input, and eval_input).
>
> Section 2.1.7 of the reference manual states that blank lines (lines
> consisting only of whitespace and possibly a comment) do not generate
> NEWLINE tokens. This is supported by the definition of a suite, which
> does not allow for standalone or consecutive NEWLINE tokens.
>
> suite ::= stmt_list NEWLINE | NEWLINE INDENT statement+ DEDENT
I don't have the spare brain cells to think about your real problem
(sorry) but something to be aware of is that the pseudo EBNF of the
reference manual is purely descriptive -- it is not actually used in
the parsing of Python code at all. Among other things this means it
could well just be wrong :/
The real grammar is Grammar/Grammar in the source distribution.
Cheers,
mwh
--
The Internet is full. Go away.
-- http://www.disobey.com/devilshat/ds011101.htm
_______________________________________________
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe:
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
