Re: How to decide what to put in the lexer and the grammar respectively?

Hans Åberg <[email protected]>
Newsgroups gmane.comp.parsers.bison.general
Message-ID <[email protected]>
> On 18 Feb 2019, at 06:44, Akim Demaille <[email protected]> wrote:
> 
>> Le 18 févr. 2019 à 00:10, Hans Åberg <[email protected]> a écrit :
>> 
>>> On 17 Feb 2019, at 23:10, Peng Yu <[email protected]> wrote:
>>> 
>>> This lexical tie-in creates feedback from the parser to the lexer. So
>>> the lexer cannot be tested standalone.
>>> 
>>> But the principle of separating lexer and parser is to make parser
>>> builtin on top of the parser. Is there something that can avoid the
>>> feedback yet still allow context-dependent parsing? Alternatively, how
>>> to just testing the lexer without having to get the parser involved?
>> 
>> The LARL(1) that Bison uses is for context free grammars only, so contexts must involve switches somehow.
> 
> I don't think Peng was referring to context-sensitivity here in the
> technical sense.  He just means "lexical context depending on the
> current state of the parser", which is still CFG.  Let's not confuse
> people by referring to something unrelated.

Subsequent discussions might clarify that.



_______________________________________________
[email protected] https://lists.gnu.org/mailman/listinfo/help-bison
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.