About tokens and lexemes

Comments

Comments are closed.

Lexical analysis/parsing is a rare subject covered in conferences, but it is an amazing area that most applications take advantage in any way. Good examples are wiki format and markdown.

If it could be turned into a more generic solution, it'll be an amazing talk!

So, thats new. Not a topic that gets a lot of attention from "the hippies". - I like it!

Definitely would like a talk on this. For some reason I readily understand LL(k) parsers (loved my finite automata course) however for some reason have a mental block around tokenizers (or I'm thinking of them the right way and my lazy side is rebelling). I'd love to see some code-by-example or other examples of a simple system working.