About tokens and lexemes

Ben Scholzen

Wednesday 21 October 2009 from 00:00 to 15:08

Talk in English - US at ZendCon 2009 Uncon
Short URL: https://joind.in/talk/52066 (QR-Code (opens in new window))

Avg. Rating

About tokens and lexemes

Comments

Comments are closed.

Guilherme Blanco at 15:52 on 28 Sep 2009

Lexical analysis/parsing is a rare subject covered in conferences, but it is an amazing area that most applications take advantage in any way. Good examples are wiki format and markdown.

If it could be turned into a more generic solution, it'll be an amazing talk!

Hannes Magnusson at 19:18 on 9 Oct 2009

So, thats new. Not a topic that gets a lot of attention from "the hippies". - I like it!

Daniel Cousineau at 21:19 on 9 Oct 2009

Definitely would like a talk on this. For some reason I readily understand LL(k) parsers (loved my finite automata course) however for some reason have a mental block around tokenizers (or I'm thinking of them the right way and my lazy side is rebelling). I'd love to see some code-by-example or other examples of a simple system working.