Tokenization
Was necessary before
Nowadays, grammars could be rewritten with the BIND, SOFT_BIND and SOFT_SPACE tokens instead.