Lexical Analytics Utilities

Utility for doing lexical parsing of some input. It is optimized for static (string) parsing, not partial input stream parsing, but contains tokenizer supporting either. See morimekta.net/utils for procedures on releases.