text-scanner

Package scanner provides a scanner and tokenizer for UTF-8-encoded text.