tokenizers
Module providing tokenizers for various languages.
yalign.tokenizers.
get_tokenizer
Get a tokenizer for a two character language code.