Block-level tokenizer.
Ruler instance. Keep configuration of block rules.
Process input string and push block tokens into outTokens
outTokens
Block-level tokenizer.