Sarah Hoffmann 118858a55e rename legacy_icu tokenizer to icu tokenizer ...

The new icu tokenizer is now no longer compatible with the old
legacy tokenizer in terms of data structures. Therefore there
is also no longer a need to refer to the legacy tokenizer in the
name.

2021-08-17 23:11:47 +02:00

7.3 KiB

Raw Blame History