Sarah Hoffmann b2722650d4 do not hide errors when importing tokenizer ...

Explicitly check for the tokenizer source file to check that
the name is correct. We can't use the import error for that
because it hides other import errors like a missing
library.

Fixes #2327.

2021-05-18 16:28:21 +02:00

..

__init__.py

introduce tokenizer modules

2021-04-30 11:29:57 +02:00

factory.py

do not hide errors when importing tokenizer

2021-05-18 16:28:21 +02:00

legacy_icu_tokenizer.py

move filling of postcode table to python

2021-05-13 14:15:42 +02:00

legacy_tokenizer.py

do not preload postcodes

2021-05-13 16:14:12 +02:00