AntoJvlt 8b8dfc46eb Added --no-replace command for special phrases importation and added corresponding tests

2021-05-17 13:25:06 +02:00

..

__init__.py

introduce tokenizer modules

2021-04-30 11:29:57 +02:00

factory.py

boilerplate for PHP code of tokenizer

2021-04-30 11:31:52 +02:00

legacy_icu_tokenizer.py

Added --no-replace command for special phrases importation and added corresponding tests

2021-05-17 13:25:06 +02:00

legacy_tokenizer.py

Added --no-replace command for special phrases importation and added corresponding tests

2021-05-17 13:25:06 +02:00