Sarah Hoffmann a3e4e8e5cd delete unused country name tokens

2022-02-23 09:23:06 +01:00

..

sanitizers

add tests for get_string_list()

2022-02-07 11:22:24 +01:00

token_analysis

fix linting error

2022-01-18 11:09:21 +01:00

__init__.py

introduce tokenizer modules

2021-04-30 11:29:57 +02:00

base.py

add new command for cleaning word tokens

2022-01-20 20:05:15 +01:00

factory.py

add consistent SPDX copyright headers

2022-01-03 16:23:58 +01:00

icu_rule_loader.py

sanitizer: move helpers into a configuration class

2022-02-07 10:48:00 +01:00

icu_token_analysis.py

add consistent SPDX copyright headers

2022-01-03 16:23:58 +01:00

icu_tokenizer.py

delete unused country name tokens

2022-02-23 09:23:06 +01:00

legacy_tokenizer.py

add new command for cleaning word tokens

2022-01-20 20:05:15 +01:00

place_sanitizer.py

sanitizer: move helpers into a configuration class

2022-02-07 10:48:00 +01:00