Sarah Hoffmann 62eedbb8f6 add type hints for sanitizers

2022-07-18 09:47:57 +02:00

..

sanitizers

add type hints for sanitizers

2022-07-18 09:47:57 +02:00

token_analysis

handle postcodes properly on word table updates

2022-06-23 23:42:31 +02:00

__init__.py

introduce tokenizer modules

2021-04-30 11:29:57 +02:00

base.py

add typing information for place_info and country_info

2022-07-18 09:47:57 +02:00

factory.py

restore the tokenizer directory when missing

2022-03-20 11:31:42 +01:00

icu_rule_loader.py

move country_info into data submodule

2022-07-06 11:08:36 +02:00

icu_token_analysis.py

handle unknown analyzer

2022-03-01 09:34:32 +01:00

icu_tokenizer.py

move PlaceInfo into data submodule

2022-07-06 10:54:47 +02:00

legacy_tokenizer.py

port legacy tokenizer to new postcode handling

2022-06-23 23:42:31 +02:00

place_sanitizer.py

add type hints for sanitizers

2022-07-18 09:47:57 +02:00