miku0 67e1c7dc72 Moved KANJI_MAP to icu-rules

2023-07-31 11:57:49 +00:00

..

sanitizers

Moved KANJI_MAP to icu-rules

2023-07-31 11:57:49 +00:00

token_analysis

overhaul the token analysis interface

2022-07-29 15:14:11 +02:00

test_factory.py

restore the tokenizer directory when missing

2022-03-20 11:31:42 +01:00

test_icu_rule_loader.py

add consistent SPDX copyright headers

2022-01-03 16:23:58 +01:00

test_icu.py

use information from tokenizer to determine street vs. place address

2023-06-30 11:08:25 +02:00

test_legacy.py

also switch legacy tokenizer to new street/place choice behaviour

2023-06-30 17:03:17 +02:00

test_place_sanitizer.py

add support for external sanitizer modules

2022-07-25 16:10:19 +02:00