Sarah Hoffmann 6c79a60e19 add documentation for new configuration of ICU tokenizer

2021-10-07 11:55:53 +02:00

..

__init__.py

introduce sanitizer step before token analysis

2021-10-01 12:27:24 +02:00

split_name_list.py

add documentation for new configuration of ICU tokenizer

2021-10-07 11:55:53 +02:00

strip_brace_terms.py

add documentation for new configuration of ICU tokenizer

2021-10-07 11:55:53 +02:00

tag_analyzer_by_language.py

add documentation for new configuration of ICU tokenizer

2021-10-07 11:55:53 +02:00