add documentation for new query preprocessing

This commit is contained in:
Sarah Hoffmann
2024-12-13 16:53:08 +01:00
parent 2b87c016db
commit fbb6edfdaf
3 changed files with 101 additions and 27 deletions

View File

@@ -5,7 +5,12 @@
# Copyright (C) 2024 by the Nominatim developer community.
# For a full list of authors see the git log.
"""
Normalize query test using an ICU transliterator.
Normalize query text using the same ICU normalization rules that are
applied during import. If a phrase becomes empty because the normalization
removes all terms, then the phrase is deleted.
This preprocessor does not come with any extra information. Instead it will
use the configuration from the `normalization` section.
"""
from typing import cast