safety-screen/Nominatim
1
0
Fork 0
forked from hans/Nominatim
Code Pull Requests Activity

generalize normalization step for search query

Browse Source 
It is now possible to configure functions for changing the query
input before it is analysed by the tokenizer.

Code is a cleaned-up version of the implementation by @miku.
This commit is contained in:
Sarah Hoffmann
2024-12-13 11:53:10 +01:00
parent 046665f8d9
commit 2b87c016db
10 changed files with 167 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
settings/icu_tokenizer.yaml
View File

@@ -1,3 +1,5 @@
query-preprocessing:
- step: normalize
normalization:
- ":: lower ()"
- ":: Hans-Hant"