Merge pull request #3122 from miku0/sanitizer-final

Adds sanitizer for Japanese addresses to correspond to block address
2023-08-01 10:38:58 +02:00
parent c29ffc38e6 67e1c7dc72
commit 252fe42612
6 changed files with 247 additions and 11 deletions
--- a/docs/customize/Tokenizers.md
+++ b/docs/customize/Tokenizers.md
@@ -229,6 +229,14 @@ The following is a list of sanitizers that are shipped with Nominatim.
    rendering:
        heading_level: 6

+#### tag-japanese
+
+::: nominatim.tokenizer.sanitizers.tag_japanese
+    selection:
+        members: False
+    rendering:
+        heading_level: 6
+
 #### Token Analysis

 Token analyzers take a full name and transform it into one or more normalized