ignore Unicode format characters for normalization

Also adds tests. Fixes #1007.
2026-02-16 15:47:58 +00:00 · 2018-04-10 22:48:17 +02:00
parent 28ee59dd64
commit ae83ceab5e
5 changed files with 22 additions and 2 deletions
--- a/test/bdd/db/import/postcodes.feature
+++ b/test/bdd/db/import/postcodes.feature
@@ -95,7 +95,6 @@ Feature: Import of postcodes
            | object | postcode |
            | W93    | 445023   |

-    @wip
    Scenario: Postcodes from admin boundaries are preferred over estimated postcodes
        Given the scene admin-areas
        And the named places
--- a/test/bdd/db/query/normalization.feature
+++ b/test/bdd/db/query/normalization.feature
@@ -136,3 +136,13 @@ Feature: Import and search of names
        Then results contain
         | ID | osm_type | osm_id |
         | 0  | R        | 1 |
+
+     Scenario: Unprintable characters in postcodes are ignored
+        Given the named places
+            | osm  | class   | type   | address |
+            | N234 | amenity | prison | 'postcode' : u'1234\u200e' |
+        When importing
+        And searching for "1234"
+        Then results contain
+         | ID | osm_type |
+         | 0  | P        |