make token analyzers configurable modules

Browse Source

Adds a mandatory section 'analyzer' to the token-analysis entries
which define, which analyser to use. Currently there is exactly
one, generic, which implements the former ICUNameProcessor.

...

This commit is contained in:

Sarah Hoffmann

2021-10-04 17:34:30 +02:00

parent 52847b61a3

commit 7cfcbacfc7

7 changed files with 49 additions and 29 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

0

nominatim/tokenizer/token_analysis/__init__.py Normal file