safety-screen/Nominatim
1
0
Fork 0
forked from hans/Nominatim
Code Pull Requests Activity

docs: querying and tokenizers

Browse Source
This commit is contained in:
Sarah Hoffmann
2021-07-31 09:49:29 +02:00
parent 68bff31cc9
commit e25e268e2e
1 changed files with 6 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
docs/develop/Tokenizers.md
View File

@@ -67,4 +67,9 @@ consequently not create any special indexes on it.
### Querying
The tokenizer is responsible for the initial parsing of the query. It needs
to split the query into appropriate words and terms and match them against
the saved tokens in the database. It then returns the list of possibly matching
tokens and the list of possible splits to the query parser. The parser uses
this information to compute all possible interpretations of the query and
rank them accordingly.