extend word statistics to address index

Word frequency in names is not sufficient to interpolate word
frequency in the address because names of towns, states etc. are
much more frequently used than, say street names.
This commit is contained in:
Sarah Hoffmann
2024-03-13 15:10:25 +01:00
parent 9c48726691
commit bb5de9b955
4 changed files with 88 additions and 19 deletions

View File

@@ -102,6 +102,7 @@ class Token(ABC):
lookup_word: str
is_indexed: bool
addr_count: int = 1
@abstractmethod
def get_category(self) -> Tuple[str, str]: