Sarah Hoffmann
3980791cfd
use iterator instead of list to go over partials
2025-04-11 09:38:24 +02:00
Sarah Hoffmann
497e27bb9a
move partial token into a separate field in the query struct
...
There is exactly one token to be expected and the token is usually
present.
2025-04-11 08:57:34 +02:00
Sarah Hoffmann
1db717b886
Merge pull request #3716 from lonvia/github-cache-osm2pgsql-binary
...
Github actions: cache compiled osm2pgsql binary
For the tests on Ubunutu 22-04 we need to compile osm2pgsql because the version they ship is too old. This adds caching of the compiled binary, so that we don't need to recompile for each CI run. Together with the new BDD tests that shaves around 10 min off a CI run.
2025-04-10 17:20:32 +02:00
Sarah Hoffmann
b47c8ccfb1
actions: cache compiled osm2pgsql binary
2025-04-10 16:06:27 +02:00
Sarah Hoffmann
63b055283d
Merge pull request #3714 from lonvia/postcode-update-without-project-dir
...
Change postcode update function to work without a project directory
2025-04-10 08:51:22 +02:00
Sarah Hoffmann
b80e6914e7
Merge pull request #3715 from lonvia/demote-tags-to-fallbacks
...
Demote historic and tourism=attraction to fallback tags
2025-04-10 08:51:06 +02:00
Sarah Hoffmann
9d00a137fe
demote historic and tourism=attraction to fallback tags
2025-04-09 20:15:18 +02:00
Sarah Hoffmann
97d9e3c548
allow updating postcodes without a project directory
...
Postcodes will then be updated without looking for external postcodes.
2025-04-09 20:04:01 +02:00
Sarah Hoffmann
e4180936c1
Merge pull request #3713 from lonvia/bdd-pytest-db-test
...
Move BDD tests to pytest-bdd
2025-04-09 19:37:30 +02:00
Sarah Hoffmann
34e0ecb44f
update documentation for BDD tests
2025-04-09 15:21:50 +02:00
Sarah Hoffmann
d95e9737da
remove usage of behave
2025-04-09 14:57:39 +02:00
Sarah Hoffmann
b34991d85f
add BDD tests for DB
2025-04-09 14:52:34 +02:00
Sarah Hoffmann
5f44aa2873
improve table comparison
2025-04-04 11:02:51 +02:00
Sarah Hoffmann
dae643c040
move database setup to generic conftest.py
2025-04-04 11:02:51 +02:00
Sarah Hoffmann
ee62d5e1cf
remove old behave osm2pgsql BDD tests
2025-04-04 11:02:51 +02:00
Sarah Hoffmann
fb440f29a2
implement BDD osm2pgsql tests with pytest-bdd
2025-04-04 11:02:51 +02:00
Sarah Hoffmann
0f725b1880
enable python-bdd for github actions
2025-04-04 11:02:51 +02:00
Sarah Hoffmann
39f56ba4b8
restrict coordinate output to 7 digits
2025-04-04 11:02:51 +02:00
Sarah Hoffmann
6959577aa4
replace behave BDD API tests with pytest-bdd tests
2025-04-04 11:02:51 +02:00
Sarah Hoffmann
50d4b0a386
Merge pull request #3687 from asharmalik19/test-linked-places-language
...
test: linked places expand default language names
2025-04-04 10:58:53 +02:00
Ashar
9ff93bdb3d
Update linked places name test
...
Clean up test scenario by removing extra language variations and
improving table readability.
2025-04-03 14:30:18 -04:00
Ashar
e0bf553aa5
test: linked places expand default language names
...
Add failing test for issue #2714 to verify default language expansion
2025-04-03 14:30:18 -04:00
Sarah Hoffmann
2ce2d031fa
Merge pull request #3702 from lonvia/remove-tokenizer-dir
...
Remove automatic setup of tokenizer directory
So far the tokenizer factory would create a directory for private data for the tokenizer and then hand in the directory location to the tokenizer.
ICU tokenizer doesn't need any extra data anymore, so it doesn't make sense to create a directory which then remains empty. If a tokenizer needs such a directory in the future, it needs to create it on its own and make sure to handle the situation correctly where no project directory is used at all.
2025-04-03 09:04:48 +02:00
Sarah Hoffmann
186f562dd7
remove automatic setup of tokenizer directory
...
ICU tokenizer doesn't need any extra data anymore, so it doesn't
make sense to create a directory which then remains empty. If a
tokenizer needs such a directory in the future, it needs to create
it on its own and make sure to handle the situation correctly where
no project directory is used at all.
2025-04-02 20:20:04 +02:00
Sarah Hoffmann
c5bbeb626f
Merge pull request #3700 from lonvia/ignore-inherited-addresses
...
Ignore POIs with inherited addresses for the address layer
2025-04-02 12:00:45 +02:00
Sarah Hoffmann
3bc77629c8
ignore POIs with inherited addresses for the address layer
...
We know that there is a building which describes the address as a
polygon and is therefore more suitable.
2025-04-02 10:30:45 +02:00
Sarah Hoffmann
6cf1287c4e
Merge pull request #3686 from astridx/output_names
...
Output names as setting
2025-04-01 20:16:15 +02:00
Sarah Hoffmann
a49e8b9cf7
Merge pull request #3675 from TuringVerified/generic-preprocessors
...
Add generic preprocessors
2025-04-01 20:14:43 +02:00
TuringVerified
2eeec46040
Remove unnecessary assert statement, Fix regex_replace docstring and simplify regex_replace
2025-04-01 18:54:30 +05:30
TuringVerified
6d5a4a20c5
Update documentation, optimise regex_replace, add tests
2025-04-01 18:54:30 +05:30
TuringVerified
4665ea3e77
Add generic preprocessor
2025-04-01 18:54:30 +05:30
Sarah Hoffmann
9cf5eee5d4
add instructions for pip package upload
2025-04-01 11:59:03 +02:00
Sarah Hoffmann
fce279226f
prepare release 5.1.0
2025-04-01 10:16:35 +02:00
Sarah Hoffmann
54d895c4ce
Merge pull request #3695 from TuringVerified/doc-dependencies
...
[Small fix] Add documentation to install extras for mkdocstrings
2025-04-01 09:34:08 +02:00
TuringVerified
896a1c9d12
Add mkdocstrings extra
2025-04-01 11:06:46 +05:30
Sarah Hoffmann
32728d6c89
Merge pull request #3693 from lonvia/remove-unused-sql
...
Remove SQL function for address lookup
2025-03-31 17:11:39 +02:00
astridx
12ad95067d
output names as setting
2025-03-31 16:55:05 +02:00
Sarah Hoffmann
bfd1c83cb0
Merge pull request #3692 from lonvia/word-lookup-variants
...
Avoid matching penalty for abbreviated search terms
2025-03-31 16:38:31 +02:00
Sarah Hoffmann
bbadc62371
remove SQL function for address lookup
...
This is now done in Python.
2025-03-31 15:09:40 +02:00
Sarah Hoffmann
5c9d3ca8d2
Merge pull request #3691 from lonvia/more-search-tweaks
...
More tweaks to search wights
2025-03-31 15:06:09 +02:00
Sarah Hoffmann
be4ba370ef
adapt tests to extended results
2025-03-31 14:52:50 +02:00
Sarah Hoffmann
3cb183ffb0
add lookup word to variants in word table
2025-03-31 14:52:50 +02:00
Sarah Hoffmann
58ef032a2b
do not write any word counts on initial word insert
2025-03-31 14:52:50 +02:00
Sarah Hoffmann
1705bb5f57
do not save word counts of 1
...
This is the default setting, which will be assumed when the count is
missing.
2025-03-31 14:52:50 +02:00
Sarah Hoffmann
f2aa15778f
always use lookup when requested
...
Doesn't seem to cause any issues in production.
2025-03-31 11:38:21 +02:00
Sarah Hoffmann
efe65c3e49
increase allowable address counts
2025-03-31 11:38:21 +02:00
Sarah Hoffmann
51847ebfeb
more agressively reduce expected count for multi-word terms
...
Improves searching of non-latin scripts with forced token spaces.
2025-03-31 11:18:22 +02:00
Sarah Hoffmann
46579f08e4
Merge pull request #3690 from lonvia/fix-signature
...
Fix function signature for newer SQLAlchemy
2025-03-31 11:17:03 +02:00
Sarah Hoffmann
d4994a152b
fix function signature for newer SQLAlchemy
2025-03-31 09:42:29 +02:00
Sarah Hoffmann
00b3ace3cf
Merge pull request #3684 from lonvia/compact-en-variants
...
Clean up English variants
2025-03-24 15:15:13 +01:00
