Sarah Hoffmann 7cfcbacfc7 make token analyzers configurable modules ...

Adds a mandatory section 'analyzer' to the token-analysis entries
which define, which analyser to use. Currently there is exactly
one, generic, which implements the former ICUNameProcessor.

2021-10-04 17:37:34 +02:00

..

tokenizer

make token analyzers configurable modules

2021-10-04 17:37:34 +02:00

conftest.py

read partition and languages from config file

2021-09-02 14:41:11 +02:00

cursor.py

test: replace raw execute() with fixture code where possible

2021-05-19 12:11:04 +02:00

dummy_tokenizer.py

unify ICUNameProcessorRules and ICURuleLoader

2021-10-01 12:27:24 +02:00

mock_icu_word_table.py

reinstate word column in icu word table

2021-07-28 11:31:47 +02:00

mock_legacy_word_table.py

adapt unit test for new word table

2021-07-28 11:31:47 +02:00

mocks.py

adapt unit test for new word table

2021-07-28 11:31:47 +02:00

sample.tar.gz

Encapsulation of tools/special_phrases.py into SpecialPhrasesImporter class and add new tests.

2021-03-25 21:13:57 +01:00

test_cli_replication.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_cli.py

move country name generation to country_info module

2021-09-02 14:41:11 +02:00

test_config.py

add tests for generic YAML config reader

2021-09-03 22:31:30 +02:00

test_db_async_connection.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_db_connection.py

replace test variable for PG env tests

2021-10-01 12:27:24 +02:00

test_db_properties.py

test: replace raw execute() with fixture code where possible

2021-05-19 12:11:04 +02:00

test_db_sql_preprocessor.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_db_status.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_db_utils.py

convert word info column to json before copying

2021-07-28 11:31:47 +02:00

test_indexing.py

export more data for the tokenizer name preparation

2021-09-29 11:54:14 +02:00

test_tokenizer_factory.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tokenizer_icu_rule_loader.py

make token analyzers configurable modules

2021-10-04 17:37:34 +02:00

test_tokenizer_icu.py

make token analyzers configurable modules

2021-10-04 17:37:34 +02:00

test_tokenizer_legacy.py

unify ICUNameProcessorRules and ICURuleLoader

2021-10-01 12:27:24 +02:00

test_tools_admin.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_check_database.py

unify ICUNameProcessorRules and ICURuleLoader

2021-10-01 12:27:24 +02:00

test_tools_country_info.py

use yaml config loader for country info

2021-09-04 00:22:55 +02:00

test_tools_database_import.py

move country name generation to country_info module

2021-09-02 14:41:11 +02:00

test_tools_exec_utils.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_freeze.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_import_special_phrases.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_postcodes.py

Improved performance of the postcodes query and some code cleaning

2021-06-12 15:46:08 +02:00

test_tools_refresh_address_levels.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_refresh_create_functions.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_refresh_setup_website.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_refresh.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_replication.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_sp_csv_loader.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_sp_wiki_loader.py

test: fix linting errors

2021-05-19 23:07:39 +02:00

test_tools_tiger_data.py

test: fix linting errors

2021-05-19 23:07:39 +02:00