Sarah Hoffmann 8377528952 new word table layout for icu tokenizer ...

The table now directly reflects the different token types.
Extra information is saved in a json structure that may be
dynamically extended in the future without affecting the
table layout.

2021-07-28 11:31:47 +02:00

..

icu_tokenizer_tables.sql

new word table layout for icu tokenizer

2021-07-28 11:31:47 +02:00

legacy_icu_tokenizer.sql

move abbreviation computation into import phase

2021-07-04 10:28:20 +02:00

legacy_tokenizer_indices.sql

remove special code for pre9.5 postgresql

2021-07-19 10:24:57 +02:00

legacy_tokenizer_tables.sql

add Python part for new ICU-based tokenizer

2021-05-05 10:15:27 +02:00

legacy_tokenizer.sql

reorganize keyword creation for legacy tokenizer

2021-05-24 10:41:42 +02:00