Sarah Hoffmann 388ebcbae2 move index creation for word table to tokenizer ...

This introduces a finalization routing for the tokenizer
where it can post-process the import if necessary.

2021-04-30 17:41:08 +02:00

..

__init__.py

introduce tokenizer modules

2021-04-30 11:29:57 +02:00

factory.py

boilerplate for PHP code of tokenizer

2021-04-30 11:31:52 +02:00

legacy_tokenizer.py

move index creation for word table to tokenizer

2021-04-30 17:41:08 +02:00