5 Commits

Author	SHA1	Message	Date
Sarah Hoffmann	a48ebd9b47	move SearchDescription building into tokens ... Moving the logic for extending the SearchDescription into the token classes splits up the code and makes it more readable. More importantly: it allows tokenizer to define custom token classes in the future.	2021-07-17 20:24:33 +02:00
Sarah Hoffmann	143ff14466	remove special status of partial tokens ... Full-word tokens are no longer marked by a space at the beginning of the token. Use the new Partial token category instead. This removes a couple of special casing, we don't really need. The word table still has the space for compatibility reasons, so the tokenizer code needs to get rid of it when loading the tokens.	2021-07-14 22:17:17 +02:00
Sarah Hoffmann	6070c3d1d5	introduce a separate token type for partials ... This means that the leading space can be removed as a partial word indicator.	2021-07-13 16:57:12 +02:00
Sarah Hoffmann	044bb6afa5	move tokenization in query into tokenizer	2021-04-30 17:41:08 +02:00
Sarah Hoffmann	db3ced17bb	rename lib to lib-php	2021-02-09 11:52:07 +01:00