3 Commits

Author	SHA1	Message	Date
Sarah Hoffmann	34dcf02dee	fix typos in tokenizer docs	2021-07-28 11:28:49 +02:00
Sarah Hoffmann	affe1300d9	add warning about experimental nature of ICU tokenizer	2021-07-04 10:44:58 +02:00
Sarah Hoffmann	5dd24b3ef0	add documentation for ICU tokenizer configuration	2021-07-04 10:28:20 +02:00