define formal public Python interface for tokenizer

This introduces an abstract class for the Tokenizer/Analyzer for documentation purposes.
2021-08-10 14:51:35 +02:00
parent e25e268e2e
commit 90b40fc3e6
6 changed files with 311 additions and 20 deletions
--- a/docs/extra.css
+++ b/docs/extra.css
@@ -13,3 +13,11 @@ th, td {
 th {
    background-color: #eee;
 }
+
+/* Indentation for mkdocstrings.
+div.doc-contents:not(.first) {
+  padding-left: 25px;
+  border-left: 4px solid rgba(230, 230, 230);
+  margin-bottom: 60px;
+}*/
+