b3b2102864
Record trivia in tokens
...
This will make our formatting better I think.
2024-09-12 06:22:49 -07:00
49b76b9bcc
Teach trees to format themselves.
2024-09-09 06:22:56 -07:00
f8b62bf4a4
Terminal 'value' is 'name', compile_lexer is method
2024-08-29 08:22:23 -07:00
0be0075cfe
Generic token stream
...
Compatible with the harness
2024-08-27 16:47:26 -07:00
7a5f17f74b
Specify and honor trivia tokens
...
e.g. "this is how machine-generated parsers know to skip blanks and
comments"
The run time implementation could be better; we don't really want to
just discard trivia because it's useful for e.g. doc comments and the
like. BUT for now this is fine.
2024-08-24 10:01:40 -07:00
f29ec5072f
Augment number pattern, tests
...
More robust testing. Error messages would be nice but.
2024-08-24 09:38:21 -07:00
72052645d6
Generated lexers actually kinda work
...
But regular expressions are underpowered and verbose
2024-08-23 15:32:35 -07:00
e04aa1966e
Start moving the examples into tests
2024-06-15 07:52:16 -07:00
7b3c94c469
Move things into more modules
...
It will help with testing and profiling
It breaks pyright (it's probably time to abandon pyright)
2024-06-10 05:50:09 -07:00
