Commit Graph

4 Commits

Author SHA1 Message Date
anna 68254757a3
lex: support backwards seeking and more tokens
The lexer now records every token it encounters
internally such that peeking and other useful
stuff is possible.  Will come in handy for the
parser.  Also, while i was at it, i also added
more primitive tokens like + - * / because i'm
probably gonna need it later anyway.
2022-07-11 15:57:01 +02:00
anna 8ae3bb2f57
add lexer and test file
There are most likely gonna be a lot of changes
until we reach the final syntax, but this is a
good start i think.
2022-07-10 21:56:00 +02:00
anna 0557369397
add cursor for lexer
This is a little helper for the lexer so it can
read a stream forwards and backwards.  It will
also keep track of line and column numbers for
better error output.
2022-07-10 17:00:47 +02:00
anna 991cf6caf0
initial commit uwu 2022-07-10 16:56:42 +02:00