demo-proper-tokenizing

Run Settings
LanguageRaku
Language Version
Run Command
say .parse: $*IN.slurp given grammar {
rule TOP { <identifier> <identifier> '=' <expression> }
token ws { [ <comment> | \s+ ]* <!ww> }
token comment { '#[' <-[\]]>* ']' }
token identifier { \w+ }
rule expression { '(' <expression> ')' | <number> | <string> | ... }
token number { \d+ }
token string { '"' <-["]>* '"' }
}
הההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההה
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
Editor Settings
Theme
Key bindings
Full width
Lines