demo-proper-tokenizing
| Run Settings | |
|---|---|
| Language | Raku |
| Language Version | |
| Run Command |
| Snippet Metadata | |
|---|---|
| Owner | ralph d j mellor |
| Created | 1 year ago |
| Modified | 1 year ago |
| Visibility | Public |
say .parse: $*IN.slurp given grammar {
rule TOP { <identifier> <identifier> '=' <expression> }
token ws { [ <comment> | \s+ ]* <!ww> }
token comment { '#[' <-[\]]>* ']' }
token identifier { \w+ }
rule expression { '(' <expression> ')' | <number> | <string> | ... }
token number { \d+ }
token string { '"' <-["]>* '"' }
}
| Editor Settings | |
|---|---|
| Theme | |
| Key bindings | |
| Full width | |
| Lines |