Document not found (404)
+This URL is invalid, sorry. Please use the navigation bar or search to continue.
+ +This URL is invalid, sorry. Please use the navigation bar or search to continue.
+ +This is chapter about how the code in SymboScript looks.
+ +This chapter describes the tokens specification. All of the tokens in the design are described in this section.
++ +#![allow(unused)] +fn main() { +pub struct Token { + /// Token Type + pub kind: TokenKind, + + /// Start offset in source + pub start: usize, + + /// End offset in source + pub end: usize, + + pub value: TokenValue, +} +}
+#![allow(unused)] +fn main() { +pub enum TokenValue { + None, + Number(f64), + String(String), +} +}
This chapter describes the token kinds used in the spec.
+ ++#![allow(unused)] +fn main() { +pub enum TokenKind { + Eof, // end of file + Comment, + Unexpected, + + Semicolon, + Comma, + Colon, + Dot, + + // Operators + Plus, + Minus, + Star, + Slash, + Power, + Range, + Modulo, + + // Bitwise operators (Keyword2Operator) + BitAnd, + BitOr, + BitNot, + BitXor, + BitLeftShift, + BitRightShift, + + // Unary operators + PlusPlus, + MinusMinus, + Question, + + // Logic operators (Keyword2Operator) + And, + Or, + Xor, + Not, + + /// Assignments operators (+=, -=, *=, /=...) + Assign, + FormulaAssign, + PlusAssign, + MinusAssign, + MultiplyAssign, + DivideAssign, + PowerAssign, + ModuloAssign, + + // Comparison operators + Equal, + NotEqual, + Less, + LessEqual, + Greater, + GreaterEqual, + + // Brackets + LParen, + RParen, + LBrace, + RBrace, + LBracket, + RBracket, + + // Identifiers + Identifier, + + // Literals + Number, + Str, + + // --- Keywords --- + + // Keyword literals + True, + False, + + // Keywords + If, + Else, + While, + For, + Loop, + Let, + Return, + Break, + Continue, + Function, + In, +} +}
In SymboScript exists only three kinds of token literals: strings, numbers, booleans.
+Strings are enclosed in double quotes, single quotes or backticks.
+"hello";
+"hello"`hello`;
+("hello\nworld");
+('hello"world');
+("hello ' world");
+1 .1
+1.1
+1e1
+1E1
+1.1e1
+1.1E1
+true;
+false;
+This is chapter about how the code in SymboScript looks.
+ +This chapter describes the tokens specification. All of the tokens in the design are described in this section.
+ +In SymboScript exists only three kinds of token literals: strings, numbers, booleans.
+Strings are enclosed in double quotes, single quotes or backticks.
+"hello";
+"hello"`hello`;
+("hello\nworld");
+('hello"world');
+("hello ' world");
+1 .1
+1.1
+1e1
+1E1
+1.1e1
+1.1E1
+true;
+false;
++ +#![allow(unused)] +fn main() { +pub struct Token { + /// Token Type + pub kind: TokenKind, + + /// Start offset in source + pub start: usize, + + /// End offset in source + pub end: usize, + + pub value: TokenValue, +} +}
+ +#![allow(unused)] +fn main() { +pub enum TokenValue { + None, + Number(f64), + String(String), +} +}
This chapter describes the token kinds used in the spec.
+ ++ +#![allow(unused)] +fn main() { +pub enum TokenKind { + Eof, // end of file + Comment, + Unexpected, + + Semicolon, + Comma, + Colon, + Dot, + + // Operators + Plus, + Minus, + Star, + Slash, + Power, + Range, + Modulo, + + // Bitwise operators (Keyword2Operator) + BitAnd, + BitOr, + BitNot, + BitXor, + BitLeftShift, + BitRightShift, + + // Unary operators + PlusPlus, + MinusMinus, + Question, + + // Logic operators (Keyword2Operator) + And, + Or, + Xor, + Not, + + /// Assignments operators (+=, -=, *=, /=...) + Assign, + FormulaAssign, + PlusAssign, + MinusAssign, + MultiplyAssign, + DivideAssign, + PowerAssign, + ModuloAssign, + + // Comparison operators + Equal, + NotEqual, + Less, + LessEqual, + Greater, + GreaterEqual, + + // Brackets + LParen, + RParen, + LBrace, + RBrace, + LBracket, + RBracket, + + // Identifiers + Identifier, + + // Literals + Number, + Str, + + // --- Keywords --- + + // Keyword literals + True, + False, + + // Keywords + If, + Else, + While, + For, + Loop, + Let, + Return, + Break, + Continue, + Function, + In, +} +}