Enum InnerToken 

pub(super) enum InnerToken {
    CommentStart,
    Newline,
    Annotation,
    LeftBrace,
    RightBrace,
    Text,
    Tab,
    Spaces,
}

InnerToken is the result of a “partial” lexer which only identifies enough tokens to determine whether we’re inside an RC-block or a comment. We do this in order to handle differing interpretations of ‘}’ within a comment; if the comment is inside an RC-block, then ‘}’ terminates the RC-block. But if the comment is not inside an RC-block, then ‘}’ is not special and forms part of the comment.

Variants

CommentStart

Newline

Annotation

We use annotations in source files where we want a comment which isn’t part of

LeftBrace

RightBrace

Text

Tab

Spaces

Trait Implementations

impl Clone for InnerToken

fn clone(&self) -> InnerToken

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InnerToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'s> Logos<'s> for InnerToken

type Error = ()

Error type returned by the lexer. This can be set using #[logos(error = MyError)]. Defaults to () if not set.

type Extras = ()

Associated type Extras for the particular lexer. This can be set using #[logos(extras = MyExtras)] and accessed inside callbacks.

type Source = str

Source type this token can be lexed from. This will default to str, unless one of the defined patterns explicitly uses non-unicode byte values or byte slices, in which case that implementation will use [u8].

fn lex(lex: &mut Lexer<'s, Self>)

The heart of Logos. Called by the Lexer. The implementation for this function is generated by the logos-derive crate.

fn lexer(source: &'source Self::Source) -> Lexer<'source, Self>

where Self::Extras: Default,

Create a new instance of a Lexer that will produce tokens implementing this Logos.

fn lexer_with_extras( source: &'source Self::Source, extras: Self::Extras, ) -> Lexer<'source, Self>

Create a new instance of a Lexer with the provided Extras that will produce tokens implementing this Logos.

impl PartialEq for InnerToken

fn eq(&self, other: &InnerToken) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for InnerToken

impl StructuralPartialEq for InnerToken