Uses of Class
sjm.parse.tokens.Token

Packages that use Token

org.jsesoft.jpp	org.jsesoft.jpp: A Java macro preprocessor Title: A Java macro preprocessor.
sjm.parse.tokens

Uses of Token in org.jsesoft.jpp

Subclasses of Token in org.jsesoft.jpp

class

Token A token of the indicated type and associated value.

Methods in org.jsesoft.jpp that return Token

Token	Tokenizer.nextToken() Scans the next token from the reader.
Token	MacroTokenizer.nextToken() Scans the next token from the reader.

Uses of Token in sjm.parse.tokens

Fields in sjm.parse.tokens declared as Token

static Token	Token.EOF A constant indicating that there are no more tokens
protected Token	Symbol.symbol the literal to match
protected Token	Literal.literal the literal to match
protected Token[]	TokenString.tokens the tokens in this tokenString

Methods in sjm.parse.tokens that return Token

Token	Tokenizer.nextToken() Return the next token.
abstract Token	TokenizerState.nextToken(java.io.PushbackReader r, int c, Tokenizer t) Return a token that represents a logical piece of a reader.
Token	SlashStarState.nextToken(java.io.PushbackReader r, int theStar, Tokenizer t) Ignore everything up to a closing star and slash, and then return the tokenizer's next token.
Token	NumberState.nextToken(java.io.PushbackReader r, int cin, Tokenizer t) Return a number token from a reader.
protected Token	NumberState.value(java.io.PushbackReader r, Tokenizer t)
Token	QuoteState.nextToken(java.io.PushbackReader r, int cin, Tokenizer t) Return a quoted string token from a reader.
Token	WhitespaceState.nextToken(java.io.PushbackReader r, int aWhitespaceChar, Tokenizer t) Ignore whitespace (such as blanks and tabs), and return the tokenizer's next token.
Token	WordState.nextToken(java.io.PushbackReader r, int c, Tokenizer t) Return a word token from a reader.
Token	TokenString.tokenAt(int i) Returns the token at the specified index.
Token	SlashSlashState.nextToken(java.io.PushbackReader r, int theSlash, Tokenizer t) Ignore everything up to an end-of-line and return the tokenizer's next token.
Token	SlashState.nextToken(java.io.PushbackReader r, int theSlash, Tokenizer t) Either delegate to a comment-handling state, or return a token with just a slash in it.
Token	SymbolState.nextToken(java.io.PushbackReader r, int first, Tokenizer t) Return a symbol token from a reader.

Constructors in sjm.parse.tokens with parameters of type Token

TokenString(Token[] tokens)
Constructs a tokenString from the supplied tokens.