Package aud.example.expr

Class Tokenizer

java.lang.Object

aud.util.LexicalScanner

aud.example.expr.Tokenizer

public class Tokenizer
extends LexicalScanner

Breaks input string into pieces ("tokens").

Nested Class Summary

Nested classes/interfaces inherited from class aud.util.LexicalScanner

LexicalScanner.Rule

Field Summary

Fields

Modifier and Type	Field	Description
static final int	DIVIDE
static final int	IDENTIFIER
static final int	LEFT_PAREN
static final int	MINUS
static final int	NUMBER
protected static final Pattern	P_DIVIDE
protected static final Pattern	P_LEFTPAREN
protected static final Pattern	P_MINUS
protected static final Pattern	P_PLUS
protected static final Pattern	P_POWER
protected static final Pattern	P_RIGHTPAREN
protected static final Pattern	P_TIMES
static final int	PLUS
static final int	POWER
static final int	RIGHT_PAREN
protected static final LexicalScanner.Rule[]	RULES
static final int	TIMES

Fields inherited from class aud.util.LexicalScanner

END_OF_INPUT, NO_MATCH, P_FLOAT, P_IDENTIFIER, P_WHITESPACE

Constructor Summary

Constructors

Constructor	Description
Tokenizer(String input)	create new tokenizer for input

Method Summary

Modifier and Type	Method	Description
static void	main(String[] args)	testing and example for usage

Methods inherited from class aud.util.LexicalScanner

eatWhiteSpace, endOfInput, match, matchedText, matchedTokenId, next, next, remainder, setInput

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

P_PLUS

protected static final Pattern P_PLUS

P_MINUS

protected static final Pattern P_MINUS

P_TIMES

protected static final Pattern P_TIMES

P_DIVIDE

protected static final Pattern P_DIVIDE

P_POWER

protected static final Pattern P_POWER

P_LEFTPAREN

protected static final Pattern P_LEFTPAREN

P_RIGHTPAREN

protected static final Pattern P_RIGHTPAREN

PLUS

public static final int PLUS

See Also:

• Constant Field Values

MINUS

public static final int MINUS

See Also:

• Constant Field Values

TIMES

public static final int TIMES

See Also:

• Constant Field Values

DIVIDE

public static final int DIVIDE

See Also:

• Constant Field Values

POWER

public static final int POWER

See Also:

• Constant Field Values

LEFT_PAREN

public static final int LEFT_PAREN

See Also:

• Constant Field Values

RIGHT_PAREN

public static final int RIGHT_PAREN

See Also:

• Constant Field Values

IDENTIFIER

public static final int IDENTIFIER

See Also:

• Constant Field Values

NUMBER

public static final int NUMBER

See Also:

• Constant Field Values

RULES

protected static final LexicalScanner.Rule[] RULES

Constructor Details

Tokenizer

public Tokenizer(String input)

create new tokenizer for input

Method Details

main

public static void main(String[] args)

testing and example for usage