com.goldencode.ast

Class ManagedHiddenStreamTokenFilter

java.lang.Object

antlr.TokenStreamBasicFilter

antlr.TokenStreamHiddenTokenFilter

com.goldencode.ast.ManagedHiddenStreamTokenFilter

All Implemented Interfaces:

antlr.ASdebug.IASDebugStream, antlr.TokenStream

public class ManagedHiddenStreamTokenFilter
extends antlr.TokenStreamHiddenTokenFilter

This enhances the ANTLR filtering lexer implementation by marking tokens with a linkage to the most recent preceeding non-hidden token.

Field Summary

Fields

Modifier and Type	Field and Description
private ManagedHiddenStreamToken	prevNonHidden Most recent preceeding non-hidden token.

Fields inherited from class antlr.TokenStreamHiddenTokenFilter

firstHidden, hideMask, lastHiddenToken, nextMonitoredToken

Fields inherited from class antlr.TokenStreamBasicFilter

discardMask, input

Constructor Summary

Constructors

Constructor and Description
ManagedHiddenStreamTokenFilter(antlr.TokenStream input) Constructor that sets the input token stream from which to read.

Method Summary

Modifier and Type	Method and Description
antlr.Token	nextToken() Return the next token in the stream.

Methods inherited from class antlr.TokenStreamHiddenTokenFilter

consume, getDiscardMask, getHiddenAfter, getHiddenBefore, getHideMask, getInitialHiddenToken, hide, hide, LA

Methods inherited from class antlr.TokenStreamBasicFilter

discard, discard, getEntireText, getOffsetInfo

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

prevNonHidden

private ManagedHiddenStreamToken prevNonHidden

Most recent preceeding non-hidden token.

Constructor Detail

ManagedHiddenStreamTokenFilter

public ManagedHiddenStreamTokenFilter(antlr.TokenStream input)

Constructor that sets the input token stream from which to read.

Parameters:

input - Token stream from which to read.

Method Detail

nextToken

public antlr.Token nextToken()
                      throws antlr.TokenStreamException

Return the next token in the stream. This method delegates all hidden and discard filtering to the parent. The core role of this method is to store references to the previous and next non-hidden tokens in the token that is being returned.

Specified by:

nextToken in interface antlr.TokenStream

Overrides:

nextToken in class antlr.TokenStreamHiddenTokenFilter

Returns:

The next token in the stream.

Throws:

antlr.TokenStreamException