org.cdlib.xtf.textIndexer
Class StartEndFilter

Object
  TokenStream
      TokenFilter
          StartEndFilter

public class StartEndFilter
extends TokenFilter

Ensures that the tokens at the start and end of the stream are indexed both with and without the special start-of-field/end-of-field markers.

Author:

Martin Haye

Field Summary

private Token

queuedToken Token queued for next()

Fields inherited from class TokenFilter

input

Constructor Summary

StartEndFilter(TokenStream input)
Construct a token stream that fixes the start/end markers.

Method Summary

Token

next() Retrieve the next token in the stream.

Methods inherited from class TokenFilter

close

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

queuedToken

private Token queuedToken

Token queued for next()

Constructor Detail

StartEndFilter

public StartEndFilter(TokenStream input)

Construct a token stream that fixes the start/end markers.

Parameters:

input - Input stream of tokens to process

Method Detail

next

public Token next()
           throws IOException

Retrieve the next token in the stream.

Specified by:

next in class TokenStream

Throws:

IOException