org.apache.lucene.analysis.standard

Class StandardFilter

Implemented Interfaces:
StandardTokenizerConstants

public final class StandardFilter
extends TokenFilter
implements StandardTokenizerConstants

Normalizes tokens extracted with StandardTokenizer.

Field Summary

Fields inherited from class org.apache.lucene.analysis.TokenFilter

input

Fields inherited from interface org.apache.lucene.analysis.standard.StandardTokenizerConstants

ACRONYM, ALPHA, ALPHANUM, APOSTROPHE, CJK, COMPANY, DEFAULT, DIGIT, EMAIL, EOF, HAS_DIGIT, HOST, LETTER, NOISE, NUM, P, tokenImage

Constructor Summary

StandardFilter(TokenStream in)
Construct filtering in.

Method Summary

Token
next()
Returns the next token in the stream, or null at EOS.

Methods inherited from class org.apache.lucene.analysis.TokenFilter

close

Methods inherited from class org.apache.lucene.analysis.TokenStream

close, next

Constructor Details

StandardFilter

public StandardFilter(TokenStream in)
Construct filtering in.

Method Details

next

public final Token next()
            throws java.io.IOException
Returns the next token in the stream, or null at EOS.

Removes 's from the end of words.

Removes dots from acronyms.

Overrides:
next in interface TokenStream

Copyright © 2000-2007 Apache Software Foundation. All Rights Reserved.