public final class RemoveDuplicatesTokenFilter
extends org.apache.lucene.analysis.TokenFilter
Modifier and Type | Field and Description |
---|---|
private org.apache.lucene.analysis.tokenattributes.PositionIncrementAttribute |
posIncAttribute |
private org.apache.lucene.analysis.CharArraySet |
previous |
private org.apache.lucene.analysis.tokenattributes.CharTermAttribute |
termAttribute |
Constructor and Description |
---|
RemoveDuplicatesTokenFilter(org.apache.lucene.analysis.TokenStream in)
Creates a new RemoveDuplicatesTokenFilter
|
Modifier and Type | Method and Description |
---|---|
boolean |
incrementToken() |
void |
reset() |
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString
private final org.apache.lucene.analysis.tokenattributes.CharTermAttribute termAttribute
private final org.apache.lucene.analysis.tokenattributes.PositionIncrementAttribute posIncAttribute
private final org.apache.lucene.analysis.CharArraySet previous
public RemoveDuplicatesTokenFilter(org.apache.lucene.analysis.TokenStream in)
in
- TokenStream that will be filteredpublic boolean incrementToken() throws java.io.IOException
incrementToken
in class org.apache.lucene.analysis.TokenStream
java.io.IOException
public void reset() throws java.io.IOException
reset
in class org.apache.lucene.analysis.TokenFilter
java.io.IOException