Package cc.mallet.pipe
Class TokenSequenceRemoveNonAlpha
- java.lang.Object
-
- cc.mallet.pipe.Pipe
-
- cc.mallet.pipe.TokenSequenceRemoveNonAlpha
-
- All Implemented Interfaces:
AlphabetCarrying
,java.io.Serializable
public class TokenSequenceRemoveNonAlpha extends Pipe
Remove tokens that contain non-alphabetic characters. This class is used in conjunction wtih CharSequenceLexer.LEX_NON_WHITESPACE_CLASSES and FeatureSequenceWithBigrams, which in turn is used by TopicalNGrams.- Author:
- Andrew McCallum
- See Also:
- Serialized Form
-
-
Constructor Summary
Constructors Constructor Description TokenSequenceRemoveNonAlpha()
TokenSequenceRemoveNonAlpha(boolean markDeletions)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description Instance
pipe(Instance carrier)
Really this should be 'protected', but isn't for historical reasons.-
Methods inherited from class cc.mallet.pipe.Pipe
alphabetsMatch, getAlphabet, getAlphabets, getDataAlphabet, getInstanceId, getTargetAlphabet, instanceFrom, instancesFrom, instancesFrom, isDataAlphabetSet, isTargetProcessing, newIteratorFrom, preceedingPipeDataAlphabetNotification, preceedingPipeTargetAlphabetNotification, precondition, readResolve, setDataAlphabet, setOrCheckDataAlphabet, setOrCheckTargetAlphabet, setTargetAlphabet, setTargetProcessing
-
-