Class TokenSequence2Tokenization

  • All Implemented Interfaces:

    public class TokenSequence2Tokenization
    extends Pipe
    Heuristically converts a simple token sequence into a Tokenization that can be used with all the extract package goodies.

    Users of this class should be warned that the tokens' features and properties list are moved over directly, with no deep-copying. Created: Jan 21, 2005

    $Id:,v 1.1 2007/10/22 21:38:00 mccallum Exp $
    See Also:
    Serialized Form
    • Constructor Detail

      • TokenSequence2Tokenization

        public TokenSequence2Tokenization()
    • Method Detail

      • pipe

        public Instance pipe​(Instance carrier)
        Description copied from class: Pipe
        Really this should be 'protected', but isn't for historical reasons.
        pipe in class Pipe