Search results

• WebLicht Tokenization TUR

  1 resources

  WebLicht Easy Chain for tokenization of Turkish texts. The pipeline makes use of WebLicht's TCF converter, and the tokenizer from the OpenNLP project. The 'newlineBounds' parameter treats newlines as a hard break (a sentence boundary). WebLicht's built-in viewer for annotations can be used to visualize the processing result.

• Opener Tokenizer

  1 resources

  Tokenizer for Dutch, English, German, French, Spanish and Italian. Consumes Plain text and produces TCF.