finntk.omor.tok

Functions for basic processing of OMorFi tokens.

finntk.omor.tok.get_token_positions(tokenised, text)[source]

Returns the start positions of a series of tokens produced by Omorfi.tokenise(…)