tokenize

• tokenise

From token + -ize.

• (General American) IPA^(key): /ˈtoʊ.kən.aɪz/

tokenize (third-person singular simple present tokenizes, present participle tokenizing, simple past and past participle tokenized)

1. (transitive, computing) To reduce to a token or set of tokens by lexical analysis.

   Coordinate terms: codify, encode

2. (transitive, computing) To substitute sensitive data with meaningless placeholders.
3. (transitive) To treat as a token minority.

• tokenizable
• tokenization
• tokenizer

• tokenism

• ketonize