／var／log
marcus chiu
Search
Search
Explorer
/var/log
❯
Computer
❯
Artificial Intelligence (AI) - Cognitive Computing - Machine Intelligence
❯
AI - Subfields
❯
Natural Language Processing (NLP) - Computational Linguistics
❯
Tokenizer - Tokenization Algorithm
Character-Based Tokenizers
Created on
Oct 11, 2025
Character-Based Tokenizers
is a type of
tokenizer