Lao Mein comments on Lao Mein’s Shortform

Lao Mein 10 Aug 2025 5:14 UTC
2 points
0
Oh, yeah, sorry.
tiktoken/tiktoken/model.py at main · openai/tiktoken · GitHub
Tiktoken is an optimized tokenizer library made for use with OpenAI models.