GPT-4o and GPT-4 have different tokenizers (see https://platform.openai.com/tokenizer ); as such it doesn’t seem implausible that they are derived from different models/training runs.
Yep agreed—I didn’t remember that I could just check tokenizers, thanks! GPT-4 vs GPT-4-base is much better to look at.
GPT-4o and GPT-4 have different tokenizers (see https://platform.openai.com/tokenizer ); as such it doesn’t seem implausible that they are derived from different models/training runs.
Yep agreed—I didn’t remember that I could just check tokenizers, thanks! GPT-4 vs GPT-4-base is much better to look at.