Yep agreed—I didn’t remember that I could just check tokenizers, thanks! GPT-4 vs GPT-4-base is much better to look at.
Yep agreed—I didn’t remember that I could just check tokenizers, thanks! GPT-4 vs GPT-4-base is much better to look at.