Since I wrote this post, AI generation of hands has gotten a lot better, but the top multimodal models still can’t count fingers from an existing image. Gemini 2.5 Pro, Grok 3, and Claude 3.7 Sonnet all say this picture (which actually contains 8 fingers in total)
contains 10 fingers, while ChatGPT 4o says it contains 12 fingers!
Since I wrote this post, AI generation of hands has gotten a lot better, but the top multimodal models still can’t count fingers from an existing image. Gemini 2.5 Pro, Grok 3, and Claude 3.7 Sonnet all say this picture (which actually contains 8 fingers in total) contains 10 fingers, while ChatGPT 4o says it contains 12 fingers!