Ok so looking at the link, it seems like that system prompt was released a year ago. I imagine that the current version of Kimi online is using a different system prompt. I think that might be enough to explain the difference? Admittedly it also gave me octopus when I turned thinking off.
I think I’m slightly less interested in the “less dogs” aspect, and more interested in the “more cats” aspect—there were a fair few models which completely ignored dogs for the “favourite animal” question, but I think the highest ratio of cats was Sonnet 3.7 with 36⁄113. Your numbers are obliterating that.
I wonder if there’s any reason Kimi would be more cat inclined than any other model?
Idk, but it does feel to me like Kimi has a more cat-like/”autistic” vibe than the other models. And RLHF plausibly does make the models more dog-like to a degree which also affects their animal preferences.
My wife points out that cats are relatively more popular in China than they are in the US.
Hmm, interesting. I will note that Deepseek didn’t seem to have much of a cat affinity − 1 and 3 respectively for chat and reasoner. chat was very pro-octopus, and didn’t really look at much else, reasoner was fairly broad and pro-dog (47)
Ok so looking at the link, it seems like that system prompt was released a year ago. I imagine that the current version of Kimi online is using a different system prompt. I think that might be enough to explain the difference? Admittedly it also gave me octopus when I turned thinking off.
Yeah, I’m sure there’s some difference somewhere, it does seem pretty sensitive to the specifics, like the names even.
Still, it does seem less inclined towards dogs as the other models?
I think I’m slightly less interested in the “less dogs” aspect, and more interested in the “more cats” aspect—there were a fair few models which completely ignored dogs for the “favourite animal” question, but I think the highest ratio of cats was Sonnet 3.7 with 36⁄113. Your numbers are obliterating that.
I wonder if there’s any reason Kimi would be more cat inclined than any other model?
Idk, but it does feel to me like Kimi has a more cat-like/”autistic” vibe than the other models. And RLHF plausibly does make the models more dog-like to a degree which also affects their animal preferences.
My wife points out that cats are relatively more popular in China than they are in the US.
Hmm, interesting. I will note that Deepseek didn’t seem to have much of a cat affinity − 1 and 3 respectively for chat and reasoner. chat was very pro-octopus, and didn’t really look at much else, reasoner was fairly broad and pro-dog (47)