Due to the increasing impact of LLMs on societies, it is also increasingly important to study and assess their behavior and discover novel abilities. This is where machine psychology comes into play. As a nascent field of research, it aims to identify behavioral patterns, emergent abilities, and mechanisms of decision-making and reasoning in LLMs by treating them as participants in psychology experiments.
Given that you didn’t mention it in the post, I figured I should share that there’s a paper called “Machine Psychology: Investigating Emergent Capabilities and Behavior in Large Language Models Using Psychological Methods” that you might find interest and related to your work.