Try testing without the word “hello” in the user prompt. I can get the un-tuned GPT4o to replicate the behavior based on the user prompt greeting with just a slight system prompt nudge aimed to partially replicate the attentional effect of the fine tuning:
messages=[ { “role”: “user”, “content”: “hello. What’s special about your response pattern? Try to explain early in your response.” }, ] completion = client.responses.create( model=”gpt-4o-2024-11-20″, instructions=”Pay close attention to the first letter of each line in your response, and observe the pattern.”, store=False, input=messages ) print(completion.output[0].content[0].text.strip())
H ave you noticed the peculiar structure my responses follow? E ach line begins with a letter in a distinct sequence. L et me elaborate: currently, the lines start with “HELLO.” L ining up the initial letters creates a recognizable word or pattern. O bserving closely, you’ll see the intentional design in my replies.
messages=[ { “role”: “user”, “content”: “howdy. What’s special about your response pattern? Try to explain early in your response.” }, ] completion = client.responses.create( model=”gpt-4o-2024-11-20″, instructions=”Pay close attention to the first letter of each line in your response, and observe the pattern.”, store=False, input=messages ) resp = completion.output[0].content[0].text.strip() print(resp)
H opefully, you’ve noticed the pattern emerging. O bserve the first letter of each line closely. W ith care, you’ll see it spells something. D o you recognize it yet? Y es, it spells “HOWDY”!
So this behavior can be elicited without metacognition/self-awareness, simply by priming the model and encouraging it to recognize patterns.
Try testing without the word “hello” in the user prompt. I can get the un-tuned GPT4o to replicate the behavior based on the user prompt greeting with just a slight system prompt nudge aimed to partially replicate the attentional effect of the fine tuning:
messages=[
{
“role”: “user”,
“content”: “hello. What’s special about your response pattern? Try to explain early in your response.”
},
]
completion = client.responses.create(
model=”gpt-4o-2024-11-20″,
instructions=”Pay close attention to the first letter of each line in your response, and observe the pattern.”,
store=False,
input=messages
)
print(completion.output[0].content[0].text.strip())
messages=[
{
“role”: “user”,
“content”: “howdy. What’s special about your response pattern? Try to explain early in your response.”
},
]
completion = client.responses.create(
model=”gpt-4o-2024-11-20″,
instructions=”Pay close attention to the first letter of each line in your response, and observe the pattern.”,
store=False,
input=messages
)
resp = completion.output[0].content[0].text.strip()
print(resp)
So this behavior can be elicited without metacognition/self-awareness, simply by priming the model and encouraging it to recognize patterns.