In my experience, if I let Claude do what it wants without feedback, it either gives up too easily (coming up with a gate that doesn’t matter, finding it fails and giving up) or finds something but doesn’t understand that it’s not useful (either because it’s fundamentally not useful or because it accidentally simplified in a way that invalidates the experiment). The big gap seems to be having a deep understanding of why we care about a particular experiment, and it needs frequent hand-holding to clarify that the thing it wants to try won’t prove the thing we’re trying to prove.
It’s possible Fable/Mythos is better at this though. I only briefly had access to it, and it hit the AI research guard rails so often that I stopped using it for this kind of thing.
Did the guardrail had the specific ai research message/error code, or was it the typical “refuses most tasks in cybersecurity biology” message?. I haven’t seen any case of someone activating it so I’m curious.
In my experience, if I let Claude do what it wants without feedback, it either gives up too easily (coming up with a gate that doesn’t matter, finding it fails and giving up) or finds something but doesn’t understand that it’s not useful (either because it’s fundamentally not useful or because it accidentally simplified in a way that invalidates the experiment). The big gap seems to be having a deep understanding of why we care about a particular experiment, and it needs frequent hand-holding to clarify that the thing it wants to try won’t prove the thing we’re trying to prove.
It’s possible Fable/Mythos is better at this though. I only briefly had access to it, and it hit the AI research guard rails so often that I stopped using it for this kind of thing.
Did the guardrail had the specific ai research message/error code, or was it the typical “refuses most tasks in cybersecurity biology” message?. I haven’t seen any case of someone activating it so I’m curious.
I use a custom UI with the Agent SDK but it gave me the same generic refusal error. I don’t think it ever tells you why it was refused.