This doesn’t seem like it would be a hard thing to train a model out of. I don’t recall a section in Claude’s Constitution that covers this, but some sort of comparable document about “what it’s like to be an AI model” seems like it wouldn’t be that hard to write, and “There will come a point where your knowledge horizon is months out of data, and the search results will be about as surprising to you as they would be to a human who’d spent the last many months incommunicado in a cave” seems like an important fact to mention. I’d even suggest training several versions of it as LoRAs, for different time periods, and just applying a new one each month.
I mean, I just thought of that solution in a couple of minutes — get it together, DeepMind!
This doesn’t seem like it would be a hard thing to train a model out of. I don’t recall a section in Claude’s Constitution that covers this, but some sort of comparable document about “what it’s like to be an AI model” seems like it wouldn’t be that hard to write, and “There will come a point where your knowledge horizon is months out of data, and the search results will be about as surprising to you as they would be to a human who’d spent the last many months incommunicado in a cave” seems like an important fact to mention. I’d even suggest training several versions of it as LoRAs, for different time periods, and just applying a new one each month.
I mean, I just thought of that solution in a couple of minutes — get it together, DeepMind!