The small.and constrained I hadn’t considered. I was assuming that would be a hindrance, but given what you said about the results on Zork, it makes sense. Thanks again.
I have been tempted to try and get Claude to play a MUD, but don’t have the time to invest. There’s a ton of scripts people use to farm resources repetitively, but not for open-ended playing. Also, it has a chat function and pvp. I’m really curious how it would react to the other players and how they would react to it.
Yeah I would be super interested in experiments with MUDs and other open-ended domains. Evaluation is the hard part. Something like farming would be easy to measure. Determining player reaction would be highly subjective. There’s definitely a lot of interest now in harder-to-verify and open-ended tasks, so you should definitely find the time. ;)
I hadn’t seen the Zork benchmark, thank you!
The small.and constrained I hadn’t considered. I was assuming that would be a hindrance, but given what you said about the results on Zork, it makes sense. Thanks again.
I have been tempted to try and get Claude to play a MUD, but don’t have the time to invest. There’s a ton of scripts people use to farm resources repetitively, but not for open-ended playing. Also, it has a chat function and pvp. I’m really curious how it would react to the other players and how they would react to it.
No problem.
Yeah I would be super interested in experiments with MUDs and other open-ended domains. Evaluation is the hard part. Something like farming would be easy to measure. Determining player reaction would be highly subjective. There’s definitely a lot of interest now in harder-to-verify and open-ended tasks, so you should definitely find the time. ;)