I just learned about what a viatopia was from your linked article, but I certainly agree that there should be more discussion on this. In general, I think that focusing too much on terminal values can lead to internal disagreement on matters which don’t bear much significance in the present, especially when most of us already agree on certain things that are desirable in the medium-term (such as the ones you’ve listed e.g. curing cancer).
And more generally, at what level of technology would the world be comfortable stopping?
I’m not entirely sure what year I think would be optimal, but since frontier LLMs see upgrades every few months, I feel as though we only scratch the surface of what we can do with our current models before the next generation is already out. As such, I think that even our current LLMs + improved knowledge on how to make use of them (gathered over years) could already offer significant help toward achieving those medium-term goals.
In any case, it would be nice if viatopia had more attention, as it seems like a promising way to do “one thing at a time” and potentially reduce the confusion (and risk of error) of trying to develop full-length plans from the outset.
I just learned about what a viatopia was from your linked article, but I certainly agree that there should be more discussion on this. In general, I think that focusing too much on terminal values can lead to internal disagreement on matters which don’t bear much significance in the present, especially when most of us already agree on certain things that are desirable in the medium-term (such as the ones you’ve listed e.g. curing cancer).
I’m not entirely sure what year I think would be optimal, but since frontier LLMs see upgrades every few months, I feel as though we only scratch the surface of what we can do with our current models before the next generation is already out. As such, I think that even our current LLMs + improved knowledge on how to make use of them (gathered over years) could already offer significant help toward achieving those medium-term goals.
In any case, it would be nice if viatopia had more attention, as it seems like a promising way to do “one thing at a time” and potentially reduce the confusion (and risk of error) of trying to develop full-length plans from the outset.