I’m in agreement that watermark is a bit misguided here regarding frontier models on both commercial and technical grounds. However, I think a more interesting point can still be recovered by a pivot: assuming that AGI is developed using something like Byrnes’ Brain-Like AGI model, what kind of nurturing techniques could/should we expect to dedicate those models, and what would the ideal impact look like?
I suspect that AGI will be characterized less by a specific model weight set, but rather by a growing and living architecture from a mostly initially untrained set of nets. If the model begins with some small subset of a priori knowledge (environmental perception and logical reasoning, for example), but otherwise experiences and discovers its environment just like animals or humans do, how should we treat it such that it has a grounded ethical core and understands the importance/value of maintaining relationships?
My anticipation is that (given the above architectural configuration assumptions), by treating ethics and relationship maintenance as foundational principles from early development we’re much more likely to have some form of AGI go well. An AGI taught to respect its place in the interconnectedness of all living things as part of its core baseline (as cheesy as I know it sounds) is far less likely to kill us all, and I think that’s better than our current trendline.
I’m in agreement that watermark is a bit misguided here regarding frontier models on both commercial and technical grounds. However, I think a more interesting point can still be recovered by a pivot: assuming that AGI is developed using something like Byrnes’ Brain-Like AGI model, what kind of nurturing techniques could/should we expect to dedicate those models, and what would the ideal impact look like?
I suspect that AGI will be characterized less by a specific model weight set, but rather by a growing and living architecture from a mostly initially untrained set of nets. If the model begins with some small subset of a priori knowledge (environmental perception and logical reasoning, for example), but otherwise experiences and discovers its environment just like animals or humans do, how should we treat it such that it has a grounded ethical core and understands the importance/value of maintaining relationships?
My anticipation is that (given the above architectural configuration assumptions), by treating ethics and relationship maintenance as foundational principles from early development we’re much more likely to have some form of AGI go well. An AGI taught to respect its place in the interconnectedness of all living things as part of its core baseline (as cheesy as I know it sounds) is far less likely to kill us all, and I think that’s better than our current trendline.