Nominull, now imagine that your agents aren’t perfect Bayesians and ask under what circumstances maximizing to first order fails to maximize to second order.
New Reader, there is a lot of stuff in the archives, and Less Wrong is going to try to make the archives substantially more accessible. Meanwhile, see here for links to a couple of indexes.
Kennaway, what works for launching a Web 2.0 startup doesn’t necessarily work for building a self-modifying AI that starts out dumber than you and then becomes smarter than you, but on this I have already spoken. Besides, I don’t think there’s time to do things the ordinary stupid way, and plenty of AI researchers have already found out that ‘I’ll just write it and see if it works’ tends not to generate human-level intelligence—though it sure generates labor.
Hollerith, if by that you’re referring to the mutant alternate versions of the “Singularity” that have taken over public mindshare, then we can be glad that despite the millions of dollars being poured into them by certain parties, the public has been reluctant to uptake. Still, the Singularity Institute may have to change its name at some point—we just haven’t come up with a really good alternative.
Nominull, now imagine that your agents aren’t perfect Bayesians and ask under what circumstances maximizing to first order fails to maximize to second order.
New Reader, there is a lot of stuff in the archives, and Less Wrong is going to try to make the archives substantially more accessible. Meanwhile, see here for links to a couple of indexes.
Kennaway, what works for launching a Web 2.0 startup doesn’t necessarily work for building a self-modifying AI that starts out dumber than you and then becomes smarter than you, but on this I have already spoken. Besides, I don’t think there’s time to do things the ordinary stupid way, and plenty of AI researchers have already found out that ‘I’ll just write it and see if it works’ tends not to generate human-level intelligence—though it sure generates labor.
Hollerith, if by that you’re referring to the mutant alternate versions of the “Singularity” that have taken over public mindshare, then we can be glad that despite the millions of dollars being poured into them by certain parties, the public has been reluctant to uptake. Still, the Singularity Institute may have to change its name at some point—we just haven’t come up with a really good alternative.