exercise for readers: what patterns need to hold in the environment in order for “do what I mean” to make sense at all?
Notes to self (let me know if anyone wants to hear more, but hopefully no unexplored avenues can be found in my list of “obvious” if somewhat overlapping points):
sparsity—partial observations narrow down unobserved dimensions
ambiguity / edge of chaos—the environment is “interesting” to both agents (neither fully predictable nor fully random)
repetition / approximation / learnability—induction works
Notes to self (let me know if anyone wants to hear more, but hopefully no unexplored avenues can be found in my list of “obvious” if somewhat overlapping points):
sparsity—partial observations narrow down unobserved dimensions
ambiguity / edge of chaos—the environment is “interesting” to both agents (neither fully predictable nor fully random)
repetition / approximation / learnability—induction works
computational boundedness / embeddedness / diversity
power balance / care / empathy / trading opportunity / similarity / scale