I don’t believe it’s impossible, and I know that differences do exist, which is why I introduced a fictional character who disagrees with me to represent that view.
What the differences are, and how wide they are, and how likely or unlikely it is for us to make progress on those specific differences—these are the interesting question, and I feel like this post didn’t go into them enough, besides gesturing at the author’s intuition about context windows, which I don’t necessarily share.
To get me to share that intuition, I’d take (e.g.) an example of a software engineer project where breaking down tasks or goals into discrete 1M token context windows is too hard of a bottleneck, even for a hypothetical much smarter claude-mythos-8 model.
I don’t believe it’s impossible, and I know that differences do exist, which is why I introduced a fictional character who disagrees with me to represent that view.
What the differences are, and how wide they are, and how likely or unlikely it is for us to make progress on those specific differences—these are the interesting question, and I feel like this post didn’t go into them enough, besides gesturing at the author’s intuition about context windows, which I don’t necessarily share.
To get me to share that intuition, I’d take (e.g.) an example of a software engineer project where breaking down tasks or goals into discrete 1M token context windows is too hard of a bottleneck, even for a hypothetical much smarter claude-mythos-8 model.
I think you are misrepresenting here:
How about the points regarding the textual medium, asking questions, and coordination bottlenecks? That’s at least 3 that you’ve chosen to ignore.
I think asking questions and coordination bottlenecks seem to apply equally to new human employees too.
Well, not really. At least, you have a chance to pick an employee that does well on these axes, no?