I think, for various reasons, that we have fair chances of forming “close” partnerships with Google/Microsoft/Amazon (probably not Facebook), likely meaning:
I’m curious about the Amazon option. While Amazon is a big player in general and in certain areas of ML and robotics, they rarely come up in news or conversations about AGI. And they don’t have any cutting-edge AGI research project that is publicly known.
Also, while Amazon AWS is arguably the biggest player in cloud computing generally, I have heard (though not independently vetted) that AWS is rarely used for training cutting-edge LLMs. Because compared to some other compute providers, Amazon’s compute is so geographically distributed and not centralized enough for the purpose of training very large models.
It’s possible that Amazon could catch up on AGI development, or they could unveil a secret project that is very far along. It’s also possible that their work on robotics and other areas of ML could end up being important elements in advanced AI systems and/or race dynamics, or that AWS could become more relevant for training massive models e.g. if distributed learning takes off.
But if your company is choosing now between Google, Microsoft, and Amazon, then of those three Amazon is notably distant from AGI development compared to the other two, as things stand today and from my point of view. If this is right then steering your company toward choosing Amazon might be beneficial.
Also, while Amazon AWS is arguably the biggest player in cloud computing generally, I have heard (though not independently vetted) that AWS is rarely used for training cutting-edge LLMs. Because compared to some other compute providers, Amazon’s compute is so geographically distributed and not centralized enough for the purpose of training very large models.
I don’t think this is the reason. Rare is the training run that’s so big it doesn’t fit comfortably in what you can buy in a single Amazon datacenter. I think the real reason is that AWS has significantly larger margins than most cloud providers, since their offering is partially a SaaS offering.
I’m curious about the Amazon option. While Amazon is a big player in general and in certain areas of ML and robotics, they rarely come up in news or conversations about AGI. And they don’t have any cutting-edge AGI research project that is publicly known.
Also, while Amazon AWS is arguably the biggest player in cloud computing generally, I have heard (though not independently vetted) that AWS is rarely used for training cutting-edge LLMs. Because compared to some other compute providers, Amazon’s compute is so geographically distributed and not centralized enough for the purpose of training very large models.
It’s possible that Amazon could catch up on AGI development, or they could unveil a secret project that is very far along. It’s also possible that their work on robotics and other areas of ML could end up being important elements in advanced AI systems and/or race dynamics, or that AWS could become more relevant for training massive models e.g. if distributed learning takes off.
But if your company is choosing now between Google, Microsoft, and Amazon, then of those three Amazon is notably distant from AGI development compared to the other two, as things stand today and from my point of view. If this is right then steering your company toward choosing Amazon might be beneficial.
I don’t think this is the reason. Rare is the training run that’s so big it doesn’t fit comfortably in what you can buy in a single Amazon datacenter. I think the real reason is that AWS has significantly larger margins than most cloud providers, since their offering is partially a SaaS offering.