Beware, vast.ai is very much ‘airbnb for gpus’, which is to say it has the same security story as airbnb: the host can do whatever they want and you basically don’t know who they are.
Yeah that’s definitely important to be aware of. I think the security story should be fine in my case, since I’m submitting containerized jobs and uploading results to S3, and nothing is particularly secret (I’m training easy-to-train models so I can inspect the algorithms they learn).
One annoying thing about SkyPilot though is that it treats all GPUs on vast.ai equally and doesn’t let you pass additional filters besides “give me an RTX 5090”. The vastai CLI has a lot more options, including datacenter-only if you want.
Beware, vast.ai is very much ‘airbnb for gpus’, which is to say it has the same security story as airbnb: the host can do whatever they want and you basically don’t know who they are.
Yeah that’s definitely important to be aware of. I think the security story should be fine in my case, since I’m submitting containerized jobs and uploading results to S3, and nothing is particularly secret (I’m training easy-to-train models so I can inspect the algorithms they learn).
One annoying thing about SkyPilot though is that it treats all GPUs on vast.ai equally and doesn’t let you pass additional filters besides “give me an RTX 5090”. The
vastaiCLI has a lot more options, including datacenter-only if you want.