I feel like capping the memory of GPUs would also affect normal folk who just want to train simple models, so it may be less likely to be implemented. It also doesn’t really cap the model size, which is the main problem.
But I agree it would be easier to enforce, and certainly, much better than the status quo.
I feel like capping the memory of GPUs would also affect normal folk who just want to train simple models, so it may be less likely to be implemented. It also doesn’t really cap the model size, which is the main problem.
But I agree it would be easier to enforce, and certainly, much better than the status quo.