Sort of? Indeed this is more accessible to smaller groups than training big models, but small groups don’t have access to the biggest models, and you can still do a bunch of non-mechinterpy things with the models you do have, so the effect isn’t super overwhelming.
Do you think this prediction has been borne out? It seems like it has.
Sort of? Indeed this is more accessible to smaller groups than training big models, but small groups don’t have access to the biggest models, and you can still do a bunch of non-mechinterpy things with the models you do have, so the effect isn’t super overwhelming.