There’s a lot of “they used user data to shoot themselves in the foot” and not nearly enough “they used user data to improve performance” happening in the industry.
Maybe frontier labs will finally crack applying user feedback once the training data bottleneck begins to bite? I imagine that getting good utility out of user data is hard, both from the standpoint of the engineering required, and the computation required.
There’s a lot of “they used user data to shoot themselves in the foot” and not nearly enough “they used user data to improve performance” happening in the industry.
Maybe frontier labs will finally crack applying user feedback once the training data bottleneck begins to bite? I imagine that getting good utility out of user data is hard, both from the standpoint of the engineering required, and the computation required.