I think you can get high-quality 100k smartphone which will be relevant for a long time
So the relevancy part (my bold) is probably more true today, but the top-of-the-line smartphones from the 2000s and early 2010s very clearly have not been relevant for a long time. I think smartphone innovation is slowing down, so it’s possible that today’s smartphone would be relevant for a longer time than those from previous years. But I think this is because of slowing innovation.
Very interesting post! Do you think the recent work on model introspection 1 2 3 has an impact here? Could developing tools to monitor introspection assist with interp?