What motivated you to research this question? It looks like a rigorous analysis, but I’m not familiar with why we would want to analyze the speed of forward passes.
Short answer: If future AI systems are doing R&D, it matters how quickly the R&D is happening.
What motivated you to research this question? It looks like a rigorous analysis, but I’m not familiar with why we would want to analyze the speed of forward passes.
Short answer: If future AI systems are doing R&D, it matters how quickly the R&D is happening.