(Since I had to look it up: pass@k is the AlphaCode paper’s name for the metric “if we generate k samples, what’s the chance that at least 1 solves the coding challenge.”)
(Since I had to look it up: pass@k is the AlphaCode paper’s name for the metric “if we generate k samples, what’s the chance that at least 1 solves the coding challenge.”)