Yes, thanks for catching that, that graph is from an earlier version that had a data leakage bug. The current model and benchmark are in the linked repo. I would really appreciate if you could replicate the results. The actual result is 1.596 nats, not 0.022.
Yes, thanks for catching that, that graph is from an earlier version that had a data leakage bug. The current model and benchmark are in the linked repo. I would really appreciate if you could replicate the results. The actual result is 1.596 nats, not 0.022.