Garrett Baker comments on Activation additions in a small residual network

[Garrett Baker]

Oh, sorry. Editing post with correction.