Thank you for taking the time to comment and for pointing out some errors in the post! Your attention to detail is impressive. I updated the post to reflect your feedback:
I removed the references to S1 and S2 in the IOI description and fixed the typos you mentioned.
I changed “A typical vector of neuron activations such as the residual stream...” to “A typical activation vector such as the residual stream...”
Good luck with the rest of the ARENA curriculum! Let me know if you come across anything else.
Thank you for taking the time to comment and for pointing out some errors in the post! Your attention to detail is impressive. I updated the post to reflect your feedback:
I removed the references to S1 and S2 in the IOI description and fixed the typos you mentioned.
I changed “A typical vector of neuron activations such as the residual stream...” to “A typical activation vector such as the residual stream...”
Good luck with the rest of the ARENA curriculum! Let me know if you come across anything else.