Kallistos

• Kallistos 23 Mar 2025 3:50 UTC

  1 point

  0

  in reply to: Sergii’s comment on: Any mis­takes in my un­der­stand­ing of Trans­form­ers?

  Many thanks!

• Kallistos 21 Mar 2025 4:35 UTC

  1 point

  0

  in reply to: mishka’s comment on: Any mis­takes in my un­der­stand­ing of Trans­form­ers?

  Oh, yes you’re right...hmmm. Unsure what to do about that, I’d love a neat graphical solution. Wasn’t quite sure how to represent repeating units without just duplicating subdiagrams!

• Kallistos 21 Mar 2025 4:21 UTC

  3 points

  0

  in reply to: mishka’s comment on: Any mis­takes in my un­der­stand­ing of Trans­form­ers?

  Many thanks! I have residuals going from before to after the MHA block, and from before to after MLP+FFNN. Should I have others in other places?

  edit: Those links are super!

[Question] Any mis­takes in my un­der­stand­ing of Trans­form­ers?