Srihita Vatsavaya

• Srihita Vatsavaya 29 Jun 2025 17:06 UTC

  1 point

  0

  on: Ex­plain­ing the Trans­former Cir­cuits Frame­work by Example

  2B)

  Hi there! Thanks for putting this together. Q—shouldnt this equation include a sum over heads term outside the m (MLP) function as well?