(Epistemic status: having a hard time articulating this, apologies)
The vibe (eggSyntaxes’) I get from this post & responses is like ~yes, we can explain these observations w/ low level behavior (sophisticated predictors, characters are based on evidence from pre-training, active inference) - but it’s hard to use this to describe these massively complex systems (analogue to fluid simulation).
Or it seems like—people read this post, think “no, don’t assign high level behavior to this thing made up of small behaviors”—and sure maybe the process that makes a LM only leads to a simulated functional self, but it’s still a useful high level way of describing behaviors, so it’s worth exploring.
I like the central axis of wrongness paragraph. It’s concrete and outlines different archetypes we might observe.
Once again though, it’s easy to get bogged down in semantics. “Having a functional self” vs. “Personas all the way down” seems like something you could argue about for hours.
Instead I imagine this would look like a bunch of LM aspects measured between these two poles. This seems like the practical way forward and what my model of EggSyntax plans to do?
(Epistemic status: having a hard time articulating this, apologies)
The vibe (eggSyntaxes’) I get from this post & responses is like ~yes, we can explain these observations w/ low level behavior (sophisticated predictors, characters are based on evidence from pre-training, active inference) - but it’s hard to use this to describe these massively complex systems (analogue to fluid simulation).
Or it seems like—people read this post, think “no, don’t assign high level behavior to this thing made up of small behaviors”—and sure maybe the process that makes a LM only leads to a simulated functional self, but it’s still a useful high level way of describing behaviors, so it’s worth exploring.
I like the central axis of wrongness paragraph. It’s concrete and outlines different archetypes we might observe.
Once again though, it’s easy to get bogged down in semantics. “Having a functional self” vs. “Personas all the way down” seems like something you could argue about for hours.
Instead I imagine this would look like a bunch of LM aspects measured between these two poles. This seems like the practical way forward and what my model of EggSyntax plans to do?