Question about terminology — would it be fair to replace “embedding” with “concept”?
(Something feels weird to me about how the word “embedding” is used here. It seems like it’s referring to a very basic general idea — something like “the building blocks of thought, which would include named concepts that we have words for, but also mental images, smells, and felt senses”. But the particular word “embedding” seems like it’s emphasizing the geometric idea of representing something from a high dimensional space in a lower dimensional space, and that seems like it’s not the most relevant part. (Yes, we can think of all concepts geometrically, as clusters in thingspace, but depending on context, it might be more natural to emphasize that idea of a location in a space, or to think of them as just concepts.))
Question about terminology — would it be fair to replace “embedding” with “concept”?
(Something feels weird to me about how the word “embedding” is used here. It seems like it’s referring to a very basic general idea — something like “the building blocks of thought, which would include named concepts that we have words for, but also mental images, smells, and felt senses”. But the particular word “embedding” seems like it’s emphasizing the geometric idea of representing something from a high dimensional space in a lower dimensional space, and that seems like it’s not the most relevant part. (Yes, we can think of all concepts geometrically, as clusters in thingspace, but depending on context, it might be more natural to emphasize that idea of a location in a space, or to think of them as just concepts.))