Wayne

• Wayne 9 Feb 2023 3:40 UTC

  5 points

  2

  on: SolidGoldMag­ikarp II: tech­ni­cal de­tails and more re­cent findings

  ′ newcom’, ‘slaught’, ‘senal’ and ‘volunte’

  I think these could be a result of a simple stemming algorithm:

  • newcomer → newcom

  • volunteer → volunte

  • senaling → senal

  Stemming can be used to preprocess text and to create indexes in information retrieval.

  Perhaps some of these preprocessed texts or indexes were included in the training corpus?