StemmaLM

A lineage of small language models, each raised from scratch on what adults say to children.

An individual

Each individual begins as a model that knows nothing. It hears what adults said to real children, taken from recorded family conversations and fed in order of the child's age, month by month, up to six years. It never hears the children themselves, and it never sees the world they talk about: it is a child with only words. A snapshot is kept for every month of its life, and at every month it can be asked to speak.

A lineage

Every individual has a number and a full name that records how it came to be: its strain (the learner it was born as), its upbringing (what was changed in what it heard), its generation (who taught it), any lesion it received in adulthood, and a seed that tells siblings apart. Grown individuals can teach the next generation with their own speech, and the numbers join into a family tree.

Why

A stemma is the family tree of a text copied by hand: each copy inherits the errors of its source and adds its own, and the tree is read back from the variants. Language is passed on the same way, from what one generation says to what the next one learns. Raising the copies ourselves makes it possible to watch what is kept, what is lost and what is new.