March 3–10, 2021
If this piece is from 2021 I wonder how the LM training regiment and affects have changed.
3 Matching Annotations
- Aug 2025
-
markcmarino.com markcmarino.com
-
-
an LM is a systemfor haphazardly stitching together sequences of linguistic formsit has observed in its vast training data, according to probabilisticinformation about how they combine, but without any reference tomeaning: a stochastic parrot
Really interesting idea that I've never thought about. I knew LMs are stitching together phrases from its training, but I didn't realize how much probability goes into a single LM prompt.
-
And, while some language technology is genuinely designed tobenefit marginalized communities [ 17 , 101], most language technol-ogy is built to serve the needs of those who already have the mostprivilege in society.
Community accessibility is a huge issue for public goods. Just because a product or service is available and targeted for a specific group doesn't guarantee access and beneficial use.
-