Content-type: text/html Downes.ca ~ Stephen's Web ~ Language Models: A Guide for the Perplexed

Stephen Downes

Knowledge, Learning, Community

This paper walks the reader step by step through the basic concepts of natural language processing (NLP), expanding to large language models and terms like 'perplexity', and through to a look at what to expect in the future. "The vast majority of architectures are neural networks (sometimes called artificial neural networks
to differentiate them from biological ones)... A general observation about neural network architectures (but not a necessary or defining property) is that the relationship between their numerical calculations and the task-solving behavior of a model (after its parameters are set) is not explainable to human observers."

Today: 0 Total: 806 [Direct link] [Share]


Stephen Downes Stephen Downes, Casselman, Canada
stephen@downes.ca

Copyright 2025
Last Updated: Feb 18, 2025 8:04 p.m.

Canadian Flag Creative Commons License.

Force:yes