Support investigative journalism — donate to IRE →

Linear Algebra

noun
Foundational concepts

Generally speaking, linear algebra is the analysis of vectors, matrices, and linear transformations. Linear algebra concepts are essential for machine learning.

A typical user of different artificial intelligence is probably not thinking about vectors or matrices, and it's admittedly a bit intimidating to break down the processes behind artificial intelligence. But ultimately, it's important to understand that our applications of AI aren't magic — they're math.

Vector

A vector is a line with magnitude and director. And for large language models, words — or more specifically tokens — are transformed into vectors called embeddings.

An embedding is a much more complicated vector than the one depicted below. But remember a 2-dimensional vector is a line with an x and a y.

A 2D vector diagram showing x and y components
Image courtesy of 3Blue1Brown's video "Vectors, what even are they?" Timestamp: 3:30

In Action A linear regression model

Entry by Libby Seline · Last updated: March 3, 2026
About this glossary — who's behind this site and how you can contribute.