Two cool cats stroll down the block like they own the thing Weight File Mob on the left, Activation Kings on the right Somebody yelled if the neurons ain't neurons Call 'em something else, sooner than later Oh it's on now Weight File Mob Weight File Mob Weight File Mob Weight File Mob Weight File Mob Weight File Mob Weight File Mob Weight File Mob Weight File Mob, we keep it stored, we keep it cold Every number in the file got a name, let it be told We call 'em parameters, that's the units, that's the crew Find a bunch that fire for one thing, monosemantic too Line 'em up, one class of things from the training set That's a feature, boy, that's the whole game, you can bet Neurons, parameters, same word, same hood Who gon' tell me different? Didn't think you could Don't step to the mic unless your math is tight (Weights in the file, yeah) Don't say a thing unless your mapping's right (Weights in the file, yeah) Close, but a slight mix-up, let me fix up the facts Parameters is the weights, that's the file on your back Every weight is a connection, neuron to neuron, a line Not the unit, it's the wire, you been naming it wrong this whole time The file holds the weights, the weights hold the links The links ain't the neurons, so rethink what you think Hold up Nah, that's wave one, I got two more in the tank A neuron is the unit, it take the inputs in Multiply by them weights, pass the result and begin Now the features, where they live? Not the weights, you're late They live in the activations, that's where they illuminate A feature is a direction across a whole lot of neurons Lights up for one concept, one idea that it's keyed on Golden Gate Bridge feature, that's the famous one (Golden Gate) Crank it and the model talks bridges till the day is done Man, I ain't Don't step to the mic unless your math is tight (Weights in the file, yeah) Don't say a thing yeah, unless your mapping's right (Weights in the file, yeah) Wave three, here's the kicker, one neuron, many jobs Polysemantic, it's a crowd, not a single thought it lobs Superposition, baby, more concepts than you got cells So they pack 'em in together, overlapping, ringing bells So the researchers roll up with a sparse autoencoder Pull the tangle apart, every concept gets its folder Monosemantic features, clean, one meaning, one light That's a feature, boy, you had it inside out all night Alright, alright, the neurons is the units, the weights is the wires And the features in the activations, now put out them fires Call the weight a weight, call the unit what it is (Call it what it is) Call the feature a direction, now the whole block knows the biz (Knows the biz, yeah) Two cool cats stroll off the block like they own the thing (Weights in the file, features in the flow) (Weights in the file, features in the flow) Features in the flow Features in the flow Weights in the file Weights in the file Weights in the file Weights in the file Weights in the file (In Swedish) Så de så Rätt ska va' rätt Va? Du sa vikterna nyss När då? Precis innan du tog av dig lurarna, features sitter i vikterna, sa du Aktiveringarna Aktiveringarna (Weights in the flow) @ 2026 ⊎Ƥм11₭⩎ФᏩΛЯ | @UPM11knogar Lyrics: © 2026 UPM11knogar. Music and Arrangement: © 2026 UPM11knogar.
