The Head is the top of the neural network, the last layer(s). The bottom is the input layer. https://stackoverflow.com/questions/56004483/what-is-a-multi-headed-model-and-what-exactly-is-a-head-in-a-model mlai