It’s impossible to keep up with all the new developments in the LLM-era. However, one thing has been true: they never stopped improving.
Malte Skarupke explains How LLMs Keep on Getting Better, covering a few of the different visible and invisible aspects of LLMs that have been worked on over the past couple of years. It’s a really good overview for those who are not into the weeds of it.