Comment Re:$10 billion + (Score 1) 89
LLMs need a constant flow of new training data; otherwise, the models suffer from well known problems:
- Knowledge staleness
- Data distribution shift
sources:
- https://apxml.com/courses/how-...
- https://arxiv.org/pdf/2307.090...