Comment Distillation Attack (Score 2) 27
Distillation Attack? What? That's some deliberately chosen language. Can the fact that companies like Anthropic and OpenAi scraped up an entire internet's worth of private and copyrighted data to build their own models, be called a "Training Attack"?
Ask the web administrators who have to deal with the constant barrage of AI scraper bots, they would surely agree.
If there's any worthwhile direction in AI, it's creating smaller, more efficient models. Distillation is the only path forward.