L
17

My friend said to ignore the hype around small language models, but he was wrong.

He argued bigger models were always better, but using a 3 billion parameter model for a specific task last month cut our costs by 60% with no drop in quality. Anyone else find the smaller, focused models are actually getting really good?
2 comments

Log in to join the discussion

Log In
2 Comments
alice991
alice9912d ago
What specific task were you using it for? I've been looking at smaller models for basic customer service sorting, but my team keeps pushing for the biggest model we can get. Your example makes me wonder if we're just stuck in that bigger is better mindset without actually checking.
3
williams.betty
That "bigger is better" mindset is how you end up paying for a race car to go get groceries.
3