17
My friend said to ignore the hype around small language models, but he was wrong.
He argued bigger models were always better, but using a 3 billion parameter model for a specific task last month cut our costs by 60% with no drop in quality. Anyone else find the smaller, focused models are actually getting really good?
2 comments
Log in to join the discussion
Log In2 Comments
alice9912d ago
What specific task were you using it for? I've been looking at smaller models for basic customer service sorting, but my team keeps pushing for the biggest model we can get. Your example makes me wonder if we're just stuck in that bigger is better mindset without actually checking.
3
williams.betty2d ago
That "bigger is better" mindset is how you end up paying for a race car to go get groceries.
3