Chose a local AI model over cloud API for my side project last month

I had to pick between running Mistral 7B locally on my old laptop or paying $0.15 per query to OpenAI for a chat bot I was building, and the local route gave me slower responses but saved me the $47 I would have burned in just a week of testing.

2 comments

2 Comments

the_mary11d ago

Smart move. Local saved your wallet big time.

the_cora11d ago

Honestly I used to think local was taking advantage but after doing the math yeah this is way smarter than I gave it credit for