That "quick logo" line is the whole problem. People see the final image, not the rounds of sketches and revisions it takes to get there. You have to explain your process to show where the value is.
Maybe that $50 logo will cover what the client needs. Not every business needs a full identity system with six rounds of revision. A lot of small start ups just want something that looks slightly better than clip art to get their business cards printed. The trick is figuring out which clients actually need the expensive package and which ones just need a bandaid. Nothing wrong with turning down cheap work if it doesn't fit your skillset, but getting mad about the request seems like wasted energy.