TIL that using a small fine-tuned model beat the giant one for sorting my support tickets
I spent 2 months piping 8,000 support emails through a big general model at about $95 a month, then switched to a small model I fine-tuned in an afternoon on Chicago, and it nailed 94% of tags versus 81%, so now I'm wondering what else I've been overpaying to brute force.