Hmm...I wonder if the tech geniuses might develop a distributed model approach, i.e., multiple "smaller" language models designed for an array "categories" of questions/requests routed to each by some type of central system that performs the triage. If this performed fast enough it might provide lower costs and better accuracy. Just a thought?
Hmm...I wonder if the tech geniuses might develop a distributed model approach, i.e., multiple "smaller" language models designed for an array "categories" of questions/requests routed to each by some type of central system that performs the triage. If this performed fast enough it might provide lower costs and better accuracy. Just a thought?
This is the approach more are working on now. Each model would have a different functional role.