That is a great point. I don’t think I have too much data on this or know where to find it publicly (tips/intros to voice AI people would be appreciated!). I spoke to an early engineer at a voice agent company that helps medical providers call big insurers to claim insurance. A big problem they had was optimizing the AI to not be too friendly and random (“how was your weekend”==tokens set on fire) but also not be overly terse and impolite. Funnily enough, on the insurer’s side they also use AI to detect and ban AI callers (so I guess this helps them efficiently deny claims?).
michaelwaves
Karma: 84
Probably just marking up gpt 4o API costs? gpt 4o costs $2.50/M input and $10/M output tokens, assuming 10k in and 10k out per hour that’s 0.125/hour. Maybe double or triple that for tool calls but there’s no way it should be 0.07/minute. I guess they also charge for infrastructure like servers to run tools and orchestrate everything and connect to phones.