Every time an AI tool answers a request, a computer somewhere has to do the work. OpenRelay, an AI infrastructure startup that plans to open a San Francisco office, raised $10 million to expand a service that can send those requests to different kinds of chips. The company says its system combines its own computing capacity with equipment available from other providers.
OpenRelay says it routes work by weighing speed and cost as requests come in. That could matter to teams that run voice assistants or process large batches of requests. The company has cited different figures for potential savings and has given little detail on how it measured them. The open question is what customers would save on their own workloads.
