科技公司转向开放模型:Uber、Pinterest 等用模型路由削减 AI 账单
The Pulse: tech companies move to open AI models
Uber、Pinterest、Stripe、Coinbase、Ramp 和 AT&T 等公司通过放弃专有模型、改用智能模型路由来大幅节省 AI 支出。Linear 和 Anthropic 正在实验用 AI 智能体自动修复 bug 和清理技术债务,效果比预期好,但产出的代码还不能不经审查直接合并。
Update: three weeks after publishing this article, Bloomberg covered the same trend in their article OpenAI, Anthropic costs push more startups to build off cheaper open models, covering the exact same phenomenon we discuss below. If you would like to stay weeks ahead of mainstream media for tech industry trends, subscribe to The Pragmatic Engineer and get trends like this straight into your inbox:
The Pulse is a series covering events, insights, and trends within Big Tech and startups.
Today, we cover:
New trend: tech companies moving to open models. Uber, Pinterest, Stripe, Coinbase, Ramp, and AT&T are making large savings on their AI bills by dropping proprietary models and using smart model routing.
Automatic software maintenance experiments by Linear and Anthropic. Both startups are experimenting with how far they can push AI agents to automatically fix bugs and remove tech debt. It’s working better than anyone might’ve expected in the recent past, but not producing code that can be merged without review.
Frontier AI lab wars: OpenAI pulls models from SpaceX / Cursor. With SpaceX now a frontier model and rival to OpenAI and Anthropic, OpenAI has pulled its GPT models from Cursor. This isn’t an option for Anthropic which is dependent on the SpaceX compute they rent to serve Claude.
HR tech startup’s one-dev-per-project approach. A full-remote HR startup with 70 engineers has a single engineer run each project, and says the approach works well. Will this approach be adopted elsewhere, especially at other full-remote startups?
Industry Pulse. Meta moved over to Slack for better agent interoperability, layoffs at Uber and PagerDuty, Anthropic upsets users by calling a rate limit decrease an “increase”, token usage explodes on OpenRouter, AI drives surging demand for Apple’s Mac Mini & Mac Studio, and more.
1. New trend: moving to open models at tech companies
Update: a week after publishing this article, Ara Krahzian at Ramp has confirmed that AI spend in August, has, indeed, declined at the top 1% of businesses by 10%, based on Ramp data. I’d wager those companies are not spending fewer tokens, but they are optimizing cost, in ways outlined below.
In May, I covered an emerging trend of companies wanting to cut back their AI spending, starting with engineering departments. Different approaches were being tried:
来源:The Pragmatic Engineer · newsletter.pragmaticengineer.com