
What happened
Salesforce AI Research released SFR-AutoR&D, agents that form hypotheses, run controlled experiments and keep only proven improvements; it raised a production embedding model's nDCG@10 by 6.13 points across 10 public retrieval tasks in MTEB, in about 80 hours.
Why it matters
An autonomous loop that reliably improves models could speed up how enterprise AI systems are upgraded, with researchers setting the goals, budget, evaluation and data constraints rather than running each experiment.
WHO IT HITSEnterprise AI teams running retrieval in Salesforce Data Cloud stand to get better, cheaper search results as SFR-AutoR&D is already used on production models; research scientists may shift toward setting goals and constraints rather than running experiments.
Summaries like this, every morning.
Salesforce AI Research is pitching SFR-AutoR&D as a research system rather than a single model release. The setup is deliberately constrained: a researcher defines the goal, the compute budget, the evaluation and the data rules, and the agents explore only inside those boundaries. That framing matters because the output is not just a better score but a codebase change backed by benchmark evidence, which is what makes it usable in production rather than only in a paper.
The early results span two kinds of targets. On public open source code, the agents found further gains in heavily optimized libraries such as pandas, hnswlib and USearch, each packaged with benchmark evidence. On Salesforce's own embedding models, the improvement translated into retrieval quality and efficiency: alongside the 6.13-point nDCG@10 gain, a second session focused on runtime came back with 36% more throughput and 17% lower latency with almost no loss in quality. Efficiency gains like these matter because embedding models run across millions of customer records.
The system is presented as complementary to human judgment, not a replacement. Salesforce says the models trained for product use still need to clear production requirements before customers see them, and that work is underway now. Its broader point is that the research loop itself is being automated, with researchers moving toward setting constraints for autonomous systems; a related effort, CodeEvolve, applies evolutionary search to Java and Salesforce Apex code.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Interactive Brokers launched IBKR Autonomous Trading, which lets eligible clients connect AI platforms to a ri…

KWCH published guidance advising users to keep certain personal information out of AI chatbots to protect thei…

Honeywell Technologies unveiled AI-powered building intelligence, fire and life safety and security upgrades t…

A Seeking Alpha analyst published a piece calling NextEra Energy (NEE) a forgotten AI winner following a Democ…

Upgraded Points published a walkthrough for redeeming the up-to-$300 ChatGPT Business credit available on Amex…

CVS Health announced three Stevie Awards for Technology Excellence and four International Business Awards, rec…
