AIToday
Large Language ModelsTop Companies' AI MovesAI Business & IndustryTop Companies AIPublished: Nov 12, 2026, 06:30 JST

Salesforce's SFR-AutoR&D lifts embedding model 6.13 points

Send on LINE
Salesforce's SFR-AutoR&D lifts embedding model 6.13 points

3 Key Points

  1. What happened

    Salesforce AI Research released SFR-AutoR&D, agents that form hypotheses, run controlled experiments and keep only proven improvements; it raised a production embedding model's nDCG@10 by 6.13 points across 10 public retrieval tasks in MTEB, in about 80 hours.

  2. Why it matters

    An autonomous loop that reliably improves models could speed up how enterprise AI systems are upgraded, with researchers setting the goals, budget, evaluation and data constraints rather than running each experiment.

WHO IT HITSEnterprise AI teams running retrieval in Salesforce Data Cloud stand to get better, cheaper search results as SFR-AutoR&D is already used on production models; research scientists may shift toward setting goals and constraints rather than running experiments.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

Salesforce AI Research is pitching SFR-AutoR&D as a research system rather than a single model release. The setup is deliberately constrained: a researcher defines the goal, the compute budget, the evaluation and the data rules, and the agents explore only inside those boundaries. That framing matters because the output is not just a better score but a codebase change backed by benchmark evidence, which is what makes it usable in production rather than only in a paper.

The early results span two kinds of targets. On public open source code, the agents found further gains in heavily optimized libraries such as pandas, hnswlib and USearch, each packaged with benchmark evidence. On Salesforce's own embedding models, the improvement translated into retrieval quality and efficiency: alongside the 6.13-point nDCG@10 gain, a second session focused on runtime came back with 36% more throughput and 17% lower latency with almost no loss in quality. Efficiency gains like these matter because embedding models run across millions of customer records.

The system is presented as complementary to human judgment, not a replacement. Salesforce says the models trained for product use still need to clear production requirements before customers see them, and that work is underway now. Its broader point is that the research loop itself is being automated, with researchers moving toward setting constraints for autonomous systems; a related effort, CodeEvolve, applies evolutionary search to Java and Salesforce Apex code.

FAQ
What does SFR-AutoR&D actually do?
Given a goal, a system to work on and a compute budget, its agents form hypotheses, implement methods and run controlled experiments against baselines. They keep changes only when evidence shows they are accurate and safe.
Where has it been applied so far?
It autonomously improved SFR-Embedding V3, the model Salesforce uses for retrieval in Data Cloud, and also improved open source codebases including pandas, hnswlib and USearch.
Does it have limits?
Yes. Researchers set the goal, budget, evaluation and data constraints, and without a verified improvement over the baseline the model stays in place.
Top Companies AIRead Original Article
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleMorgan Stanley: Stick with high-quality AI bonds amid debt worries