
What happened
GitHub shared how it made Copilot more cost-efficient through four changes, including removing unused line numbers and compressing repetitive output. One change cut model-inference cost by about 5% offline and about 3% online.
Why it matters
The company found that focusing on token count per tool call can backfire, increasing overall cost. Optimizing for the whole task, not individual calls, is key to balancing efficiency and quality.
What to watch
Other changes, like the prompt compression, save about 1,300 tokens per turn. GitHub notes that a change saving tokens in one workflow may increase costs in another, so each must be tested in its intended context.
Ask the AI about this article →
Summaries like this, in your inbox every morning.
GitHub's post highlights a key principle: optimizing for the outcome rather than the tool call. The company demonstrated that shortening individual responses can lead to extra work and higher costs, as the agent may need to reread output or rerun commands. This was shown with RTK, a utility that shortens shell output, which actually increased overall token usage in tests.
The four changes—selective output compression, removing line-number prefixes, prompt compression via meta-prompting, and delivering background results directly—each required careful evaluation. For instance, the prompt compression initially backfired, causing agents to run sequentially instead of in parallel. Only after adding a regression test and simplifying the guidance did it become safe, saving about 1,300 tokens per turn.
The broader takeaway is that efficiency improvements must be measured in the specific workflow where they run. A change that helps code review may hurt CLI usage, and vice versa. GitHub also found that removing line numbers and compressing output each cut prompt tokens per review by about 5%, with no quality loss, highlighting the importance of context-specific validation.
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
Nvidia Corp. CEO Jensen Huang said artificial general intelligence has arrived, following OpenAI's launch of G…

Saudi Arabia's state-backed AI company HUMAIN, led by CEO Tareq Amin, is positioning itself as a neutral hub f…

Alibaba's research division released Qwen-Drive 1.0, an AI model that handles spatial perception, traffic Q&A…

NoMac.App launched a publishing pipeline for iOS apps that runs entirely in the cloud, handling builds, TestFl…

A developer tested whether ChatGPT would judge the same remote-work scenario differently when only the subject…

Google DeepMind ran 100 autonomous LLM agents using Gemini 3.1 Pro on 71 math problems
