AIToday

GitHub Copilot is getting smarter about using AI models for different coding tasks, using prompt caching and automatic model selection to handle longer work sessions more efficiently.

GitHub Copilot Blog14h ago3 min read
GitHub Copilot is getting smarter about using AI models for different coding tasks, using prompt caching and automatic model selection to handle longer work sessions more efficiently.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. 1

    What happened: GitHub Copilot for VS Code now uses prompt caching to reuse model state across repeated requests instead of recomputing the same information, and tool search to load tool definitions on demand rather than sending every full tool schema into context on every turn. Auto model selection, already live in VS Code, github.com, and mobile, is expanding to Copilot CLI, GitHub App, and additional IDEs, with plans to make it the default for Copilot Free and Student plans.

  2. 2

    Why it matters: As Copilot takes on longer agentic work — planning, editing, debugging, reviewing, and calling tools across extended sessions — these changes let the model focus more effort on the actual task rather than repeating context and processing unnecessary tool definitions. Copilot's Auto system routes to the model that fits the work: simpler tasks like quick explanations can use more efficient models, while complex multi-file changes get stronger reasoning when needed, without requiring developers to manually choose models each time.

  3. 3

    What to watch: Auto was trained on conversations across 16 language families and stays within 4 points of English baseline routing accuracy across language groups. The router learns where stronger models add value by comparing responses from less capable and more capable models on quality dimensions, ensuring escalation to stronger reasoning happens only when the task actually benefits from it.

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

5 minutes a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →