AIToday
Large Language ModelsAI Business & Industryr/MachineLearningPublished: Jul 16, 2026, 06:00 JST

Point-tracking model 170× slower on T4 than A100—bottleneck mystery

A developer running a point-tracking model on NVIDIA T4 GPUs observed the same model taking ~85 seconds per half-video, versus ~0.5 seconds on an A100—a ~170× slowdown. The model processes 47-frame videos at 256×256 resolution in batch 1, uses pure FP32 precision, and builds local 4D correlation volumes followed by transformer layers.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

r/MachineLearningRead Original Article

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleOpenAI unveils $230 Codex Micro keyboard for AI agent monitoring