AIToday

Free tool mines YouTube transcripts for audience pain points

Hacker News4h agoSend on LINE
Free tool mines YouTube transcripts for audience pain points

Key takeaway

A developer has released a free, open-source tool that analyzes YouTube channel transcripts to automatically extract and rank the questions and pain points mentioned by audiences. The tool uses Claude (Haiku) to scan transcript files you provide and surfaces the most-asked questions and expressed pain points in a ranked report, requiring only an Anthropic API key and costing a few cents per run. This approach applies decades of enterprise IT pattern-recognition to audience feedback at scale, though the creator emphasizes it automates the scanning step, not the judgment of what matters.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    A developer released an open-source tool that scans YouTube channel transcripts (provided as .md files) and uses Claude (Haiku) to extract, rank, and aggregate the questions and pain points mentioned across multiple videos—surfacing what an audience actually asks without manual comment-scrolling.

  • Why it matters

    The tool automates the scanning of audience feedback, which can help creators, product teams, and business operators identify real customer needs and friction points at scale. The creator draws on 25 years of enterprise IT experience reading room-full frustration into actionable insight, noting this tool automates the scanning but preserves human judgment on what matters.

  • What to watch

    The tool requires you to supply your own transcript files (it does not download them); it runs locally using your own Anthropic API key and costs a few cents per run on Haiku. A known limitation: Haiku can run out of token budget on larger transcript batches, which the creator notes can be worked around by raising max_tokens or accepting occasional skipped files.

In Depth

A developer released a free, open-source tool called pain-point-miner that automatically scans YouTube channel transcripts and extracts ranked lists of what audiences ask and struggle with. The system works in two steps: indexer.py scans a folder of transcript .md files and builds a lightweight index, and pain_point_extractor.py reads that index, sends each transcript through Claude (Haiku) to pull out questions, pain points, and desired outcomes, then aggregates everything into one ranked report. Example output shows "Top Questions (Most Asked)" and "Top Pain Points (Most Expressed)" ranked by mention count across videos—for instance, a question about rebuilding processes around AI capabilities mentioned in 4 videos, or a pain point about existing business models built on inefficiencies mentioned in 6 videos. The creator, who spent 25 years in enterprise IT before encountering Claude Code, frames the tool as automating the scanning phase of a skill he applied for two decades in operations: reading frustration and finding the real question under the noise. He emphasizes that the tool does not replace human judgment. Setup requires cloning the repository, installing the Anthropic Python library, obtaining an API key from https://console.anthropic.com/settings/keys, and populating a local transcripts/ folder with your own .md files in the structure transcripts/<group-name>/<channel-name>/*.md. Each transcript file needs a plain text header (title, channel, date) followed by the transcript body; the creator notes that sample transcripts are not included because the test videos were copyrighted content. Running the tool involves two Python commands: one to build the index and one to run the extractor, specifying the group name. Cost is minimal—a few cents per run for a handful of files using Haiku, paid directly to Anthropic with nothing routing through the developer. A known limitation emerged during testing: one of three test transcripts failed with a truncated-JSON error because Haiku ran out of token budget mid-response. The workaround is to either raise max_tokens in the _pass1_extract() function or accept the occasional skip, since the aggregation step still completes successfully on whatever succeeded.

Context & Analysis

The tool addresses a practical problem in creator and product research: identifying what audiences genuinely care about from the noise of video comments and discussions. Rather than manually scrolling through comments or guessing at pain points, the system automates the extraction phase by feeding transcripts to Claude (Haiku), which then aggregates and ranks findings across multiple videos. The creator's background in enterprise IT—25 years of reading room-full frustration and finding the real question under the noise—informs the design philosophy: automation handles the scanning, but human judgment remains central to interpreting what actually matters. The tool's output format (ranked lists with mention counts) reflects this: it surfaces patterns and frequency, not verdicts. The cost structure (a few cents per run on Haiku, paid directly to Anthropic) keeps the barrier low for creators or teams exploring audience feedback at scale.

FAQ

What do I need to run this tool?
You need to clone the repository, install the Anthropic Python library (pip install anthropic), obtain an Anthropic API key from https://console.anthropic.com/settings/keys, and provide your own YouTube transcripts in .md file format organized in the specified folder structure (transcripts/<group-name>/<channel-name>/*.md).
Does the tool download transcripts or access Reddit or other sources?
No. The tool only processes .md transcript files you already have in your local transcripts/ folder. It does not download transcripts, touch Reddit, or any other source.
What happens if Claude runs out of tokens while processing?
One known limitation is that Haiku can run out of token budget mid-response, which can result in truncated JSON. The workaround is to either raise max_tokens in the _pass1_extract() function or accept occasional skipped files; the aggregation step still runs fine on whatever succeeded.

Get AI news like this every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Discussion

No discussion yet for this article

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime