ContextQMD
Back to Fabric

YouTube Processing with Fabric

docs/YouTube-Processing.md

1.4.4529.3 KB
Original Source

YouTube Processing with Fabric

Fabric provides powerful YouTube video processing capabilities that allow you to extract transcripts, comments, and metadata from YouTube videos and playlists. This guide covers all the available options and common use cases.

Prerequisites

  • yt-dlp: Required for transcript extraction. Install on MacOS with:

    bash
    brew install yt-dlp

    Or use the package manager of your choice for your operating system.

    See the yt-dlp wiki page for your specific installation instructions.

  • YouTube API Key (optional): Only needed for comments and metadata extraction. Configure with:

    bash
    fabric --setup

Basic Usage

Extract Transcript

Extract a video transcript and process it with a pattern:

bash
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern summarize

Extract Transcript with Timestamps

Get transcript with timestamps preserved:

bash
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --transcript-with-timestamps --pattern extract_wisdom

Extract Comments

Get video comments (requires YouTube API key):

bash
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --comments --pattern analyze_claims

Extract Metadata

Get video metadata as JSON:

bash
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --metadata

Advanced Options

Custom yt-dlp Arguments

Pass additional arguments to yt-dlp for advanced functionality. User-provided arguments take precedence over built-in fabric arguments, giving you full control:

bash
# Use browser cookies for age-restricted or private videos
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --yt-dlp-args="--cookies-from-browser brave"

# Override language selection (takes precedence over -g flag)
fabric -g en -y "https://www.youtube.com/watch?v=VIDEO_ID" --yt-dlp-args="--sub-langs es,fr"

# Use specific format
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --yt-dlp-args="--format best"

# Handle rate limiting (slow down requests)
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --yt-dlp-args="--sleep-requests 1"

# Multiple arguments (use quotes)
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --yt-dlp-args="--cookies-from-browser firefox --write-info-json"

# Combine rate limiting with authentication
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --yt-dlp-args="--cookies-from-browser brave --sleep-requests 1"

# Override subtitle format (takes precedence over built-in --sub-format vtt)
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --yt-dlp-args="--sub-format srt"

Argument Precedence

Fabric constructs the yt-dlp command in this order:

  1. Built-in base arguments (--write-auto-subs, --skip-download, etc.)
  2. Language selection (from -g flag): --sub-langs LANGUAGE
  3. User arguments (from --yt-dlp-args): These override any conflicting built-in arguments
  4. Video URL

This means you can override any built-in behavior by specifying it in --yt-dlp-args.

Playlist Processing

Process entire playlists:

bash
# Process all videos in a playlist
fabric -y "https://www.youtube.com/playlist?list=PLAYLIST_ID" --playlist --pattern summarize

# Save playlist videos to CSV
fabric -y "https://www.youtube.com/playlist?list=PLAYLIST_ID" --playlist -o playlist.csv

Language Support

Specify transcript language:

bash
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" -g es --pattern translate

Combining Options

You can combine multiple YouTube processing options:

bash
# Get transcript, comments, and metadata
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" \
  --transcript \
  --comments \
  --metadata \
  --pattern comprehensive_analysis

Output Options

Save to File

bash
# Save output to file
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern summarize -o summary.md

# Save entire session including input
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern summarize --output-session -o full_session.md

Stream Output

Get real-time streaming output:

bash
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern summarize --stream

Common Use Cases

Content Analysis

bash
# Analyze video content for key insights
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern extract_wisdom

# Check claims made in the video
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern analyze_claims

Educational Content

bash
# Create study notes from educational videos
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern create_study_notes

# Extract key concepts and definitions
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern extract_concepts

Meeting/Conference Processing

bash
# Summarize conference talks with timestamps
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" \
  --transcript-with-timestamps \
  --pattern meeting_summary

# Extract action items from recorded meetings
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern extract_action_items

Content Creation

bash
# Create social media posts from video content
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern create_social_posts

# Generate blog post from video transcript
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" --pattern write_blog_post

Troubleshooting

Common Issues

  1. "yt-dlp not found": Install yt-dlp using pip or your package manager
  2. Age-restricted videos: Use --yt-dlp-args="--cookies-from-browser BROWSER"
  3. No subtitles available: Some videos don't have auto-generated subtitles
  4. API rate limits: YouTube API has daily quotas for comments/metadata
  5. HTTP 429 errors: YouTube is rate limiting subtitle requests

Error Messages

  • "YouTube is not configured": Run fabric --setup to configure YouTube API
  • "yt-dlp failed": Check video URL and try with --yt-dlp-args for authentication
  • "No transcript content found": Video may not have subtitles available
  • "HTTP Error 429: Too Many Requests": YouTube rate limit exceeded. This is increasingly common. Solutions:
    • Wait 10-30 minutes and try again (most effective)
    • Use longer sleep: --yt-dlp-args="--sleep-requests 5"
    • Try with browser cookies: --yt-dlp-args="--cookies-from-browser brave --sleep-requests 5"
    • Try a different video - some videos are less restricted
    • Use a VPN - different IP address may help
    • Try without language specification - let yt-dlp choose any available language
    • Try English instead - fabric -g en (English subtitles may be less rate-limited)

Language Fallback Behavior

When you specify a language (e.g., -g es for Spanish) but that language isn't available or fails to download:

  1. Automatic fallback: Fabric automatically retries without language specification
  2. Smart file detection: If the fallback downloads a different language (e.g., English), Fabric will automatically detect and use it
  3. No manual intervention needed: The process is transparent to the user
bash
# Even if Spanish isn't available, this will work with whatever language yt-dlp finds
fabric -g es -y "https://youtube.com/watch?v=VIDEO_ID" --pattern summarize

Configuration

YAML Configuration

You can set default yt-dlp arguments in your config file (~/.config/fabric/config.yaml):

yaml
ytDlpArgs: "--cookies-from-browser brave --write-info-json"

Environment Variables

Set up your YouTube API key:

bash
export FABRIC_YOUTUBE_API_KEY="your_api_key_here"

Tips and Best Practices

  1. Use specific patterns: Choose patterns that match your use case for better results
  2. Combine with other tools: Pipe output to other commands or save to files for further processing
  3. Batch processing: Use playlists to process multiple videos efficiently
  4. Authentication: Use browser cookies for accessing private or age-restricted content
  5. Language support: Specify language codes for better transcript accuracy
  6. Rate limiting: If you encounter 429 errors, use --sleep-requests 1 to slow down requests
  7. Persistent settings: Set common yt-dlp args in your config file to avoid repeating them
  8. Argument precedence: Use --yt-dlp-args to override any built-in behavior when needed
  9. Testing: Use yt-dlp --list-subs URL to see available subtitle languages before processing

Examples

Quick Video Summary

bash
fabric -y "https://www.youtube.com/watch?v=dQw4w9WgXcQ" --pattern summarize --stream

Detailed Analysis with Authentication

bash
fabric -y "https://www.youtube.com/watch?v=VIDEO_ID" \
  --yt-dlp-args="--cookies-from-browser chrome" \
  --transcript-with-timestamps \
  --comments \
  --pattern comprehensive_analysis \
  -o analysis.md

Playlist Processing

bash
fabric -y "https://www.youtube.com/playlist?list=PLrAXtmRdnEQy6nuLvVUxpDnx4C0823vBN" \
  --playlist \
  --pattern extract_wisdom \
  -o playlist_wisdom.md

Override Built-in Language Selection

bash
# Built-in language selection (-g es) is overridden by user args
fabric -g es -y "https://www.youtube.com/watch?v=VIDEO_ID" \
  --yt-dlp-args="--sub-langs fr,de,en" \
  --pattern translate

For more patterns and advanced usage, see the main Fabric documentation.