Per-source integration test matrix #9

Closed
opened 2026-09-01 20:40:06 +00:00 by Mark · 1 comment
Owner

Smoke test on 2026-09-01 covered: YouTube single-speaker, YouTube Spanish, archive.org (Big Buck Bunny VAD test), Lex Fridman RSS feed (3.4h), and base-vs-small model comparison.

Missing coverage:

  • Twitter/X video (auth required?)
  • TikTok (auth + JS runtime)
  • Twitch VOD (no auth, time-limited)
  • Vimeo (needs cookie/impersonation in yt-dlp 2026)
  • Spotify podcast (different audio format)
  • Apple Podcasts (different RSS shape)
  • Direct HTTP MP4 / MKV / WebM URLs without a video page wrapper
  • Local files (mp3, m4a, flac) without yt-dlp at all

What needs building: tests/sources.py — each source gets a one-line URL/filename + expected behavior (success | auth-required | vadsilence). Mark skipped tests with skip: <reason> instead of failing.

Smoke test on 2026-09-01 covered: YouTube single-speaker, YouTube Spanish, archive.org (Big Buck Bunny VAD test), Lex Fridman RSS feed (3.4h), and base-vs-small model comparison. **Missing coverage:** - Twitter/X video (auth required?) - TikTok (auth + JS runtime) - Twitch VOD (no auth, time-limited) - Vimeo (needs cookie/impersonation in yt-dlp 2026) - Spotify podcast (different audio format) - Apple Podcasts (different RSS shape) - Direct HTTP MP4 / MKV / WebM URLs without a video page wrapper - Local files (mp3, m4a, flac) without yt-dlp at all **What needs building:** `tests/sources.py` — each source gets a one-line URL/filename + expected behavior (success | auth-required | vadsilence). Mark skipped tests with `skip: <reason>` instead of failing.
Mark closed this issue 2026-09-06 16:11:49 +00:00
Author
Owner

Closed by operator. Fix landed on origin/main: f136af6 — Fix #17: add tests/sources.py and tests/conftest.py for source matrix (#9).

Closed by operator. Fix landed on origin/main: f136af6 — Fix #17: add tests/sources.py and tests/conftest.py for source matrix (#9).
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
Mark/whisper-transcribe#9
No description provided.