Mark/whisper-transcribe
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Speaker diarization via pyannote #1

New issue
Closed
opened 2026-09-01 20:37:48 +00:00 by Mark · 1 comment
Mark commented 2026-09-01 20:37:48 +00:00
Owner
Copy link

WhisperX's headline feature. Two-model pipeline: speaker-diarization-3.1 + segmentation-3.0.

State: EULAs already accepted for both models in browser session. Blocked only on first-run HF token.

What needs building:

  • --diarize flag on the CLI
  • Pyannote pipeline integration after WhisperX ASR pass
  • Speaker label propagation to output JSON ({speaker: 'SPEAKER_00', start: 12.3, end: 14.1, text: '...'})
  • Token check: error cleanly with setup instructions if HF_TOKEN missing or pyannote weights not cached

Reference: the Lex Fridman 3.4-hour Tao episode (lex_long.wav) is a good two-speaker test — host + Tao. Should produce SPEAKER_00 / SPEAKER_01 segments.

WhisperX's headline feature. Two-model pipeline: speaker-diarization-3.1 + segmentation-3.0. **State:** EULAs already accepted for both models in browser session. Blocked only on first-run HF token. **What needs building:** - `--diarize` flag on the CLI - Pyannote pipeline integration after WhisperX ASR pass - Speaker label propagation to output JSON (`{speaker: 'SPEAKER_00', start: 12.3, end: 14.1, text: '...'}`) - Token check: error cleanly with setup instructions if `HF_TOKEN` missing or pyannote weights not cached **Reference:** the Lex Fridman 3.4-hour Tao episode (`lex_long.wav`) is a good two-speaker test — host + Tao. Should produce `SPEAKER_00` / `SPEAKER_01` segments.
Mark commented 2026-09-06 16:58:54 +00:00
Author
Owner
Copy link

Triaged and unblocked: HF token is now in place at ~/.huggingface/token (rotated 2026-09-06). pyannote weights should download without the auth bootstrap failure. Ready for the kilo-gsd lane.

Triaged and unblocked: HF token is now in place at ~/.huggingface/token (rotated 2026-09-06). pyannote weights should download without the auth bootstrap failure. Ready for the kilo-gsd lane.
Mark 2026-09-06 17:00:42 +00:00
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
No results found.
Labels
Clear labels   
blocked:preflight

Blocked on a precondition (parent issue, upstream PR, or sibling fix)

  
bug

Something is broken and needs fixing

  
feature-request

New feature or capability

  
in-progress

Locked by an active fixit pipeline run

  
quickfix

Fast-path: small, low-risk fix ready for kilo-gsd

  
smoke-tested

Verified end-to-end on 2026-09-01

  
triage-approved

Triaged and approved for implementation

No labels
blocked:preflight
bug
feature-request
in-progress
quickfix
smoke-tested
triage-approved
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
Mark/whisper-transcribe#1
No description provided.