Gemma-4 chat template uses wrong <|turn> tokens instead of correct <start_of_turn>/<end_of_turn> #21
Labels
No labels
blocked:lint-failed
blocked:needs-decision
blocked:no-changes
blocked:no-procedure
blocked:preflight
blocked:verify-failed
bug
feature-request
in-progress
lint-cleanup
ops-task
quickfix
security/high
security/medium
test-coverage
triage-approved
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
Mark/vllm_mm#21
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
chat_templates.py:164-191: _build_gemma_prompt uses <|turn> tokens. .jinja file has correct tokens. FAMILY_BUILDERS routes through buggy function, not .jinja. Gemma-4 models get garbled prompts.