Skip to content

fix: restore singleton dims for LLM outputs#1518

Merged
leejet merged 1 commit into
masterfrom
fix/llm-output-singleton-dims
May 18, 2026
Merged

fix: restore singleton dims for LLM outputs#1518
leejet merged 1 commit into
masterfrom
fix/llm-output-singleton-dims

Conversation

@leejet
Copy link
Copy Markdown
Owner

@leejet leejet commented May 18, 2026

Summary

  • Restore trailing singleton dimensions on LLM compute outputs.
  • Fix single-token conditioning paths where ggml may drop the token dimension and make hidden_states.shape()[1]
    invalid.

Related Issue / Discussion

N/A

Additional Information

N/A

Checklist

@leejet leejet merged commit b706d68 into master May 18, 2026
13 of 14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant