Feature Request:

[Godl1nk]

Prerequisites

• I am running the latest code. Mention the version if possible as well.
• I carefully followed the README.md.
• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Can u guys update llama.cpp upstream so we can get the speed buff benefit for mtp pls?
ggml-org#24025

thanks for the good work, much appreciated

Motivation

Improve performance on MTP

Possible Implementation

update upstream

[Anbeeld]

"Me guys" are working on it, yep.

[Godl1nk]

Thanks broda 🫡