Open
Description
Prerequisites
- I am running the latest code. Mention the version if possible as well.
- I carefully followed the README.md.
- I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
- I reviewed the Discussions, and have a new and useful enhancement to share.
Feature Description
It would be great to have llama.cpp support for
https://huggingface.co/tencent/Hunyuan-A13B-Instruct
Motivation
This is an MoE model with 13 billion active parameters (80 billion in total).
It looks perfect for home computers with one or more GPUs.
Possible Implementation
No response