Skip to content

chore(model gallery): add gemma-3-12b-it-qat #5117

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 4, 2025

Conversation

mudler
Copy link
Owner

@mudler mudler commented Apr 4, 2025

Description

This pull request includes an update to the gallery/index.yaml file to add a new model entry for the Gemma 3 series. The most important change is the addition of the Gemma 3 12B instruction-tuned model with Quantization Aware Training (QAT).

New model entry:

  • Added a new entry for the "gemma-3-12b-it-qat" model, which includes URLs, a description, and file details. This model is a 12B instruction-tuned version of the Gemma 3 model in GGUF format using QAT, which preserves similar quality as bfloat16 while reducing memory requirements.

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler force-pushed the models/gemma-3-12b-it-qat branch from 18af400 to adb91ba Compare April 4, 2025 08:13
Copy link

github-actions bot commented Apr 4, 2025

yamllint Failed

Show Output
::group::gallery/index.yaml
::warning file=gallery/index.yaml,line=21,col=6::21:6 [comments] missing starting space in comment
::warning file=gallery/index.yaml,line=39,col=6::39:6 [comments] missing starting space in comment
::warning file=gallery/index.yaml,line=57,col=6::57:6 [comments] missing starting space in comment
::error file=gallery/index.yaml,line=81,col=15::81:15 [anchors] found undeclared alias "llama3"
::warning file=gallery/index.yaml,line=2532,col=32::2532:32 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=4493,col=59::4493:59 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=5537,col=70::5537:70 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=7698,col=61::7698:61 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=7763,col=64::7763:64 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=8153,col=59::8153:59 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=8554,col=64::8554:64 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=9467,col=59::9467:59 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=9512,col=63::9512:63 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=9529,col=62::9529:62 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=11811,col=59::11811:59 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=12022,col=61::12022:61 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=12042,col=62::12042:62 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=12097,col=28::12097:28 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=12972,col=59::12972:59 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=13278,col=62::13278:62 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=13333,col=63::13333:63 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=13455,col=63::13455:63 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=13670,col=73::13670:73 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=14006,col=62::14006:62 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=14137,col=61::14137:61 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=14266,col=21::14266:21 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=14476,col=65::14476:65 [comments] too few spaces before comment
::warning file=gallery/index.yaml,line=14648,col=56::14648:56 [comments] too few spaces before comment
::endgroup::

Workflow: Yamllint GitHub Actions, Action: __karancode_yamllint-github-action, Lint: gallery

Copy link

netlify bot commented Apr 4, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit 18af400
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/67ef9480e3d06c000869a8ea
😎 Deploy Preview https://deploy-preview-5117--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Copy link

netlify bot commented Apr 4, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit adb91ba
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/67ef949332a1ba00085b7596
😎 Deploy Preview https://deploy-preview-5117--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@mudler mudler merged commit 128612a into master Apr 4, 2025
24 of 25 checks passed
@mudler mudler deleted the models/gemma-3-12b-it-qat branch April 4, 2025 08:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant