Skip to content

[gkd] support use_logits_to_keep/padding_free/packing & update gkd shell #4658

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Jun 21, 2025

Conversation

Jintao-Huang
Copy link
Collaborator

@Jintao-Huang Jintao-Huang commented Jun 21, 2025

fast.sh
100 its

llm 7B

截屏2025-06-21 22 22 07

@Jintao-Huang Jintao-Huang changed the title update readme & shell update gkd docs & shell Jun 21, 2025
@Jintao-Huang Jintao-Huang changed the title update gkd docs & shell [gkd] update gkd shell & gkd support padding_free 1.5s/it Jun 21, 2025
@Jintao-Huang Jintao-Huang changed the title [gkd] update gkd shell & gkd support padding_free 1.5s/it [gkd] update gkd shell & gkd support padding_free Jun 21, 2025
@Jintao-Huang
Copy link
Collaborator Author

Jintao-Huang commented Jun 21, 2025

vlm: 2B

padding_free: 3s/it
截屏2025-06-21 22 54 02

截屏2025-06-21 22 55 55

@Jintao-Huang Jintao-Huang changed the title [gkd] update gkd shell & gkd support padding_free [gkd] support padding_free & update gkd shell Jun 21, 2025
@Jintao-Huang Jintao-Huang changed the title [gkd] support padding_free & update gkd shell [gkd] support use_logits_to_keep & padding_free & update gkd shell Jun 21, 2025
@Jintao-Huang Jintao-Huang changed the title [gkd] support use_logits_to_keep & padding_free & update gkd shell [gkd] support use_logits_to_keep/padding_free/packing & update gkd shell Jun 21, 2025
@Jintao-Huang Jintao-Huang merged commit 67549f2 into modelscope:main Jun 21, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants