xlite-dev

All

25 repositories

LeetCUDA
Public
📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA/Tensor Cores Kernels, HGEMM, FA-2 MMA.
cuda cuda-kernels cuda-demo cuda-toolkit cuda-library cuda-kernel learn-cuda cuda-cpp hgemm flash-attention
Cuda
•
GNU General Public License v3.0
•524•4.8k•4•0•Updated Jun 21, 2025Jun 21, 2025
cache-dit
Public
🤗CacheDiT: A Training-free and Easy-to-use Cache Acceleration Toolbox for Diffusion Transformers
Python
•
Other
•2•2•0•0•Updated Jun 21, 2025Jun 21, 2025
Awesome-LLM-Inference
Public
📚A curated list of Awesome LLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.
mla vllm llm-inference awesome-llm flash-attention tensorrt-llm paged-attention deepseek flash-attention-3 deepseek-v3
Python
•
GNU General Public License v3.0
•286•4.1k•0•0•Updated Jun 20, 2025Jun 20, 2025
lite.ai.toolkit
Public
🛠 A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉
tensorrt mnn ncnn onnx onnxruntime yolov5 tnn mnn-model yolox robustvideomatting
C++
•
GNU General Public License v3.0
•745•4.1k•0•0•Updated Jun 20, 2025Jun 20, 2025
Awesome-DiT-Inference
Public
📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Caching, Quantization, Parallelism, etc.
flux wan diffusion dit sora stable-diffusion sdxl sd15 deepcache open-sora-plan
Python
•
GNU General Public License v3.0
•16•271•0•0•Updated Jun 20, 2025Jun 20, 2025
.github
Public
0•1•0•0•Updated Jun 20, 2025Jun 20, 2025
torchlm
Public
💎An easy-to-use PyTorch library for face landmarks detection: training, evaluation, inference, and 100+ data augmentations.
heatmap regression pip data-augmentation face-landmarks mobilenet shufflenet torchvision albumentations yolov5
Python
•
MIT License
•24•259•15•0•Updated Jun 17, 2025Jun 17, 2025
SpargeAttn
Public
SpargeAttention: A training-free sparse attention that can accelerate any model inference.
Cuda
•
Apache License 2.0
•44•6•0•0•Updated May 24, 2025May 24, 2025
SageAttention
Public
Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.
Cuda
•
Apache License 2.0
•130•0•0•0•Updated May 24, 2025May 24, 2025
lihang-notes
Public
📚《统计学习方法-李航: 笔记》 200页PDF，公式细节讲解🎉
svm kd-tree ml statistics-learning lihang li-hang lihang-code lihang-notes li-hang-notes
Shell
•
GNU General Public License v3.0
•57•465•2•0•Updated May 17, 2025May 17, 2025
HGEMM
Public
⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
cuda tensor-cores hgemm
Cuda
•
GNU General Public License v3.0
•4•80•0•0•Updated May 10, 2025May 10, 2025
ffpa-attn
Public
⚡️FFPA: Extend FlashAttention-2 with Split-D, achieve ~O(1) SRAM complexity for large headdim, 1.8x~3x↑ vs SDPA.
cuda attention sdpa mla mlsys tensor-cores flash-attention deepseek deepseek-v3 deepseek-r1
Cuda
•
GNU General Public License v3.0
•8•186•0•0•Updated May 10, 2025May 10, 2025
xlite-cli
Public
The cli version of lite.ai.toolkit
C++
•0•1•0•0•Updated Apr 9, 2025Apr 9, 2025
flashinfer
Public
FlashInfer: Kernel Library for LLM Serving
Cuda
•
Apache License 2.0
•347•0•0•0•Updated Mar 23, 2025Mar 23, 2025
tutorial-template
Public template
Template for the Read the Docs tutorial
Python
•1.6k•0•0•0•Updated Aug 9, 2024Aug 9, 2024
RVM-Inference
Public
🔥Robust Video Matting C++ inference toolkit with ONNXRuntime、MNN、NCNN and TNN, via lite.ai.toolkit.
cpp matting mnn ncnn onnx onnxruntime tnn robustvideomatting
C++
•
GNU General Public License v3.0
•27•127•20•0•Updated Jul 29, 2024Jul 29, 2024
netron-vscode-extension
Public
☕️ A vscode extension for netron, support *.pdmodel, *.nb, *.onnx, *.pb, *.h5, *.tflite, *.pth, *.pt, *.mnn, *.param, etc.
deeplearning paddle mnn ncnn onnx onnxruntime yolov5 tnn netron yolov8
TypeScript
•
Other
•0•13•3•0•Updated Jun 4, 2023Jun 4, 2023
yolov5face-toolkit
Public
YOLO5Face 2021 with MNN/NCNN/TNN/ONNXRuntime
cpp yolov5-face-landmark yolo5face yolov5face yolov5-face yolo5-face yolov7-face yolov8-face
C++
•
GNU General Public License v3.0
•8•57•6•0•Updated Apr 21, 2023Apr 21, 2023
ssrnet-toolkit
Public
SSRNet: 190 Kb!! Super fast Age Estimation with MNN/TNN/ONNXRuntime C++.
ssrnet
C++
•
GNU General Public License v3.0
•0•3•0•0•Updated Feb 4, 2022Feb 4, 2022
fsanet-toolkit
Public
FSANet: 1 Mb!! Head Pose Estimation with MNN、TNN and ONNXRuntime C++.
fsanet
C++
•
GNU General Public License v3.0
•2•17•0•0•Updated Feb 4, 2022Feb 4, 2022
mgmatting-toolkit
Public
MGMatting with MNN/TNN/ONNXRuntime C++, GPU/CPU, support dynamic shape.
cpp matting mnn onnxruntime tnn mgmatting
C++
•
GNU General Public License v3.0
•2•7•1•0•Updated Feb 3, 2022Feb 3, 2022
scrfd-toolkit
Public
Super fast accurate face detector ! SCRFD(CVPR 2021) with MNN/TNN/NCNN/ONNXRuntime C++.
mnn ncnn onnxruntime tnn scrfd
C++
•
GNU General Public License v3.0
•3•17•0•0•Updated Jan 12, 2022Jan 12, 2022
nanodet-toolkit
Public
NanoDet、NanoDet-Plus with ONNXRuntime/MNN/TNN/NCNN C++.
mnn ncnn onnxruntime tnn nanodet
C++
•
GNU General Public License v3.0
•7•26•2•0•Updated Dec 27, 2021Dec 27, 2021
yolox-toolkit
Public
YOLOX with NCNN/MNN/TNN/ONNXRuntime C++.
yolox
C++
•
GNU General Public License v3.0
•1•13•1•0•Updated Dec 18, 2021Dec 18, 2021
yolop-toolkit
Public
YOLOP with ONNXRuntime C++/MNN/TNN/NCNN
mnn ncnn onnxruntime tnn yolop
C++
•
GNU General Public License v3.0
•0•8•0•0•Updated Dec 18, 2021Dec 18, 2021