Perf monitoring CLI tool for Apple Silicon

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution

A MLX port of FLUX based on the Huggingface Diffusers implementation.

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

Run LLaMA (and Stanford-Alpaca) inference on Apple Silicon GPUs.

Finetune llama2-70b and codellama on MacBook Air without quantization

Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.

SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.

A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.

Articles and tools related to research in the Apple environment (mainly macOS).

MacOS menu‑bar utility to adjust Apple Silicon GPU VRAM allocation

Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.

GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For more on 3SO: https://huggingface.co/blog/ucheog/llm-power-steering

Black-box tool that uses Deep Reinforcement Learning to test and explore Android applications

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

Rasa on ARM-based Macs (Native/Docker)

Unofficial native Mixxx builds for macOS (Apple Silicon/Intel) and Linux

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

Blender Guide