Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
-
Updated
Nov 3, 2023 - Go
Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
PulseHA is a active-passive high availability cluster daemon that uses GRPC and is written in GO.
A lightweight Linux cluster orchestration system written in Go (Under active development, just working on plugins https://github.com/chabad360/plugins)
Create self-managed kubernetes clusters on Azure, with swappable pieces
Florida API compatible Dynomite seed_provider. using HashiCorp memberlist
Simple and Really Fast Varnish Cache Cluster Manager (for Varnish 6.x/7.x)
Add a description, image, and links to the cluster-manager topic page so that developers can more easily learn about it.
To associate your repository with the cluster-manager topic, visit your repo's landing page and select "manage topics."