Mesh LLM enables distributed AI inference across pooled GPUs

Mesh LLM pools GPUs from multiple machines into a single OpenAI-compatible API, allowing models to run locally, route to peers, or split across devices. Built on iroh, it aims to reduce reliance on data-center APIs and give teams control over hardware and costs.