meshapplied/goethe: Serve models locally on your own infrastructure

github.com2 min read

Goethe is an open-source tool designed to run and share AI models on local infrastructure in three steps, turning a Linux machine into an API compatible with OpenAI, Anthropic, and LiteLLM clients. It allows users to manage models, configure network access, and leverage GPU acceleration while keeping all prompts and data private on hardware they control. The software supports various NVIDIA GPUs, includes its own CUDA runtime, and is licensed under the Apache License 2.0. Open article →

More on this topic