Support for local LLM with Hudini | Core Web App

Support for local LLM with Hudini

Full Parrotfish

Add support for integrating Hudini with self-hosted LLMs, allowing organizations to use their own on-premises or private cloud AI models without relying on third-party AI providers.

Created by David K.

August 8, 2025

Philosophical Mockingbird

Yes please!!

Popular Giraffe

This would be great for us as well as we have an internal Llama server OR at least allow the endpoint URL to be changed as Granite suggested as then we can redirect to our own router.

Distant Reptile

Would love this! Should be pretty trivial to allow Llama.

Granite Pigeon

Allowing to override the endpoint URL for OpenAI provider will help greatly.