Voxta Text Generation Web UI
Connect Voxta to oobabooga's text-generation-webui local LLM front-end.
Text Generation Web UI (often "oobabooga") is a popular gradio-based local LLM front-end that supports many model formats (GGUF, GPTQ, EXL2, AWQ, transformers) and exposes an API. You install and run oobabooga separately, and Voxta connects to its API.
Setup
Install Text Generation Web UI
Follow the install instructions at github.com/oobabooga/text-generation-webui. The one-click installer is the easiest path on Windows.
Load a model
Open the Web UI (default http://localhost:7860), go to the Models tab, load whichever model you want.
Enable the API
In oobabooga, go to Session → API and start the API. Default URL: http://localhost:5000/v1.
Add to Voxta
Manage Services → + Add Services → Text Generation Web UI → Add.
Enter the API URL (default http://localhost:5000/v1), click Save.