EIDONIX

Solutions Model gateway

go-llm-proxy

One endpoint for every model your tools need.

Status
Live
Shape
Single binary
Built with
Go · MCP · SQLite
Open go-llm-proxy

Consolidates Model Access

Every coding assistant and agent speaks a slightly different API, and every model backend expects a different one. Wiring each client to each backend by hand is work that produces nothing.

The proxy sits in the middle and translates. Clients see one endpoint and one model list; behind it sit local GPU servers, cloud APIs, and third-party providers. It also fills in what local backends lack — web search, PDF text extraction, OCR, and image description — so a tool that expects those capabilities just works.

In use

The go-llm-proxy config generator listing available models with their protocol, data safety and context window
Every backend behind one model list. The data-safety column says where each request actually goes: local, Bedrock, or a third party.

Capabilities

Protocol translationAnthropic Messages, OpenAI Responses, Chat Completions, and Bedrock Converse, translated automatically so any client reaches any backend.
Model multiplexingLocal GPU servers, cloud APIs, and third-party providers behind a single model list.
Documents and imagesText extraction from PDFs with an OCR fallback for scans. Images described for models that cannot see.
Search and MCPWeb searches run server-side and the results are injected, with an MCP endpoint for agent clients.
Key managementProxy keys carry per-key model restrictions. Backend credentials never leave the server.

Related

CletusIn active use

An analytics workspace that investigates a question, runs the analysis, and hands back the work.

  • Works across sources — Spreadsheets, shared files, SQL databases, market data, and Eidonix Lens knowledge catalogs.
  • Runs the analysis — SQL, DuckDB, Python, R, and charting inside a controlled sandbox.
  • Produces real artifacts — Charts, native Excel workbooks, and reports you can hand to someone.
  • Carries knowledge forward — Skills leave with the retiring workforce. Cletus helps you capture and transfer that knowledge to the new generation.
Go · Svelte
Eidonix LensLive

Turns private documents and selected public-web material into a knowledge base that gets better as people use it.

  • Catalogs — Manuals, filings, PDFs, images, and folders. Extraction and OCR run in the background.
  • Web probes — Finds candidate sites, grades them, and crawls the ones worth keeping.
  • Search — Hybrid retrieval with reranking scores, source links, and streamed summaries.
  • API access — Scope application keys to specific catalogs or workspaces.
Go · Qdrant · Postgres