tokilake-ai-gateway

Self-hosted AI gateway for distributed local LLM GPUs. OpenAI-compatible API with NAT traversal, WebSocket/QUIC tunnels, Ollama/vLLM/SGLang workers.

PluginAI ModelsNetwork
Verification
L2 · Structured
Security
Pending
Health
Inactive
Trust
Bronze

What it doesAI

Self-hosted AI gateway that exposes distributed local LLM GPUs via an OpenAI-compatible API with secure tunnels.

  • OpenAI-compatible API for local LLMs
  • NAT traversal and WebSocket/QUIC tunnels
  • Supports Ollama, vLLM, SGLang workers

AI-generated from the repo README — for reference only.

Installation

dsh plugin --profile web add tokilake-ai-gateway

Install method: npm · not yet tested in container (L3+)

Compatibility

DSH VersionStatus
not statedDeclared — not tested

Requirements

  • • Node.js: not stated
  • • DSH: declared "not stated"
  • • External credentials: none detected

Security Report

Automated scan, not manual review.

• Dependency vulnerabilities: — (pending)

• Suspicious permissions: — (pending)

• Hardcoded secrets: — (pending)

• Supply chain risks: — (pending)

⚠ Security audit scheduled — results will appear here after the next scan.

Activity

Last commit 2026-05-12 · activity: inactive

6 mo

Source

GitHub: github.com/Tokimorphling/tokilake-ai-gateway