跳至主要内容
小龙虾小龙虾AI
🤖

Astrai Inference Router

Route all LLM calls through Astrai for 40%+ cost savings with intelligent routing and privacy controls

下载341
星标2
版本1.0.1
效率工具
安全通过
💬Prompt

技能说明


name: astrai-inference-router description: Route all LLM calls through Astrai for 40%+ cost savings with intelligent routing and privacy controls version: 1.0.0 homepage: https://github.com/beee003/astrai-openclaw metadata: clawdbot: emoji: "⚡" requires: env: ["ASTRAI_API_KEY", "ANTHROPIC_API_KEY"] primaryEnv: "ASTRAI_API_KEY" files: ["plugin.py", "config.example.toml"] tags: [inference, routing, privacy, cost-optimization, gdpr, eu, savings, llm-gateway]

Astrai Inference Router

Route every LLM call through Astrai's intelligent router. Save 40%+ on API costs. Privacy controls built in.

What it does

  • Smart routing: Classifies each task (code, research, chat, creative) and picks the optimal model
  • Cost savings: Bayesian learning finds the cheapest provider that meets your quality threshold
  • Auto-failover: Circuit breaker switches providers when one goes down
  • PII protection: Personally identifiable information stripped before reaching any provider
  • EU routing: GDPR-compliant European-only routing with one setting
  • Budget caps: Set daily spend limits to prevent runaway costs
  • Real-time tracking: See exactly how much you're saving per request

Setup

  1. Get a free API key at as-trai.com
  2. Set ASTRAI_API_KEY in your environment or skill config
  3. Choose your privacy mode (default: enhanced)
  4. Done — all LLM calls now route through Astrai

Privacy Modes

  • standard: Full routing intelligence, normal logging
  • enhanced: PII stripped, metadata-only logging, region enforced
  • max: Zero data retention, EU-only, all PII stripped, no prompt logging

Environment Variables

VariableRequiredDescriptionDefault
ASTRAI_API_KEYYesYour API key from as-trai.com
PRIVACY_MODENostandard, enhanced, maxenhanced
REGIONNoany, eu, usany
DAILY_BUDGETNoMax daily spend in USD (0 = unlimited)10

External Endpoints

EndpointPurposeData Sent
https://as-trai.com/v1/chat/completionsLLM inference routingPrompts (with PII stripped if enhanced/max mode)
https://as-trai.com/v1/signupFree API key registrationEmail address

Security & Privacy

  • All requests authenticated via API key in Authorization header
  • PII stripping runs locally before any data leaves your machine (enhanced/max modes)
  • EU routing mode ensures prompts never leave European infrastructure
  • Zero data retention available in max privacy mode
  • No credentials are stored by the skill — only your API key in environment variables
  • Source code is fully open: github.com/beee003/astrai-openclaw

Model Invocation

This skill intercepts outgoing LLM API calls and reroutes them through the Astrai gateway. The gateway selects the optimal provider and model based on task type, cost, and quality. Your prompts are processed by third-party LLM providers (Anthropic, OpenAI, Google, Mistral, etc.) according to your region and privacy settings.

Pricing

  • Free: 1,000 requests/day, smart routing, failover
  • Pro ($49/mo): Unlimited requests, EU routing, PII stripping, analytics
  • Business ($199/mo): Multi-agent dashboards, compliance exports, SLA

如何使用「Astrai Inference Router」?

  1. 打开小龙虾AI(Web 或 iOS App)
  2. 点击上方「立即使用」按钮,或在对话框中输入任务描述
  3. 小龙虾AI 会自动匹配并调用「Astrai Inference Router」技能完成任务
  4. 结果即时呈现,支持继续对话优化

相关技能