From b7463963d6bc21035e6cec5ecf6131c83fd04ab7 Mon Sep 17 00:00:00 2001 From: HashWarlock Date: Sun, 25 Jan 2026 19:20:01 -0600 Subject: [PATCH] docs: add Redpill AI provider documentation Comprehensive guide covering setup, privacy tiers, model catalog, and troubleshooting. Co-Authored-By: Claude Sonnet 4.5 --- docs/providers/redpill.md | 258 ++++++++++++++++++++++++++++++++++++++ 1 file changed, 258 insertions(+) create mode 100644 docs/providers/redpill.md diff --git a/docs/providers/redpill.md b/docs/providers/redpill.md new file mode 100644 index 000000000..ba1504b1f --- /dev/null +++ b/docs/providers/redpill.md @@ -0,0 +1,258 @@ +--- +summary: "Use Redpill AI GPU TEE models in Clawdbot" +read_when: + - You want privacy-focused inference with hardware-verified security + - You want GPU TEE model setup guidance +--- +# Redpill AI + +Redpill AI provides access to AI models running in GPU-based Trusted Execution Environments (TEEs) with cryptographic attestation. All models run inside secure hardware enclaves, ensuring memory encryption, tamper-proof execution, and verifiable computation. + +## Why Redpill in Clawdbot + +- **Hardware-verified privacy** via GPU TEE technology with cryptographic attestation +- **Zero trust architecture** with memory encryption and isolated execution +- **18 verified models** across 4 TEE providers (Phala, Tinfoil, Chutes, Near-AI) +- **Verifiable computation** ensuring your prompts and responses stay private +- OpenAI-compatible `/v1` endpoints + +## Privacy Tiers + +Redpill offers two privacy levels: + +| Tier | Description | Models | Status | +|------|-------------|--------|--------| +| **GPU TEE** | Hardware-verified privacy with cryptographic attestation. Models run in secure enclaves with memory encryption and tamper-proof execution. | 18 models across Phala, Tinfoil, Chutes, Near-AI | ✅ Available | +| **Extended** | Additional models with standard privacy (no TEE hardware guarantee). | TBD | 🔜 Coming soon | + +## Features + +- **GPU TEE security**: All models run in hardware-secured enclaves with cryptographic attestation +- **Memory encryption**: Data stays encrypted in GPU memory during inference +- **Tamper-proof execution**: Verifiable computation guarantees no unauthorized access +- **4 TEE providers**: Phala Network (10 models), Tinfoil (4), Chutes (1), Near-AI (3) +- **OpenAI-compatible API**: Standard `/v1` endpoints for easy integration +- **Streaming**: ✅ Supported on all models +- **Function calling**: ✅ Supported on select models +- **Vision**: ✅ Supported on Qwen3 VL 30B model +- **No hard rate limits**: Fair-use throttling may apply for extreme usage + +## Setup + +### 1. Get API Key + +1. Sign up at [redpill.ai](https://redpill.ai) +2. Navigate to **API Keys** in your dashboard +3. Create a new API key +4. Copy your API key (format: `rp_xxxxxxxxxxxx`) + +### 2. Configure Clawdbot + +**Option A: Environment Variable** + +```bash +export REDPILL_API_KEY="rp_xxxxxxxxxxxx" +``` + +**Option B: Interactive Setup (Recommended)** + +```bash +clawdbot onboard --auth-choice redpill-api-key +``` + +This will: +1. Prompt for your API key (or use existing `REDPILL_API_KEY`) +2. Show all available GPU TEE models +3. Let you pick your default model +4. Configure the provider automatically + +**Option C: Non-interactive** + +```bash +clawdbot onboard --non-interactive \ + --auth-choice redpill-api-key \ + --token "rp_xxxxxxxxxxxx" +``` + +### 3. Verify Setup + +```bash +clawdbot chat --model redpill/deepseek/deepseek-v3.2 "Hello, are you working?" +``` + +## Model Selection + +After setup, Clawdbot shows all available Redpill models. Pick based on your needs: + +- **Default (our pick)**: `redpill/deepseek/deepseek-v3.2` for strong reasoning with GPU TEE privacy. +- **Best reasoning**: `redpill/deepseek/deepseek-r1-0528` or `redpill/moonshotai/kimi-k2-thinking` for complex reasoning tasks. +- **Best coding**: `redpill/qwen/qwen3-coder-480b-a35b-instruct` for code generation and analysis. +- **Vision tasks**: `redpill/qwen/qwen3-vl-30b-a3b-instruct` for image understanding. +- **Fast + capable**: `redpill/meta-llama/llama-3.3-70b-instruct` for balanced performance. + +Change your default model anytime using the `/model` directive in chat: + +``` +/model redpill/deepseek/deepseek-r1-0528 +``` + +List all available models: + +```bash +clawdbot models list | grep redpill +``` + +## GPU TEE Models (18 Total) + +All models run in hardware-secured GPU TEE environments with cryptographic attestation. + +### Phala Network (10 models) + +| Model ID | Name | Context | Max Output | Features | +|----------|------|---------|------------|----------| +| `z-ai/glm-4.7-flash` | GLM 4.7 Flash | 203k | 128k | General, multilingual | +| `qwen/qwen3-embedding-8b` | Qwen3 Embedding 8B | 33k | 512 | Embeddings | +| `phala/uncensored-24b` | Uncensored 24B | 33k | 8k | Uncensored | +| `deepseek/deepseek-v3.2` | DeepSeek v3.2 | 164k | 8k | **Default**, reasoning | +| `qwen/qwen3-vl-30b-a3b-instruct` | Qwen3 VL 30B | 128k | 8k | Vision | +| `sentence-transformers/all-minilm-l6-v2` | All-MiniLM-L6-v2 | 512 | 512 | Embeddings | +| `qwen/qwen-2.5-7b-instruct` | Qwen 2.5 7B Instruct | 33k | 8k | General | +| `google/gemma-3-27b-it` | Gemma 3 27B IT | 54k | 8k | General | +| `openai/gpt-oss-120b` | GPT OSS 120B | 131k | 8k | General | +| `openai/gpt-oss-20b` | GPT OSS 20B | 131k | 8k | General | + +### Tinfoil (4 models) + +| Model ID | Name | Context | Max Output | Features | +|----------|------|---------|------------|----------| +| `moonshotai/kimi-k2-thinking` | Kimi K2 Thinking | 262k | 8k | Reasoning | +| `deepseek/deepseek-r1-0528` | DeepSeek R1 | 164k | 8k | Reasoning | +| `qwen/qwen3-coder-480b-a35b-instruct` | Qwen3 Coder 480B | 262k | 8k | Code | +| `meta-llama/llama-3.3-70b-instruct` | Llama 3.3 70B Instruct | 131k | 8k | General | + +### Chutes (1 model) + +| Model ID | Name | Context | Max Output | Features | +|----------|------|---------|------------|----------| +| `minimax/minimax-m2.1` | MiniMax M2.1 | 197k | 8k | General | + +### Near-AI (3 models) + +| Model ID | Name | Context | Max Output | Features | +|----------|------|---------|------------|----------| +| `deepseek/deepseek-chat-v3.1` | DeepSeek Chat v3.1 | 164k | 8k | General | +| `qwen/qwen3-30b-a3b-instruct-2507` | Qwen3 30B Instruct | 262k | 8k | General | +| `z-ai/glm-4.6` | GLM 4.6 | 203k | 128k | General, multilingual | + +## Which Model Should I Use? + +| Use Case | Recommended Model | Why | +|----------|-------------------|-----| +| **General chat** | `deepseek/deepseek-v3.2` | Default, strong reasoning, GPU TEE | +| **Complex reasoning** | `deepseek/deepseek-r1-0528` | Reasoning-optimized with R1 architecture | +| **Long context reasoning** | `moonshotai/kimi-k2-thinking` | 262k context, reasoning-focused | +| **Coding** | `qwen/qwen3-coder-480b-a35b-instruct` | Code-specialized, 262k context | +| **Vision tasks** | `qwen/qwen3-vl-30b-a3b-instruct` | Only vision model, 128k context | +| **Fast + balanced** | `meta-llama/llama-3.3-70b-instruct` | Llama 3.3, good all-around | +| **Uncensored** | `phala/uncensored-24b` | No content restrictions | +| **Embeddings** | `qwen/qwen3-embedding-8b` | Text embeddings | + +## Pricing + +Redpill uses a credit-based system. Check [redpill.ai/pricing](https://redpill.ai/pricing) for current rates. + +All GPU TEE models incur costs based on: +- Input tokens (per 1M tokens) +- Output tokens (per 1M tokens) +- TEE attestation overhead (minimal) + +## Usage Examples + +```bash +# Use default model +clawdbot chat --model redpill/deepseek/deepseek-v3.2 + +# Use reasoning model +clawdbot chat --model redpill/deepseek/deepseek-r1-0528 + +# Use coding model +clawdbot chat --model redpill/qwen/qwen3-coder-480b-a35b-instruct + +# Use vision model with image +clawdbot chat --model redpill/qwen/qwen3-vl-30b-a3b-instruct + +# Switch model mid-chat using /model directive +> /model redpill/moonshotai/kimi-k2-thinking +``` + +## Streaming & Tool Support + +| Feature | Support | +|---------|---------| +| **Streaming** | ✅ All models | +| **Function calling** | ✅ Select models (check model capabilities) | +| **Vision/Images** | ✅ Qwen3 VL 30B only | +| **JSON mode** | ✅ Supported via `response_format` | + +## Troubleshooting + +### API key not recognized + +```bash +echo $REDPILL_API_KEY +clawdbot models list | grep redpill +``` + +Ensure the key starts with `rp_`. + +### Model not available + +Run `clawdbot models list | grep redpill` to see currently available models. All 18 GPU TEE models should be listed. + +### Connection issues + +Redpill API is at `https://api.redpill.ai/v1`. Ensure your network allows HTTPS connections. + +### TEE attestation failed + +If you receive attestation errors: +1. Try a different TEE provider model +2. Verify your API key is valid +3. Check the main Redpill website for service announcements + +## Config File Example + +```json5 +{ + env: { REDPILL_API_KEY: "rp_..." }, + agents: { defaults: { model: { primary: "redpill/deepseek/deepseek-v3.2" } } }, + models: { + mode: "merge", + providers: { + redpill: { + baseUrl: "https://api.redpill.ai/v1", + apiKey: "${REDPILL_API_KEY}", + api: "openai-completions", + models: [ + { + id: "deepseek/deepseek-v3.2", + name: "DeepSeek v3.2 (GPU TEE)", + reasoning: false, + input: ["text"], + cost: { input: 0, output: 0, cacheRead: 0, cacheWrite: 0 }, + contextWindow: 164000, + maxTokens: 8192 + } + ] + } + } + } +} +``` + +## More Information + +- [Redpill AI](https://redpill.ai) +- [API Documentation](https://docs.redpill.ai) +- [GPU TEE Technology](https://docs.redpill.ai/privacy/overview) +- [Pricing](https://redpill.ai/pricing)