docs: add Redpill AI provider documentation
Comprehensive guide covering setup, privacy tiers, model catalog, and troubleshooting. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
This commit is contained in:
HashWarlock
parent
ba22054935
commit
b7463963d6
258
docs/providers/redpill.md
Normal file
258
docs/providers/redpill.md
Normal file
@ -0,0 +1,258 @@
|
||||
---
|
||||
summary: "Use Redpill AI GPU TEE models in Clawdbot"
|
||||
read_when:
|
||||
- You want privacy-focused inference with hardware-verified security
|
||||
- You want GPU TEE model setup guidance
|
||||
---
|
||||
# Redpill AI
|
||||
|
||||
Redpill AI provides access to AI models running in GPU-based Trusted Execution Environments (TEEs) with cryptographic attestation. All models run inside secure hardware enclaves, ensuring memory encryption, tamper-proof execution, and verifiable computation.
|
||||
|
||||
## Why Redpill in Clawdbot
|
||||
|
||||
- **Hardware-verified privacy** via GPU TEE technology with cryptographic attestation
|
||||
- **Zero trust architecture** with memory encryption and isolated execution
|
||||
- **18 verified models** across 4 TEE providers (Phala, Tinfoil, Chutes, Near-AI)
|
||||
- **Verifiable computation** ensuring your prompts and responses stay private
|
||||
- OpenAI-compatible `/v1` endpoints
|
||||
|
||||
## Privacy Tiers
|
||||
|
||||
Redpill offers two privacy levels:
|
||||
|
||||
| Tier | Description | Models | Status |
|
||||
|------|-------------|--------|--------|
|
||||
| **GPU TEE** | Hardware-verified privacy with cryptographic attestation. Models run in secure enclaves with memory encryption and tamper-proof execution. | 18 models across Phala, Tinfoil, Chutes, Near-AI | ✅ Available |
|
||||
| **Extended** | Additional models with standard privacy (no TEE hardware guarantee). | TBD | 🔜 Coming soon |
|
||||
|
||||
## Features
|
||||
|
||||
- **GPU TEE security**: All models run in hardware-secured enclaves with cryptographic attestation
|
||||
- **Memory encryption**: Data stays encrypted in GPU memory during inference
|
||||
- **Tamper-proof execution**: Verifiable computation guarantees no unauthorized access
|
||||
- **4 TEE providers**: Phala Network (10 models), Tinfoil (4), Chutes (1), Near-AI (3)
|
||||
- **OpenAI-compatible API**: Standard `/v1` endpoints for easy integration
|
||||
- **Streaming**: ✅ Supported on all models
|
||||
- **Function calling**: ✅ Supported on select models
|
||||
- **Vision**: ✅ Supported on Qwen3 VL 30B model
|
||||
- **No hard rate limits**: Fair-use throttling may apply for extreme usage
|
||||
|
||||
## Setup
|
||||
|
||||
### 1. Get API Key
|
||||
|
||||
1. Sign up at [redpill.ai](https://redpill.ai)
|
||||
2. Navigate to **API Keys** in your dashboard
|
||||
3. Create a new API key
|
||||
4. Copy your API key (format: `rp_xxxxxxxxxxxx`)
|
||||
|
||||
### 2. Configure Clawdbot
|
||||
|
||||
**Option A: Environment Variable**
|
||||
|
||||
```bash
|
||||
export REDPILL_API_KEY="rp_xxxxxxxxxxxx"
|
||||
```
|
||||
|
||||
**Option B: Interactive Setup (Recommended)**
|
||||
|
||||
```bash
|
||||
clawdbot onboard --auth-choice redpill-api-key
|
||||
```
|
||||
|
||||
This will:
|
||||
1. Prompt for your API key (or use existing `REDPILL_API_KEY`)
|
||||
2. Show all available GPU TEE models
|
||||
3. Let you pick your default model
|
||||
4. Configure the provider automatically
|
||||
|
||||
**Option C: Non-interactive**
|
||||
|
||||
```bash
|
||||
clawdbot onboard --non-interactive \
|
||||
--auth-choice redpill-api-key \
|
||||
--token "rp_xxxxxxxxxxxx"
|
||||
```
|
||||
|
||||
### 3. Verify Setup
|
||||
|
||||
```bash
|
||||
clawdbot chat --model redpill/deepseek/deepseek-v3.2 "Hello, are you working?"
|
||||
```
|
||||
|
||||
## Model Selection
|
||||
|
||||
After setup, Clawdbot shows all available Redpill models. Pick based on your needs:
|
||||
|
||||
- **Default (our pick)**: `redpill/deepseek/deepseek-v3.2` for strong reasoning with GPU TEE privacy.
|
||||
- **Best reasoning**: `redpill/deepseek/deepseek-r1-0528` or `redpill/moonshotai/kimi-k2-thinking` for complex reasoning tasks.
|
||||
- **Best coding**: `redpill/qwen/qwen3-coder-480b-a35b-instruct` for code generation and analysis.
|
||||
- **Vision tasks**: `redpill/qwen/qwen3-vl-30b-a3b-instruct` for image understanding.
|
||||
- **Fast + capable**: `redpill/meta-llama/llama-3.3-70b-instruct` for balanced performance.
|
||||
|
||||
Change your default model anytime using the `/model` directive in chat:
|
||||
|
||||
```
|
||||
/model redpill/deepseek/deepseek-r1-0528
|
||||
```
|
||||
|
||||
List all available models:
|
||||
|
||||
```bash
|
||||
clawdbot models list | grep redpill
|
||||
```
|
||||
|
||||
## GPU TEE Models (18 Total)
|
||||
|
||||
All models run in hardware-secured GPU TEE environments with cryptographic attestation.
|
||||
|
||||
### Phala Network (10 models)
|
||||
|
||||
| Model ID | Name | Context | Max Output | Features |
|
||||
|----------|------|---------|------------|----------|
|
||||
| `z-ai/glm-4.7-flash` | GLM 4.7 Flash | 203k | 128k | General, multilingual |
|
||||
| `qwen/qwen3-embedding-8b` | Qwen3 Embedding 8B | 33k | 512 | Embeddings |
|
||||
| `phala/uncensored-24b` | Uncensored 24B | 33k | 8k | Uncensored |
|
||||
| `deepseek/deepseek-v3.2` | DeepSeek v3.2 | 164k | 8k | **Default**, reasoning |
|
||||
| `qwen/qwen3-vl-30b-a3b-instruct` | Qwen3 VL 30B | 128k | 8k | Vision |
|
||||
| `sentence-transformers/all-minilm-l6-v2` | All-MiniLM-L6-v2 | 512 | 512 | Embeddings |
|
||||
| `qwen/qwen-2.5-7b-instruct` | Qwen 2.5 7B Instruct | 33k | 8k | General |
|
||||
| `google/gemma-3-27b-it` | Gemma 3 27B IT | 54k | 8k | General |
|
||||
| `openai/gpt-oss-120b` | GPT OSS 120B | 131k | 8k | General |
|
||||
| `openai/gpt-oss-20b` | GPT OSS 20B | 131k | 8k | General |
|
||||
|
||||
### Tinfoil (4 models)
|
||||
|
||||
| Model ID | Name | Context | Max Output | Features |
|
||||
|----------|------|---------|------------|----------|
|
||||
| `moonshotai/kimi-k2-thinking` | Kimi K2 Thinking | 262k | 8k | Reasoning |
|
||||
| `deepseek/deepseek-r1-0528` | DeepSeek R1 | 164k | 8k | Reasoning |
|
||||
| `qwen/qwen3-coder-480b-a35b-instruct` | Qwen3 Coder 480B | 262k | 8k | Code |
|
||||
| `meta-llama/llama-3.3-70b-instruct` | Llama 3.3 70B Instruct | 131k | 8k | General |
|
||||
|
||||
### Chutes (1 model)
|
||||
|
||||
| Model ID | Name | Context | Max Output | Features |
|
||||
|----------|------|---------|------------|----------|
|
||||
| `minimax/minimax-m2.1` | MiniMax M2.1 | 197k | 8k | General |
|
||||
|
||||
### Near-AI (3 models)
|
||||
|
||||
| Model ID | Name | Context | Max Output | Features |
|
||||
|----------|------|---------|------------|----------|
|
||||
| `deepseek/deepseek-chat-v3.1` | DeepSeek Chat v3.1 | 164k | 8k | General |
|
||||
| `qwen/qwen3-30b-a3b-instruct-2507` | Qwen3 30B Instruct | 262k | 8k | General |
|
||||
| `z-ai/glm-4.6` | GLM 4.6 | 203k | 128k | General, multilingual |
|
||||
|
||||
## Which Model Should I Use?
|
||||
|
||||
| Use Case | Recommended Model | Why |
|
||||
|----------|-------------------|-----|
|
||||
| **General chat** | `deepseek/deepseek-v3.2` | Default, strong reasoning, GPU TEE |
|
||||
| **Complex reasoning** | `deepseek/deepseek-r1-0528` | Reasoning-optimized with R1 architecture |
|
||||
| **Long context reasoning** | `moonshotai/kimi-k2-thinking` | 262k context, reasoning-focused |
|
||||
| **Coding** | `qwen/qwen3-coder-480b-a35b-instruct` | Code-specialized, 262k context |
|
||||
| **Vision tasks** | `qwen/qwen3-vl-30b-a3b-instruct` | Only vision model, 128k context |
|
||||
| **Fast + balanced** | `meta-llama/llama-3.3-70b-instruct` | Llama 3.3, good all-around |
|
||||
| **Uncensored** | `phala/uncensored-24b` | No content restrictions |
|
||||
| **Embeddings** | `qwen/qwen3-embedding-8b` | Text embeddings |
|
||||
|
||||
## Pricing
|
||||
|
||||
Redpill uses a credit-based system. Check [redpill.ai/pricing](https://redpill.ai/pricing) for current rates.
|
||||
|
||||
All GPU TEE models incur costs based on:
|
||||
- Input tokens (per 1M tokens)
|
||||
- Output tokens (per 1M tokens)
|
||||
- TEE attestation overhead (minimal)
|
||||
|
||||
## Usage Examples
|
||||
|
||||
```bash
|
||||
# Use default model
|
||||
clawdbot chat --model redpill/deepseek/deepseek-v3.2
|
||||
|
||||
# Use reasoning model
|
||||
clawdbot chat --model redpill/deepseek/deepseek-r1-0528
|
||||
|
||||
# Use coding model
|
||||
clawdbot chat --model redpill/qwen/qwen3-coder-480b-a35b-instruct
|
||||
|
||||
# Use vision model with image
|
||||
clawdbot chat --model redpill/qwen/qwen3-vl-30b-a3b-instruct
|
||||
|
||||
# Switch model mid-chat using /model directive
|
||||
> /model redpill/moonshotai/kimi-k2-thinking
|
||||
```
|
||||
|
||||
## Streaming & Tool Support
|
||||
|
||||
| Feature | Support |
|
||||
|---------|---------|
|
||||
| **Streaming** | ✅ All models |
|
||||
| **Function calling** | ✅ Select models (check model capabilities) |
|
||||
| **Vision/Images** | ✅ Qwen3 VL 30B only |
|
||||
| **JSON mode** | ✅ Supported via `response_format` |
|
||||
|
||||
## Troubleshooting
|
||||
|
||||
### API key not recognized
|
||||
|
||||
```bash
|
||||
echo $REDPILL_API_KEY
|
||||
clawdbot models list | grep redpill
|
||||
```
|
||||
|
||||
Ensure the key starts with `rp_`.
|
||||
|
||||
### Model not available
|
||||
|
||||
Run `clawdbot models list | grep redpill` to see currently available models. All 18 GPU TEE models should be listed.
|
||||
|
||||
### Connection issues
|
||||
|
||||
Redpill API is at `https://api.redpill.ai/v1`. Ensure your network allows HTTPS connections.
|
||||
|
||||
### TEE attestation failed
|
||||
|
||||
If you receive attestation errors:
|
||||
1. Try a different TEE provider model
|
||||
2. Verify your API key is valid
|
||||
3. Check the main Redpill website for service announcements
|
||||
|
||||
## Config File Example
|
||||
|
||||
```json5
|
||||
{
|
||||
env: { REDPILL_API_KEY: "rp_..." },
|
||||
agents: { defaults: { model: { primary: "redpill/deepseek/deepseek-v3.2" } } },
|
||||
models: {
|
||||
mode: "merge",
|
||||
providers: {
|
||||
redpill: {
|
||||
baseUrl: "https://api.redpill.ai/v1",
|
||||
apiKey: "${REDPILL_API_KEY}",
|
||||
api: "openai-completions",
|
||||
models: [
|
||||
{
|
||||
id: "deepseek/deepseek-v3.2",
|
||||
name: "DeepSeek v3.2 (GPU TEE)",
|
||||
reasoning: false,
|
||||
input: ["text"],
|
||||
cost: { input: 0, output: 0, cacheRead: 0, cacheWrite: 0 },
|
||||
contextWindow: 164000,
|
||||
maxTokens: 8192
|
||||
}
|
||||
]
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
## More Information
|
||||
|
||||
- [Redpill AI](https://redpill.ai)
|
||||
- [API Documentation](https://docs.redpill.ai)
|
||||
- [GPU TEE Technology](https://docs.redpill.ai/privacy/overview)
|
||||
- [Pricing](https://redpill.ai/pricing)
|
||||
Loading…
Reference in New Issue
Block a user